Table of Contents
Introduction to OpenRefine Extensions
Messy data is useless data – this is the first thing that comes into your mind when you encounter chaotic, sloppy, and irregular content. Extra spaces, duplicate records, misspellings, or unstructured format needs to be cleaned up before starting a proper data analysis. You’ll agree that being a data analyst does not imply cleaning “dirty” material, though this process takes a major part of analytic time. That’s why it’s critical to prepare it first. In this article, we’ll learn about a powerful tool called OpenRefine and how it can help us with data cleaning.About OpenRefine and Its Alternatives
OpenRefine software, a former Google Refine, is a robust desktop application that will help to fix inconsistencies in your extracted content and transform it into a clean, near-perfect source for further analysis.
OpenRefine has the following features:
Today there are a lot of OpenRefine alternatives that can be used for content transformation, but as a rule, they are pretty expensive. On the other hand, OpenRefine is a free and open-source tool that can help you clean up your content and not only. OpenRefine also enables you to:
While using OpenRefine, keep in mind the following key points:
But that’s not all, there are extra services that you can use only after
downloading OpenRefine extensions. OpenRefine has lots of tutorials and a
large community ready to help you with any matter, from the simplest to
the toughest one.
How to use OpenRefine
Installing OpenRefine
To download OpenRefine on your computer, make the following steps:- Go to http://openrefine.org/download.html to download and install it.
- Run it by clicking on openrefine.exe
- Wait until it is opened with Firefox or Chrome (make sure that one of these browsers is set as a default one)
- If OpenRefine is not automatically opened, point your web browser at http://127.0.0.1:3333/ or http://localhost:3333/ and run it again.
Creating a project
Let’s start with creating a project with OpenRefine.- Prepare a .csv file with content to be cleaned
- Run OpenRefine
- Select the Create Project tab
- Click on the Choose Files button and select the file.
- Click on Next to begin the uploading.
- When the file is uploaded, name the project and click on Create Project.
A screen with your data log will appear where you can see your content
to be cleaned.
- Change the Settings available on the bottom of the screen according to your needs.
- Click on Create Project to finish importing.
Parsing data
While proceeding with further parsing, you can consider the following options by clicking the arrow on the required column:Exporting data
After finishing with parsing, you need to export the cleaned dataset:- Click on the Export button.
- Select the required format.
OpenRefine Alternatives
Several other data cleaning tools can be used as an alternative to OpenRefine.- Trifacta data engineering tool. The tool has built-in analytics, GitHub code quality control, and integration with AWS, Google Cloud, and Microsoft Azure. It has a free trial. However, due to the extended functionality, all plans are premium, with the starter premium license costing $80 per user per month.
- Tibco Clarity tool is a cloud-based data cleansing service with a free 30-day trial. The standard plan starts at $100 per month.
- Melissa Clean Suite for CRM – is a part of Melissa data management service. It has similar functions and works with the most popular data formats and compressed archives. The pricing is credit-based at $4/1,000 credits.
- IBM InfoSphere QualityStage is a very powerful tool allowing you to investigate, clean, and organize data. One of its characteristic features is deep data profiling with built-in data classes. It can save you a lot of hours.
- Mr. Data Converter – a simple and free tool that can be useful if you work with single-page content and clean it up manually. It converts CSV / Exel data into web formats (HTML, JSON, XML).
