Tools
Programmers can set up ETL processes using almost any programming language, but building such processes from scratch can become complex. Increasingly, companies are buying ETL tools to help in the creation of ETL processes.
By using an established ETL framework, one may increase one’s chances of ending up with better connectivity and scalability. A good ETL tool must be able to communicate with the many different relational databases and read the various file formats used throughout an organization. ETL tools have started to migrate into Enterprise Application Integration, or even Enterprise Service Bus, systems that now cover much more than just the extraction, transformation, and loading of data. Many ETL vendors now have data profiling, data quality, and metadata capabilities.
Some of the Most popular ETL Tools are:
Open-source ETL frameworks
Apatar
CloverETL
Flat File Checker
Jitterbit 2.0
Pentaho Data Integration Kettle Project
RapidMiner
Scriptella
Talend Open Studio
Proprietary ETL frameworks
Adeptia
IBM InfoSphere DataStage
Informatica PowerCenter
Oracle Data Integrator (ODI)
Ab Initio
Altova MapForce
HiT Software Allora
Digital Fuel Service Flow
WisdomForce DatabaseSync System
Phocas ETL
Microsoft SQL Server Integration Services (SSIS)
Coglin Mill RODIN Data Asset Management
Twister Data Integrator (TDI)
SAS Data Integration Studio
SnapLogic Server
Latest ETL tools and suggested users
- Xplenty: Companies who use ETL and/or ELT workloads; companies who prefer an intuitive drag-and-drop interface that non-technical employees can use; companies who need many pre-built integrations; companies who value data security.
- Talend: Companies who prefer an open-source solution; companies that need many pre-built integrations.
- Stitch: Companies who prefer an open-source solution; companies who prefer a simple ELT process; companies that don’t require complex transformations.
- Informatica PowerCenter: Large enterprises with large budgets and demanding performance needs.
- IBM Infosphere Information Server (Datastage): Large companies, esp retail, banking, healthcare and insurance with need for a robust commercially licensed tool
- Oracle Data Integrator: Existing Oracle customers; companies who use ELT workloads.
- Skyvia: Companies who want a no-code solution; companies that don’t need to perform a lot of transformations.
- Fivetran: Companies that need many pre-built integrations; companies that need the flexibility of multiple data warehouses.
- Striim: Companies that need to comply with GDPR or HIPAA; companies that don’t need to add new data sources (especially SaaS).
- Matillion: Companies that want to use a simple point-and-click interface; companies that only have a limited number of data sources.
- Pentaho: Companies who prefer open-source ETL tools.
- AWS Glue: Existing AWS customers; companies who need a fully managed ETL solution.
- Panoply: Companies who want a combined ETL and data warehouse solution.
- Alooma: Existing Google Cloud Platform customers.
- Hevo Data: Companies who want to add their own data transformations using Python; companies that don’t need to add new data sources.
- FlyData: Companies that only need to work with Redshift data warehouses.