ETL Testing Course syllabus

Module 1 : DWH Data Ware Housing Concepts

• What is Data Warehouse?
• Need of Data Warehouse
• Introduction to OLTP, ETL and OLAP Systems
• Difference between OLTP and OLAP
• Data Warehouse Architecture
• Data Marts
• ODS [Operational Data Store]
• Dimensional Modelling
• Difference between relation and dimensional modelling
• Star Schema and Snowflake Schema
• What is fact table
• What is Dimension table
• Normalization and De-Normalization

Module 2 : ETL Testing

• ETL architecture.
• What is ETL and importance of ETL testing
• How DWH ETL Testing is different from the Application Testing
• SDLC/STLC in the ETL Projects (ex: V Model, Water fall model)

Module 3 : Challenges in DWH ETL Testing compare to other testing

• Incompatible and duplicate data.
• Loss of data during ETL process.
• Testers have no privileges to execute ETL jobs by their own.
• Volume and complexity of data is very huge.
• Fault in business process and procedures.
• Trouble acquiring and building test data.

Module 4 : ETL Testing Work flow activities involved

• Analyze and interpret business requirements/ workflows to Create estimations
• Approve requirements and prepare the Test plan for the system testing
• Prepare the test cases with the help of design documents provided by the
• developer team
• Execute system testing and integration testing.
• Best practices to Create quality documentations (Test plans, Test Scripts and Test closure summaries)
• How to detect the bugs in the ETL testing
• How to report the bugs in the ETL testing
• How to co-ordinate with developer team for resolving the defects

Module 5 : Types of ETL Testing

• Data completeness.
• Data transformation.
• Data quality.
• Performance and scalability.
• Integration testing.
• User-acceptance testing.
• SQL Queries for ETL Testing
• Incremental load testing
• Initial Load / Full load testing

Module 6 : Different ETL tools available in the market

• Informatica
• Ab Initio
• IBM Data stage

Module 7 : Power Center Components

• Designer
• Repository Manager
• Workflow Manager
• Workflow Monitor
• Power Center Admin Console

Module 8 : Informatica Concepts and Overview

• Informatica Architecture.

Module 9 : Sources

• Working with relational Sources
• Working with Flat Files

Module 10 : Targets

• Working with Relational Targets
• Working with Flat file Targets

Module 11 : Transformations – Active and Passive Transformations

• Expression
• Lookup –Different types of lookup Caches
• Sequence Generator
• Filter
• Joiner
• Sorter
• Rank
• Router
• Aggregator
• Source Qualifer
• Update Strategy
• Normalizer
• Union
• Stored Procedure
• Slowly Changing Dimension
• SCD Type1
• SCD Type2 — Date, Flag and Version
• SCD Type3

Module 12 : Workflow Manger

• Creating Reusable tasks
• Workflows, Worklets & Sessions
• Tasks
• Indirect Loading
• Constraint based load ordering
• Target Load plan
• Worklet ,Mapplet ,Resuable transformation
• Migration ?ML migration and Folder Copy.
• Scheduling Workflow
• Parameter and variables
• XML Source, Target and Transformations

Module 13 : Performance Tuning

• Pipeline Partition
• Dynamic Partition
• Pushdown optimization
• Preparation of Test Cases
• Executing Test case
• Preparing Sample data
• Data validation in Source and target
• Load and performance testing
• Unit testing Procedures.
• Error handling procedures.

Meet Ananth Tirumanur. Hi there 👋

I work on projects in data science, big data, data engineering, data modeling, software engineering, and system design.

• 👨‍💻 All of my projects are available at https://github.com/akrish1982
• 💬 Ask me about Data engineering, SQL, Databases, Data pipelines, Data infrastructure
• 📄 My work history: https://www.linkedin.com/in/ananthtirumanur/
• ⚡ Fun fact: Marathoner & Casual Birding enthusiast

Connect with me:

• Twitter: @akrish82
• LinkedIn: https://linkedin.com/in/ananthtirumanur/

My Resources:

• LinkedIn Newsletter: Data Engineering with AWS
• Udemy Course: AWS Certified Data Engineer Associate Practice Test
• Python Crash Course: Python Crash Course on Gumroad

Languages and Tools:

AWS, Bash, Cassandra, Django, Docker, Elasticsearch, Flask, Git, Go, Grafana, Hadoop, Hive, Hugo, Kafka, Kubernetes, Linux, MariaDB, MySQL, Pandas, PostgreSQL, Python, Redis, Scala, Scikit-learn, SQLite