Ab Initio Software

Reading Time: 2 minutes

Ab Initio

    Introduction to Ab initio software
      Module 1: Ab initio Architecture
      • Understanding GDE
      • Understanding Co-op System
      • Understanding EME/Application hub

      Module 2: Understanding Host connection settings

      • Configure host settings

      Module 3:Understanding Abinitio Jobs/ Graphs

      • Basics of Graphs
      • Building and executing graphs
      • Understanding Sandboxes/Projects

      Module 4: Understanding components of a graph

      • Record formats, DML, Transform functions, Key specifiers
      • Dataset components/ Table components/Program components
      • Layout
        vParameters
      • Validating the graphs and understanding the error messages
      • Component Overview-Editors:
        Record Format Editors ,
        Expression Editors ,
        Transform Editors ,
        Key Spefifier Editors ,
        Package Editiors ,
        Variable Editors .

      Module 5: Component Overview-Dataset components

      • Input file
      • Output File
      • Intermediate file
      • Lookup files and Lookup Functions
      • Filter by expression
      • Dedup sorted
      • Reformat
      • Aggregate
      • Scan
      • Rollup
      • Join
      • Match sorted
      • Normalize
      • Denormalize Sorted

      Module 6: Understanding partitioning Concepts and multi files

      • Understanding Multi files
      • Understanding Parallelism:
        Data Parallelism ,
        Component Parallelism ,
        Pipeline parallelism .

      Module 7: Component Overview-Partition components

      • Broadcast
      • Partition by key
      • Partition by expression
      • Partition by round robin
      • Partition by range
      • Partition by load balance

      Module 8: Component Overview-Departition components

      • Gather
      • Concatenate
      • Interleave
      • Merge

      Module 9: Component Overview-Database Components, DBC file configuration

      • Understanding database configuration
      • Input table
      • Output table
      • Run SQL
      • Truncate Table
      • Update Table
      • Join with DB

      Module 10: Component Overview- Miscellaneous Components

      • Redefine format
      • Gather Logs
      • Replicate
      • Run Program
      • Trash

      Module 11:Component Overview- Validate Components

      • Check Order
      • Compare Records
      • Validate Records
      • Generate Record
      • Create Data
      • Compute Checksum

      Module 12: Understanding Performance Tuning

      • Component Folding

      Module 13: Additional Graph concepts

      • Tagging
      • Branching
      • Checkin-Checkout
      • Locking
      • Common projects
      • Dependancy analysys/Impact analysys
      • Generic Graphs/Reusable Graphs
      • Conditional components
      • Concept of Phases and check point

      Module 14: Understanding Plans/ConductITUnderstanding Continuous Flows

        Module 15: Understanding various command line options/ configuration Variables

        • m commands
        • air commands
        • configuration variables
        • Environment variables