Master the Fundamental Snowflake concepts & acquire the necessary skills to start implementing Snowflake based solutions
What you’ll learn
- Snowflake Essentials, it’s unique architecture & its differentiation
- Scalability through the virtual warehouse compute clusters
- Staging & Ingesting bulk & streaming data from cloud storage
- Unique features such as zero copy clones, time travel
- Snowflake value proposition through its pricing model
- Secure data sharing with snowflake & non-snowflake users
Who this course is for:
- You already have the basic knowledge of databases and SQL
- If you are a Data Engineer or ETL Developer, you want to learn how snowflake can elevate your career
- If you are an architect who wants to design and deliver a snowflake datawarehouse
- If you are an experienced software/IT professional with knowledge of Java or Python or ETL tools who wants to make a career change to a snowflake developer or a snowflake architect
- This is not for the Snowflake Admin, even though we go through a few of the admin tasks
What is Snowflake ?
Snowflake is cloud based data warehouse and analytical tool. With so many SAAS based Data warehouse applications available currently that are competing against one another, Snowflake stands out among the crowd for it uniqueness in design and approach. Snowflake works on an application that is faster and easier to handle. Unlike other data warehouse systems Snowflake is not built on Big data platforms rather it works on new SQL engine that is best suited for cloud. Having one of the best ACID (atomicity, consistency, isolation, and durability) complaint solutions. One of the USPs of Snowflake’s unique capabilities is in its table structures wherein Micro–Partitions and Data–Clustering are adopted Snowflake allows user to “time travel” i.e., track data changes overtime and view changes made anytime in the past up to a 90–days. Some of the other features of Snowflake are
- Cloning – the clone feature create instant copy of any snowflake object
- Undrop – any dropped object (Databases, schemas, tables etc) can be undropped
- Fail safe – In the event of any disaster like hardware or disk failures. Snowflake engineers can recover the data upto a 7 day period post failure
- Analytics Solution – Snowflake architecture helps in dealing with data and analytics alongside with data warehousing capabilities
-
Data Warehousing and Database concepts- The basics
The basic concept of a Data Warehouse is to facilitate a single version of truth for a company for decision making and forecasting. A Data warehouse is an information system that contains historical and commutative data from single or multiple sources. Data Warehouse Concepts simplify the reporting and analysis process of organizations.
- Cloud Data Warehouse vs Traditional Data Warehouse Concepts
- Cloud Data Warehouse Concepts
- Conclusion: Traditional vs. Data Warehouse Concepts in Brief
- Data Warehouse Architecture: Traditional vs. Cloud
- New Data Warehouse Architectures
- Data Mart vs. Data Warehouse
- The Difference Between a Data Warehouse and a Database
- Data Lake vs. Data Warehouse
- 12 Datawarehouse cloud tools
- Data Warehouse Testing
-
Modern Data Warehouse
A modern data warehouse lets you bring together all your data at any scale easily, and to get insights through analytical dashboards, operational reports, or advanced analytics for all your users.
- BI and Data Warehousing
- Data Warehousing and Data Mining
- The New EDW: Meet the Big Data Stack
- Build An ETL Process with Examples
- ETL – load data into AWS Redshift
- Full vs Incremental Loading in ETL
- Best Cloud-Based and Open Source Tools
- Get Started with ETL
- ETL Testing
- Redshift Architecture, Pricing, and Performance
- Redshift Columnar Storage
- Redshift Cluster 101
- Snowflake and the Future of Data Warehousing
- Google BigQuery Architecture
-
Cloud Basics and Why choose the Cloud Warehouse
Due to their architecture, cloud-based data warehouse offers some major advantages over the traditional systems, such as: Scalability; Reliability; Security; Adaptability; Many organizations cite a lack of resources and expertise as barriers to implementing an on-site data warehouse solution. This is where cloud data warehouses become a preference.
- What is cloud computing?
- Cloud Computing Service Models – IaaS, PaaS, SaaS
- Cloud Computing Deployment Models – Public, Private & Hybrid
- Cloud Computing Basics – Compute
- Cloud Computing Basics – Storage
- Cloud Computing Basics – Network
- Cloud Computing Basics – Serverless
- What is a cloud datawarehouse?
-
Introduction To Snowflake
Introduction to the powerful and unique features that Snowflake provides for ensuring your data is protected, secure, and available.
-
Connecting To Snowflake
This guide will walk you through how to connect to Snowflake. You may need to contact the administrator of your Snowflake account if you lack some of the credentials discussed below.
-
Loading / Unloading Data Into/From Snowflake
These topics describe the concepts and tasks for Data Loading /unloading (i.e. exporting) data from Snowflake tables. Key concepts related to data unloading, as well as best practices.
- Overview of Data Loading/Unloading
- Data Loading/Unloading Considerations
- Preparing to Load/Unload Data
- Bulk Loading/Unloading from Amazon S3
- Bulk Loading/Unloading from a Local File System
- Bulk Loading /Unloading from Microsoft Azure
- Loading Continuously Using Snowpipe
- Loading Using the Web Interface (Limited)
- Querying Data in Staged Files
- Querying Metadata for Staged Files
- Transforming Data During a Load
-
Database Objects and Querying
A database object is any defined object in a database that is used to store or reference data. Anything which we make from create command is known as Database Object. Some of the examples of database objects are : view, table, sequence, indexes, etc.
-
Sharing Data In Snowflake
Snowflake data providers can share data that resides in different databases by using secure views. A secure view can reference objects such as schemas, tables, and other views from one or more databases, as long as these databases belong to the same account.
-
Managing Your Snowflake Account
These topics describe the administrative concepts and tasks associated with managing your account in Snowflake. These topics are intended primarily for administrators (i.e. users with the ACCOUNTADMIN, SYSADMIN, or SECURITYADMIN roles). Account Identifier.
-
Advanced topics
Welcome to Advanced Topics. The goal of this course is to provide you with a deeper understanding of optimizing the usage of snowflake.
- Informatica Cloud Services and Snowflake Integration
- Informatica Snowflake Connector
- Informatica Snowflake JDBC Connection
- Informatica Snowflake Key Range Partitioning
- Informatica Snowflake Objects in Mappings
- Informatica Snowflake Sources in Mappings
- Informatica Snowflake Targets in Mappings
- Informatica Snowflake Lookups in Mappings
- Micro-partitions
- Data Clustering
- Clustering Keys & Clustered Tables
- Using the Spark Snowflake Connector
