HANDS-ON LAB: Getting Started with Data Engineering using Snowflake Notebooks

August 28, 2024 | 10:00 AM PT

Join an instructor-led, virtual hands-on lab to build your first data engineering pipeline using Snowpark in Snowflake notebooks.

In just 10 minutes, you’ll be able to use a one-click tutorial set up to:

  • Load data from Snowflake tables into Snowpark DataFrames
  • Perform exploratory data analysis on Snowpark DataFrames
  • Pivot, aggregate and join data from multiple tables using Snowpark DataFrames
  • Save transformed data into Snowflake tables
  • Schedule Snowflake notebooks to periodically run the data pipeline

A Snowflake expert will also answer your questions live!

 

REGISTER HERE!

WHAT WILL YOU BUILD?

This lab will enable you to to build Python data engineering pipelines using Snowflake native Notebooks. To deep dive after the hands-on lab, this solution provides all the details needed to manage and deploy those Notebooks through an automated CI/CD pipeline from development to production.

Snowflake Features Used

Quickstart
Getting Started with Data Engineering using Snowflake Notebooks

Solution Architecture: Data Engineering Pipelines with Snowflake Notebooks

  • In this use-case, we build a data pipeline with a Notebook to ingest Excel files into Snowflake, and to transform and aggregate data
  • A DAG (or Directed Acyclic Graph) of Tasks are created orchestrate/schedule the pipelines
  • The notebook is then deployed to production using a CI/CD pipeline

HANDS-ON TECHNICAL RESOURCES