Use Airflow & GitHub to execute SQL on Snowflake (SimpleHTTPOperator and SnowflakeOperator)

This talk will cover how to use Airflow for Analytics engineers to pull a SQL script stored in a GitHub repository using SimpleHTTPOperator and execute the SQL statement by connecting to Snowflake using SnowflakeOperator and creating an object inside Snowflake. This is useful to help analytics engineers isolate their CICD processes from data engineering teams since mostly Analytics engineers mainly work with SQL scripts. By isolating their pipelines when there are updates to Airflow data engineering pipelines, we don't need to modify any CICD workflow for Analytics engineers since their GitHub repos and scripts are separate. This video will show a demo of Airflow where we build a DAG and use XCOM functionality to pass results of one operator to another.