Create a bronze-to-silver pipeline template using Snowflake as the destination. This template will use either frankfurter or chess as the data source (since they don't require credentials) and showcase a complete ingestr -> transformation workflow with Snowflake. This template should be able to initialized with bruin init template-name
more about bruin init on : https://getbruin.com/docs/bruin/commands/init.html
Template Structure
Bronze Layer (Ingestr Asset):
- Raw data ingestion using ingestr from frankfurter or chess API
- No transformations, just data extraction to Snowflake
Silver Layer (SQL Asset):
- Aggregates and cleans bronze data from Snowflake tables
- Demonstrates typical transformation patterns
Implementation
Create templates/bronze-silver-snowflake/ with:
- Bronze asset:
assets/bronze_raw_data.asset.yml (ingestr from frankfurter/chess)
- Silver asset:
assets/silver_aggregated.sql (Snowflake SQL transformation)
Acceptance Criteria
Reference Templates
Create a bronze-to-silver pipeline template using Snowflake as the destination. This template will use either frankfurter or chess as the data source (since they don't require credentials) and showcase a complete ingestr -> transformation workflow with Snowflake. This template should be able to initialized with
bruin init template-namemore about bruin init on : https://getbruin.com/docs/bruin/commands/init.html
Template Structure
Bronze Layer (Ingestr Asset):
Silver Layer (SQL Asset):
Implementation
Create
templates/bronze-silver-snowflake/with:assets/bronze_raw_data.asset.yml(ingestr from frankfurter/chess)assets/silver_aggregated.sql(Snowflake SQL transformation)Acceptance Criteria
templates/bronze-silver-snowflake/bruin init bronze-silver-snowflakebruin validatepasses successfullybruin runexecutes the full pipeline successfullyReference Templates