Snowflake Data Platform & PostgreSQL CDC
Client: US delivery-tech unicorn
A Snowflake platform for a US delivery-tech unicorn with log-based PostgreSQL CDC via Meltano, Dagster on AKS and a Cube.js semantic layer.
The Challenge
Data from production databases, partner APIs, FTP drops and mobile app events lived in separate places, so the company had no single source of truth for reporting.
Our Solution
Designed a Snowflake platform with log-based PostgreSQL CDC through Meltano, Dagster orchestration on AKS, a fault-tolerant FTP ingestion service, and a Cube.js semantic layer feeding Looker. Snowflake roles and permissions are managed in Terraform.
Outcomes
One Snowflake warehouse for databases, APIs and app events
Log-based CDC instead of full-table reloads
Snowflake access managed as code with Terraform and CI/CD
Consistent metrics for BI through a Cube.js semantic layer
Technologies
Have a Similar Project?
Tell us about your data or AI challenge and we'll show you how we would approach it.