Insights
Gain expert strategies, real-world perspectives, and best practices in data engineering, analytics, and AI. Explore our latest insights to stay ahead in the ever-evolving data landscape.
Blog posts
Getting to Your First Flow Run: Prefect Worker & Deployment Setup
Run your first data ingestion workflow with Prefect, Docker, and Kubernetes. This guide walks through containerized flow execution, Prefect worker deployment, and clean deployment configs, laying the foundation for a scalable, maintainable orchestration layer.
Flat Tables vs. Snowflake Semantic Models: The Ultimate BI Data Debate
Structuring data for BI is a key decision that impacts performance, scalability, and data consistency. This article compares flat tables and semantic models, highlighting the strengths and trade-offs of each. Learn how a hybrid approach can offer the best of both worlds—combining consistency, flexibility, and efficient analytics across tools and teams.
Driving Sustainability with Data: Improving CO₂ Emissions Reporting Across Supply Chains
Accurate CO₂ emissions reporting is vital for meeting sustainability goals and regulatory requirements. This article delves into the challenges of Scope 3 emissions, the importance of clean data, and how structured data systems like sustainability marts can improve reporting, ensure compliance, and support better decision-making for businesses.
Roles in the Context of the Analytics Workflow
Code-based analytics workflows offer a unique advantage - the ability to combine robust collaboration with strict governance. While technically straightforward to implement, this approach only reaches its full potential when aligned with well-adapted business and analytics processes.
How to Setup Data Platform Infrastructure on Google Cloud Platform with Terraform
Learn how to set up a secure, scalable data platform infrastructure on Google Cloud Platform (GCP) using Terraform. This step-by-step guide covers VPC configuration, Compute Engine setup, firewall rules, Identity-Aware Proxy (IAP), Cloud NAT, and more, ensuring a cost-effective, flexible, and secure foundation for your data platform.
Organizing Networking for Data Platforms: Key Connectivity Options
Optimize your data platform by making informed networking decisions. This article explores how networking impacts ELT workflows, covering key connectivity options, security considerations, and best practices. Learn how to design a secure, scalable, and high-performing data platform architecture with the right networking.