» Tag
data engineering
6 postsHow Airbnb rebuilt its data architecture for a multi-product world
Airbnb explains how its data teams built a consistent yet flexible data architecture using core principles and modeling guidelines for Homes, Experiences and Services.
data engineeringdata architectureairbnbanalyticsNetflix's Data Canary: Validating Catalog Metadata at Scale
After an outage caused by corrupted data rather than code, Netflix built a production-traffic data canary system that detects catalog issues within 10 minutes.
netflixdata-engineeringreliabilitychaos-engineeringAI Technical Debt: Why Generated Code Still Needs Metadata and Review
AI-generated code speeds up data engineering but hides risk. Without structured metadata, review and governance, teams accumulate hidden intent debt.
aidata-engineeringmetadatacode-reviewNetflix's Data Projects: Managing Data Assets at Scale
Netflix introduces Data Projects to manage millions of tables and workflows, replacing fragile per-asset ACLs and user-tied identities with durable, project-level ownership.
netflixdata-engineeringidentity-managementaccess-controlHow Netflix Outgrew Casspactor for Cassandra-to-Iceberg Data Movement
Netflix built a layered, S3-native engine to replace its aging Casspactor connector for moving Cassandra data into Iceberg, fixing scale and reliability issues.
cassandraapache-icebergnetflixdata-engineeringSlack Replaces SSH with REST APIs in EMR Data Pipelines
Slack removed SSH dependency from EMR clusters, migrating 700+ data jobs to a REST-based architecture using YARN Distributed Shell and Quarry.
slackyarnemrrest-api