Data Engineering
Data engineering builds and operates the pipelines, storage, and validation systems that make data usable.
Follow databases, streaming and batch pipelines, lakehouses, and data quality. Coverage looks at how teams move, store, transform, and maintain data for analytics and AI.
Latest coverage
Articles
NewsSnowflake opens live Iceberg data to external REST Catalog clients
NewsGoogle DeepMind opens PARDIG and SatWeave weather datasets
NewsDatabricks adds push-based CDC path into Unity Catalog
NewsGS Caltex puts SageMaker Canvas models into production pipelines
NewsAWS adds single-shot and retrieval-only modes to Bedrock knowledge bases
NewsConfluent launches Streamhouse and makes Lightning Tables available on AWS
NewsOracle sets 12-month window for AI Lakehouse semantic layer
NewsDatabricks adds Unity Catalog metric views to Power BI in private preview
NewsAWS details how HyperPod data capture feeds model workflows
NewsDatabricks makes Apache Spark 4.3 available in Runtime 19
NewsSnowflake adds Inkling 2 Small to Cortex Training preview
NewsDatabricks adds native Claude OpenTelemetry export to MLflow