JDBC and ODBC often dominate large-result time. Flight SQL and ADBC keep data columnar from server to client, with Python, Go, and Rust examples.

Arrow Flight SQL and ADBC: Why the Database Driver Is the Slowest Part of Your Query

Route each lakehouse query by shape, not by sender. Signals, rules, and how to keep dashboards, batch jobs, and agents from sharing one engine.

Query Routing at Machine Scale: Dynamic Workload Distribution Across Lakehouse Engines

Build a federated semantic layer across multi-cloud data so one set of governed metric definitions serves BI tools, dashboards, and AI agents identically.

Semantic Layer Federation: One Meaning for Data That Lives Everywhere

Arrow Flight and ADBC move database results as columnar data, ending the row-oriented bottleneck between engines and applications. Here's how.

Apache Arrow Flight and ADBC, and Why Database Connectivity Finally Went Columnar

Agents fail on raw lake data because business rules live in people's heads. Data products with semantic contracts fix this at the source.

Why AI Agents Fail on Raw Data, and What to Give Them Instead

Data freshness needs to become an engineering contract with a measurable value, an owner, and consequences. How to decompose lag, make freshness queryable, and keep agents honest.

Freshness Is a Contract, Not a Note on a Dashboard

A survey of the Apache Iceberg market in July 2026: the state of the specification, platform support, the acquisition wave, the catalog contest, and how to evaluate real Iceberg support.

The Apache Iceberg Market in the Middle of 2026

Consumer hardware, columnar formats, single-node engines, and the Iceberg REST catalog crossed a threshold: a large share of cluster work now runs locally against the same governed tables.

The Whole Lakehouse Fits on Your Laptop Now

The Iceberg and Parquet specifications are co-evolving. Several of the most consequential Iceberg v4 proposals are waiting on Parquet work, and practitioners should read both dev lists.

Iceberg's Next Version Depends on Decisions Being Made in Parquet

Residency is a storage location. Sovereignty is who can compel access, who operates the systems, and whether you can leave. A practical guide to sovereign lakehouse architecture in 2026.

Building a Lakehouse That Stays Inside the Border

Iceberg table maintenance commoditized when every platform started shipping it. What the six operations are, what they cost, and the observability you should keep even when the work is managed.

Table Maintenance Stopped Being a Product

Databricks, Snowflake, and SAP are closing the gap between operational databases and analytical platforms through acquisition, betting on different layers of the same five-part architecture.

Three Vendors Are Rebuilding the Path From Transaction to Agent

Six architectures share the phrase zero-copy, and they have different costs, failure modes, and governance stories. A walk through federation, virtualization, sharing protocols, and materialization.

What Zero-Copy Actually Costs

A detailed breakdown of the five Apache projects powering the open lakehouse in 2026 -- Parquet, Iceberg, Polaris, Arrow, and Ossie -- and how to build one yourself or use a managed platform.

The Breakdown of the Open Lakehouse in 2026: Iceberg, Arrow, Polaris, Parquet, and Ossie, and How to Actually Build One

Block vs. Object Storage: A Deep Dive Into the Foundation of Modern Data, and How the Lakehouse Made the Slow Option Fast

How to use AI agent harnesses for data engineering without losing determinism, reproducibility, and trust in your data pipelines and analytics.

Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust

Preparing Your Data Lakehouse for the EU AI Act: Auditable Lineage and Data Provenance

A Deep Dive Into File Compression: How Data Gets Smaller, Why Codecs Differ, and What to Actually Use in the Lakehouse

The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage

File Encryption for the Lakehouse: The Terminology, the Machinery, and the Hard Problem of Interoperable Encrypted Tables

Open Source Foundations, Explained: What Apache, Linux, Eclipse, and Their Peers Actually Do, and Why Governance Differences Matter

Operational vs. Analytical Systems: Why the Oldest Divide in Data Exists, What Physics Enforces It, and the Honest Truth About Hybrid Systems

Migrating Proprietary Warehouses to Open Lakehouses: The 2026 Playbook for Zero-Copy Metadata Translation

A comprehensive comparison of AI agent tooling across Dremio, Snowflake, Databricks, Microsoft Fabric, AWS, Google Cloud, ClickHouse, VeloDB, SpiceAI, Bauplan, and Qlik.

Data Platform Native AI Agent Tooling in 2026

Learn how Databricks Predictive Optimization, AWS S3 Tables, and Iceberg native actions automate compaction and snapshot management before small files degrade performance.

Automating Table Maintenance Before Small Files Accumulate

Data clean rooms enable secure multi-party analytics without sharing raw data. Learn how Databricks Clean Rooms, AWS Clean Rooms, and BigQuery differential privacy work.

Clean Rooms for Privacy-Preserving Analytics

Apache DataFusion, Velox, and Substrait form the foundation of modern composable query engine stacks. Learn how these components fit together and when to use each.

Building Composable Query Engines with Rust Runtimes

dbt Fusion entered public beta in May 2025 with a Rust-powered runtime that changes how analytics engineers develop, validate, and deploy SQL models. Here's what changed.

How dbt Fusion Reshapes Analytics Engineering

The FOCUS 1.3 specification and native warehouse cost views make real-time cost attribution practical. Learn how to build a FinOps pipeline for Snowflake, BigQuery, and multi-cloud environments.

FinOps for Data Warehouses with Open Billing Data

Kafka 4.0 removes ZooKeeper and ships KRaft and KIP-848 by default. Learn what those changes mean for platform operations, upgrades, and client configurations.

Kafka 4.0 Changes Streaming Platform Operations

OpenLineage provides a standard API for collecting pipeline lineage across Airflow, Spark, Flink, and dbt. Learn how it powers blast radius analysis and incident triage.

OpenLineage as the Spine of Data Observability

Optimize single-node data engineering with DuckDB, DataFusion, Polars, and LakeSail. Compare architectures and learn when to transition to Dremio MPP.

Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail

Apache Iceberg 1.11.0 delivers manifest list encryption, the new pluggable File Format API, credential lifecycle refreshes, and Spark/Flink improvements.

An In-Depth Overview of the Apache Iceberg 1.11.0 Release

What Are Table Formats and Why Were They Needed?

The Metadata Structure of Modern Table Formats

Performance and Apache Iceberg's Metadata

Partition Evolution: Change Your Partitioning Without Rewriting Data

Hidden Partitioning: How Iceberg Eliminates Accidental Full Table Scans

Writing to an Apache Iceberg Table: How Commits and ACID Actually Work

What Are Lakehouse Catalogs? The Role of Catalogs in Apache Iceberg

When Catalogs Are Embedded in Storage

How Data Lake Table Storage Degrades Over Time

Maintaining Apache Iceberg Tables: Compaction, Expiry, and Cleanup

Apache Iceberg Metadata Tables: Querying the Internals

Using Apache Iceberg with Python and MPP Query Engines

Approaches to Streaming Data into Apache Iceberg Tables

Hands-On with Apache Iceberg Using Dremio Cloud

Migrating to Apache Iceberg: Strategies for Every Source System

How Query Engines Think: The Tradeoffs Behind Every Data System

Row vs. Column: How Storage Layout Shapes Everything

How Databases Organize Data on Disk: Pages, Blocks, and File Formats

B-Trees, LSM Trees, and the Indexing Tradeoff Spectrum

Inside the Query Optimizer: How Engines Pick a Plan

Volcano, Vectorized, Compiled: How Engines Execute Your Query

Buffer Pools, Caches, and the Memory Hierarchy

Partitioning, Sharding, and Data Distribution Strategies

Hash, Sort-Merge, Broadcast: How Distributed Joins Work

Concurrency, Isolation, and MVCC: How Engines Handle Contention

Learn about the Apache Software Foundation's history, governance model, and why it matters for open source data lakehouse technologies like Iceberg, Parquet, and Arrow.

Apache Software Foundation: History, Purpose, and Process

A deep dive into Apache Parquet's columnar storage format, encoding strategies, and why it's the backbone of modern data lakehouse architectures.

What is Apache Parquet? Columns, Encoding, and Performance

Understand how Apache Iceberg brings ACID transactions, schema evolution, and time travel to object storage, enabling the modern open data lakehouse.

What is Apache Iceberg? The Table Format Revolution

Apache Polaris is the open-source Iceberg REST catalog that enables multi-engine interoperability across your entire lakehouse ecosystem.

What is Apache Polaris? Unifying the Iceberg Ecosystem

Apache Arrow provides a standardized in-memory columnar format that eliminates serialization overhead between query engines, eliminating the cost of data movement.

What is Apache Arrow? Erasing the Serialization Tax

Learn how to combine Apache Iceberg, Apache Parquet, Apache Arrow, and Apache Polaris into a complete, vendor-neutral open data lakehouse.

Assembling the Apache Lakehouse: The Modular Architecture

Explore how the Apache Lakehouse stack enables agentic AI systems to autonomously query, reason over, and act on large-scale structured data.

Agentic Analytics on the Apache Lakehouse

How to Think Like a Data Engineer

How to Design Reliable Data Pipelines

Data Quality Is a Pipeline Problem, Not a Dashboard Problem

Idempotent Pipelines: Build Once, Run Safely Forever

Schema Evolution Without Breaking Consumers

Batch vs. Streaming: Choose the Right Processing Model

Partition and Organize Data for Performance

Testing Data Pipelines: What to Validate and When

Pipeline Observability: Know When Things Break

Data Engineering Best Practices: The Complete Checklist

An updated introduction to Apache Iceberg

A 2026 Introduction to Apache Iceberg

A look back at key developments in Apache Iceberg, Polaris, Parquet, and Arrow in 2025.

2025 Year in Review Apache Iceberg, Polaris, Parquet, and Arrow

Discover DremioFrame and IceFrame, two new Python libraries that simplify working with Dremio and Apache Iceberg. Learn how these tools streamline data management and enhance productivity for modern data teams.

dremioframe & iceberg - Pythonic interfaces for Dremio and Apache Iceberg

Discover dremioframe, a new Python library that offers a DataFrame-like experience for interacting with Dremio's data lakehouse platform. Learn how to leverage its intuitive API to streamline your data engineering workflows.

Introducing dremioframe - A Pythonic DataFrame Interface for Dremio

Walkthrough with the new trial of the Dremio Cloud Platform

Comprehensive Hands-on Walk Through of Dremio Cloud Next Gen (Hands-on with Free Trial)

A curated guide to mastering Apache Iceberg, data lakehouse architectures, and the emerging field of Agentic AI for data professionals.

2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI

Dive into the world of commercial Iceberg catalogs and discover how they enhance data lakehouse architectures for modern data engineering.

An Exploration of the Commercial Iceberg Catalog Ecosystem

Exploring paths to a universal lakehouse catalog that supports multiple data formats and engines, building on Apache Iceberg's success.

Building a Universal Lakehouse Catalog - Beyond Iceberg Tables

Learn how to leverage Apache Iceberg with Apache Polaris and Apache Spark to build scalable and efficient data lakehouses.

Intro to Apache Iceberg with Apache Polaris and Apache Spark

What's Coming in Apache Iceberg v4: A Deep Dive into the Future of Open Table Formats

The State of Apache Iceberg v4 - October 2025 Edition

Understanding Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

What is the Data Lakehouse and the Data Lakehouse Ecosystem? This comprehensive guide covers everything you need to know about the Data Lakehouse architecture, open table formats like Apache Iceberg, Delta Lake, Apache Hudi, and Apache Paimon, and the modern data ecosystem that supports them.

The 2025 & 2026 Ultimate Guide to the Data Lakehouse and the Data Lakehouse Ecosystem

Unlocking the Power of Agentic AI with Apache Iceberg and Dremio

Guide on How to Be Part of the Lakehouse Community

How to Discover or Organize Lakehouse & Apache Iceberg Meetups

Introduction to the terms in data engineering

Post Search