» Tag
parquet
7 postsDuckDB Parquet Paging: file_row_number vs OFFSET, and a Correctness Trap
DuckDB Parquet paging compared: file_row_number vs OFFSET performance, plus a hidden data-correctness risk in parallel scans.
Random Access Parquet: Fast Point Queries Over the Data Lake
Random Access Parquet uses an external index to enable low-latency point queries directly on data lake Parquet files, bypassing slow SQL engine overhead.
The New Physics of Columnar Storage: Parquet, Lance, Vortex, Nimble
How AI workloads and modern hardware are reshaping columnar file formats, from Parquet's renovation to new entrants Lance, Vortex, and Nimble.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comApache Iceberg's Variant Type: How Shredding Speeds Up JSON Analytics
Apache Iceberg v3's Variant type and shredding technique make JSON data both flexible and fast to query. Here's how it works under the hood.
Apache Iceberg V3: How Deletion Vectors Rewrote Delete Economics
A deep dive into why deleting rows in Apache Iceberg is hard, how v2's delete files work, and how v3's deletion vectors reshape update economics.
Indexing the Data Lake for Online Point Queries
Spotify and others leverage RAP to optimize point queries in data lakes.
Loading Parquet into Microsoft SQL No Longer Requires Python Tuples
With mssql-python 1.13.0, load Parquet data into Microsoft SQL faster without Python tuples.