Peter Hoffmann

#PANDAS

DuckDB vs. Azure Synapse SQL on-demand with Parquet

Inspired by Uwe Korns post on DuckDB this post shows how to use Azure Synapse SQL-on-Demand to query parquet files with T-SQL on a serverless cloud infrastructure. Read more →

Understanding Predicate Pushdown at the Row-Group Level in Parquet with PyArrow and Python

How predicate pushdown works on row group level in Apache Parquet, and how to use the row group statistics with pyarrow to read only the data you need. Read more →