https://petascalelabs.com/curriculum/ingestion-and-transport/backfill-strategies/dual-pipeline-reconciliation
Dual-Pipeline Reconciliation · Petascale Labs
Dual-Pipeline Reconciliation — a chapter in Backfill Strategies for Lakehouses on Petascale Labs. Partition-aware, idempotent backfills into Iceberg/Delta along
dualpipelinereconciliationpetascalelabs
https://petascalelabs.com/curriculum/compute-engines/spark-streaming/fault-tolerance-in-dstreams
Fault Tolerance in DStreams · Petascale Labs
Fault Tolerance in DStreams — a chapter in Apache Spark: Streaming on Petascale Labs. DStreams, Structured Streaming, event time, watermarks, Kafka deep integra
fault tolerancepetascalelabs
https://petascalelabs.com/curriculum/storage-and-file-formats/parquet-format-deep-dive-part-2/lab-encrypted-parquet-python
Lab: Encrypted Parquet with Python · Petascale Labs
Lab: Encrypted Parquet with Python — a chapter in Parquet, Part 2: Indexing, Encryption, and Engines on Petascale Labs. Indexing, predicate pushdown, encryption
labencryptedparquetpythonpetascale
https://petascalelabs.com/cookies
Cookie Policy · Petascale Labs
How Petascale Labs uses cookies and similar technologies.
cookie policypetascalelabs
https://petascalelabs.com/topics/checkpointing
Checkpointing - Data Engineering Courses & Hands-On Tools · Petascale Labs
Learn checkpointing for data engineering: the courses that teach it, a free in-browser tool to practice it, and the related concepts to learn next. First chapte
data engineeringhands oncheckpointingcoursestools
https://petascalelabs.com/topics/data-skew
Data skew - Data Engineering Courses & Hands-On Tools · Petascale Labs
Learn data skew for data engineering: the courses that teach it, a free in-browser tool to practice it, and the related concepts to learn next. First chapter of
hands ondataskewengineeringcourses
https://petascalelabs.com/curriculum/query-engines-and-olap/query-engine-foundations/distributed-join-strategies
Distributed Join Strategies · Petascale Labs
Distributed Join Strategies — a chapter in the Query Engine Foundations course on Petascale Labs: production data engineering for senior engineers, with the ful
distributedjoinstrategiespetascalelabs
https://petascalelabs.com/curriculum/dimensional-data-modeling/one-big-table/columnar-economics-made-obt-sane
The Columnar Economics That Made OBT Sane · Petascale Labs
columnareconomicsmadeobtsane
https://petascalelabs.com/curriculum/orchestration-and-pipelines/migrations-and-deprecations/theworldshop-case-study-cron-to-airflow
TheWorldShop Case Study: From Cron+Bash to Airflow in Two Quarters · Petascale Labs
TheWorldShop Case Study: From Cron+Bash to Airflow in Two Quarters — a chapter in Migrations and Deprecations on Petascale Labs. Migrating from cron to Airflow
case studyin twocronbashairflow