Training Trains Internship
Student login
← Apache Spark learning path
Apache Spark · Module 9 of 10

Delta Lake and the lakehouse

Add reliability to data lakes with Delta Lake.

📖 Key ideas

  1. Delta Lake adds ACID transactions to Parquet files.
  2. Time travel queries older versions.
  3. MERGE handles upserts.
  4. Schema enforcement prevents bad writes.
  5. Medallion architecture: bronze (raw), silver (clean), gold (business).
💡 Real-life example: Delta Lake is a notebook with version history: you can see and restore any earlier page.
Delta LakeACID table format on data lakes
Time travelQuery older table versions
MERGEUpsert operation
Medallion architectureBronze, silver, gold layers