← Big Data & Hadoop learning pathBig Data & Hadoop · Module 9 of 10
Big data in the cloud
Run big data workloads on managed cloud services.
📖 Key ideas
- Cloud object storage (S3, GCS, ADLS) replaces HDFS for data lakes.
- Managed Hadoop/Spark: AWS EMR, Google Dataproc, Azure HDInsight.
- Serverless warehouses: BigQuery, Redshift, Snowflake.
- Pay only for what you use; scale on demand.
- Lakehouse platforms (Databricks) combine lakes and warehouses.
💡 Real-life example: Cloud big data is renting a fully equipped kitchen by the hour instead of building your own.
Data lakeStore raw data at scale
Data warehouseStructured data for analytics
BigQueryGoogle's serverless warehouse
LakehouseLake + warehouse features