Training Trains Internship
Student login
← Data Engineering & ETL learning path
Data Engineering & ETL · Module 9 of 10

Cloud data platforms

Build pipelines on AWS, GCP and Azure.

📖 Key ideas

  1. AWS: S3, Glue, Redshift, Athena, Kinesis.
  2. GCP: Cloud Storage, BigQuery, Dataflow, Pub/Sub, Composer.
  3. Azure: ADLS, Data Factory, Synapse, Event Hubs.
  4. Managed services reduce maintenance.
  5. Manage cost: partition, cluster, avoid SELECT *.
💡 Real-life example: Cloud platforms are rented factories with every machine ready; you pay for hours used.
AWS GlueManaged ETL service
BigQueryServerless warehouse
Azure Data FactoryPipeline orchestration service
AthenaSQL on S3 files