← Google Cloud Platform learning pathGoogle Cloud Platform · Module 8 of 10
Messaging and data pipelines
Move and process data with Pub/Sub and Dataflow.
📖 Key ideas
- Pub/Sub is managed messaging for events.
- Publishers send messages to topics; subscribers receive them.
- Dataflow runs Apache Beam pipelines for batch and streaming.
- Dataproc runs managed Spark/Hadoop.
- Cloud Composer is managed Airflow.
💡 Real-life example: Pub/Sub is a post office: senders drop letters in topics; every subscriber gets a copy.
Pub/SubMessaging service
TopicNamed channel for messages
DataflowManaged Apache Beam
Cloud ComposerManaged Airflow