GCP Service |
Purpose |
Cloud Storage |
Stores historical energy data, IoT sensor readings, and preprocessed datasets. |
Pub/Sub |
Streams real-time energy sensor data to processing pipelines. |
Dataflow |
Processes and aggregates real-time and batch energy data for LSTM training and inference. |
BigQuery |
Stores structured energy consumption data for historical analysis and feature engineering. |
Vertex AI / ML Engine |
Train and deploy LSTM models for energy forecasting; supports GPUs/TPUs for faster computation. |
Vertex AI Pipelines |
Automates end-to-end ML workflow: preprocessing → training → evaluation → deployment. |
Cloud Functions |
Event-driven triggers for model retraining or prediction updates when new data arrives. |
Cloud Monitoring / Logging |
Monitors model performance, latency, and resource utilization. |
Looker / Data Studio |
Visualizes energy forecasts, trends, and deviations from actual consumption. |