Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Ilya S. · Reviewed בערך שעה אחת ago

Ayan B. · Reviewed בערך 2 שעות ago

Dennis C. · Reviewed בערך 3 שעות ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed בערך 6 שעות ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed בערך 7 שעות ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed בערך 8 שעות ago

Armando B. · Reviewed בערך 8 שעות ago

Pedro A. · Reviewed בערך 9 שעות ago

not up to date

Nikola P. · Reviewed בערך 11 שעות ago

Bronislav S. · Reviewed בערך 11 שעות ago

Dominika K. · Reviewed בערך 12 שעות ago

Ayesha M. · Reviewed בערך 13 שעות ago

Rushab B. · Reviewed בערך 15 שעות ago

Sonika Sharma S. · Reviewed בערך 15 שעות ago

No indication if i completed lab

Eugene K. · Reviewed בערך 16 שעות ago

Some instructions were outdated (didn't match with UI when following instructions)

Hugo N. · Reviewed בערך 16 שעות ago

Allen Chen 陳政安 E. · Reviewed בערך 18 שעות ago

Mukund K. · Reviewed בערך 18 שעות ago

Sigala M. · Reviewed בערך 19 שעות ago

Jaime L. · Reviewed בערך 19 שעות ago

스윗 레. · Reviewed בערך 19 שעות ago

Paula V. · Reviewed בערך 22 שעות ago

Vikas G. · Reviewed יום אחד ago

Sebastian S. · Reviewed יום אחד ago

Luis Alvaro M. · Reviewed יום אחד ago