Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow Reviews

Fernando H. · Reviewed 26 ימים ago

some steps did not work

Shivakeerthi K. · Reviewed 26 ימים ago

G CHETHAN A. · Reviewed 26 ימים ago

Vaishnavi M. · Reviewed 26 ימים ago

Scott D. · Reviewed 26 ימים ago

KAVITA R. · Reviewed 26 ימים ago

Sanjivani M. · Reviewed 26 ימים ago

Euphemia Z. · Reviewed 26 ימים ago

Lebogang M. · Reviewed 26 ימים ago

Prajwal P. · Reviewed 26 ימים ago

Vedant M. · Reviewed 26 ימים ago

Looker is not very intuitive and hard to navigate based on lab instructions

Tim S. · Reviewed 26 ימים ago

Somya P. · Reviewed 26 ימים ago

Ilya S. · Reviewed 27 ימים ago

Ayan B. · Reviewed 27 ימים ago

Dennis C. · Reviewed 27 ימים ago

It seems that there is an error in the aggregation for the query in BigQuery. You state that the aggregation groups data by the minute, but both the minute and timestamp attributes were included in the GROUP BY clause. You need to remove the timestamp attribute from the GROUP BY clause in order to aggregate by the minute. Otherwise, data is actually aggregated by the more granular timestamp attribute.

Tyler J. · Reviewed 27 ימים ago

first dataflow job failed second dataflow job was still running after 25 minutes so i am out of time

Yee Man B. · Reviewed 27 ימים ago

ERROR 2026-04-17T15:48:54.803165061Z [severity: ERROR] Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'. { "textPayload": "Failed to start the launcher VM, launcher-20260417084846527656604588736506, because of status code: RESOURCE_EXHAUSTED, reason: One or more operations had an error: 'operation-1776440927222-64fa9e26e7a58-7c3e24c1-9ef901b1': [ZONE_RESOURCE_POOL_EXHAUSTED] 'The zone 'projects/qwiklabs-gcp-02-e8baeaeba268/zones/europe-west4-c' does not have enough resources available to fulfill the request. Try a different zone, or try again later.'.", "insertId": "1fxact9coon", "resource": { "type": "dataflow_step", "labels": { "job_id": "2026-04-17_08_48_46-527656604588736506", "job_name": "streaming-taxi-pipeline", "project_id": "qwiklabs-gcp-02-e8baeaeba268", "step_id": "", "region": "europe-west4" } }, "timestamp": "2026-04-17T15:48:54.803165061Z", "severity": "ERROR", "labels": { "dataflow.googleapis.com/job_id": "2026-04-17_08_48_46-527656604588736506", "dataflow.googleapis.com/log_type": "system", "dataflow.googleapis.com/job_name": "streaming-taxi-pipeline", "dataflow.googleapis.com/region": "europe-west4" }, "logName": "projects/qwiklabs-gcp-02-e8baeaeba268/logs/dataflow.googleapis.com%2Fjob-message", "receiveTimestamp": "2026-04-17T15:48:55.676639069Z", "errorGroups": [ { "id": "COmfkOup6NPaOg" } ] }

Melanie B. · Reviewed 27 ימים ago

Armando B. · Reviewed 27 ימים ago

Pedro A. · Reviewed 27 ימים ago

not up to date

Nikola P. · Reviewed 27 ימים ago

Bronislav S. · Reviewed 27 ימים ago

Dominika K. · Reviewed 27 ימים ago

Ayesha M. · Reviewed 27 ימים ago