Serverless Data Analysis with Dataflow: Side Inputs (Python) Reviews

Man F. · Reviewed כמעט 6 שנים ago

林政憲 . · Reviewed כמעט 6 שנים ago

Martin E. · Reviewed כמעט 6 שנים ago

林政憲 . · Reviewed כמעט 6 שנים ago

Dragan D. · Reviewed כמעט 6 שנים ago

Martin E. · Reviewed כמעט 6 שנים ago

Martin E. · Reviewed כמעט 6 שנים ago

Andrea B. · Reviewed כמעט 6 שנים ago

Luca D. · Reviewed כמעט 6 שנים ago

Dries V. · Reviewed כמעט 6 שנים ago

Line K. · Reviewed כמעט 6 שנים ago

silviu e. · Reviewed כמעט 6 שנים ago

Strangely, it seems the DataFlow Runner executes in the context of the compute service account, rather than the student. Therefore, ran into multitude of permission issues (see below). The workaround is to grant owner rights to the service account 2020-09-23T13:17:59.724859276ZWorkflow failed. Causes: Permissions verification for controller service account failed. IAM role roles/dataflow.worker should be granted to controller service account 364341498746-compute@developer.gserviceaccount.com. 2020-09-23T13:24:44.533862646ZWorkflow failed. Causes: S06:ReadFromBQ+PackageHelp+PackageUse+TotalHelp/GroupByKey+TotalHelp/Combine/Partial+TotalHelp/GroupByKey/Reify+TotalHelp/GroupByKey/Write+TotalUse/GroupByKey+TotalUse/Combine/Partial+TotalUse/GroupByKey/Reify+TotalUse/GroupByKey/Write failed., BigQuery execution failed., Error: Message: Access Denied: Project qwiklabs-gcp-02-7c14a4925c14: User does not have bigquery.jobs.create permission in project qwiklabs-gcp-02-7c14a4925c14. HTTP Code: 403 020-09-23T13:33:28.286129267ZWorkflow failed. Causes: S01:WriteToStorage/Write/WriteImpl/DoOnce/Read+WriteToStorage/Write/WriteImpl/InitializeWrite failed., Unable to rename output files from gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/dax-tmp-2020-09-23_06_29_55-5996025813942692838-S01-1-7d24e914760ac5e5/tmp-7d24e914760ac73e@DAX.avro to gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/tmp-7d24e914760ac73e@*.avro., Unable to rename "gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/dax-tmp-2020-09-23_06_29_55-5996025813942692838-S01-1-7d24e914760ac5e5/tmp-7d24e914760ac73e-shard--try-7a7706440aaf511b-endshard.avro" to "gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/tmp-7d24e914760ac73e-00000-of-00001.avro".

Alan T. · Reviewed כמעט 6 שנים ago

Oleksandr B. · Reviewed כמעט 6 שנים ago

anantachai p. · Reviewed כמעט 6 שנים ago

Chris B. · Reviewed כמעט 6 שנים ago

Pipeline executed successfully and results file is available bucket/javahelp folder, but still progress is shown incomplete in lab.

Charu S. · Reviewed כמעט 6 שנים ago

Rob S. · Reviewed כמעט 6 שנים ago

jirawat s. · Reviewed כמעט 6 שנים ago

jirawat s. · Reviewed כמעט 6 שנים ago

Omar L. · Reviewed כמעט 6 שנים ago

Pavan Reddy V. · Reviewed כמעט 6 שנים ago

Sriram P. · Reviewed כמעט 6 שנים ago

satyendra .. · Reviewed כמעט 6 שנים ago

Mark G. · Reviewed כמעט 6 שנים ago