Análise de dados sem servidor com o Dataflow: entradas secundárias (Python) avaliações

Man F. · Revisado há almost 6 years

林政憲 . · Revisado há almost 6 years

Martin E. · Revisado há almost 6 years

林政憲 . · Revisado há almost 6 years

Dragan D. · Revisado há almost 6 years

Martin E. · Revisado há almost 6 years

Martin E. · Revisado há almost 6 years

Andrea B. · Revisado há almost 6 years

Luca D. · Revisado há almost 6 years

Dries V. · Revisado há almost 6 years

Line K. · Revisado há almost 6 years

silviu e. · Revisado há almost 6 years

Strangely, it seems the DataFlow Runner executes in the context of the compute service account, rather than the student. Therefore, ran into multitude of permission issues (see below). The workaround is to grant owner rights to the service account 2020-09-23T13:17:59.724859276ZWorkflow failed. Causes: Permissions verification for controller service account failed. IAM role roles/dataflow.worker should be granted to controller service account 364341498746-compute@developer.gserviceaccount.com. 2020-09-23T13:24:44.533862646ZWorkflow failed. Causes: S06:ReadFromBQ+PackageHelp+PackageUse+TotalHelp/GroupByKey+TotalHelp/Combine/Partial+TotalHelp/GroupByKey/Reify+TotalHelp/GroupByKey/Write+TotalUse/GroupByKey+TotalUse/Combine/Partial+TotalUse/GroupByKey/Reify+TotalUse/GroupByKey/Write failed., BigQuery execution failed., Error: Message: Access Denied: Project qwiklabs-gcp-02-7c14a4925c14: User does not have bigquery.jobs.create permission in project qwiklabs-gcp-02-7c14a4925c14. HTTP Code: 403 020-09-23T13:33:28.286129267ZWorkflow failed. Causes: S01:WriteToStorage/Write/WriteImpl/DoOnce/Read+WriteToStorage/Write/WriteImpl/InitializeWrite failed., Unable to rename output files from gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/dax-tmp-2020-09-23_06_29_55-5996025813942692838-S01-1-7d24e914760ac5e5/tmp-7d24e914760ac73e@DAX.avro to gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/tmp-7d24e914760ac73e@*.avro., Unable to rename "gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/dax-tmp-2020-09-23_06_29_55-5996025813942692838-S01-1-7d24e914760ac5e5/tmp-7d24e914760ac73e-shard--try-7a7706440aaf511b-endshard.avro" to "gs://qwiklabs-gcp-02-7c14a4925c14/staging/javahelpjob.1600867790.713577/tmp-7d24e914760ac73e-00000-of-00001.avro".

Alan T. · Revisado há almost 6 years

Oleksandr B. · Revisado há almost 6 years

anantachai p. · Revisado há almost 6 years

Chris B. · Revisado há almost 6 years

Pipeline executed successfully and results file is available bucket/javahelp folder, but still progress is shown incomplete in lab.

Charu S. · Revisado há almost 6 years

Rob S. · Revisado há almost 6 years

jirawat s. · Revisado há almost 6 years

jirawat s. · Revisado há almost 6 years

Omar L. · Revisado há almost 6 years

Pavan Reddy V. · Revisado há almost 6 years

Sriram P. · Revisado há almost 6 years

satyendra .. · Revisado há almost 6 years

Mark G. · Revisado há almost 6 years