Use Serverless for Apache Spark to Load BigQuery Reviews

Juveriya N. · Reviewed over 1 year ago

Ulu Kagan B. · Reviewed over 1 year ago

Bikramjit S. · Reviewed over 1 year ago

Tomi A. · Reviewed over 1 year ago

Angel T. · Reviewed over 1 year ago

srikanth b. · Reviewed over 1 year ago

Rim M. · Reviewed over 1 year ago

麗奈 谷. · Reviewed over 1 year ago

Thank you so much!

J JESUS G. · Reviewed over 1 year ago

Juan C. · Reviewed over 1 year ago

The below instruction could have been in little more detail. As I found dataproc identification tool not visible. Next, you're going to set a few environment variables into VM instance terminal and execute a Spark template to load data into BigQuery. Set the following environment variables for the Dataproc Serverless environment.

Sameer S. · Reviewed over 1 year ago

sandeep s. · Reviewed over 1 year ago

Jason M. · Reviewed over 1 year ago

error when submitting spark job ERROR: (gcloud.beta.dataproc.batches.submit.pyspark) Batch job is FAILED. Detail: Insufficient 'CPUS' quota. Requested 12.0, available 11.0. Your resource request exceeds your available quota. See https://cloud.google.com/compute/resource-usage. Use https://cloud.google.com/docs/quotas/view-manage#requesting_higher_quota to request additional quota. Running auto diagnostics on the batch. It may take few minutes before diagnostics output is available. Please check diagnostics output by running 'gcloud dataproc batches describe' command.

max s. · Reviewed over 1 year ago

trevor a. · Reviewed over 1 year ago

Murilo S. · Reviewed over 1 year ago

Sergiu D. · Reviewed over 1 year ago

Thanks Google

Wisdom K. · Reviewed over 1 year ago

Task 3.2 fails as the spark job needs additional IAM permissions to run the script. After adding the required permission the script passed without any issues. Lab needs to be updated with this additional step.

Vamshi K. · Reviewed over 1 year ago

Kirit C. · Reviewed over 1 year ago

there are some errors - just re-try after 2-3 mins

Tomasz M. · Reviewed over 1 year ago

Maitreyee R. · Reviewed over 1 year ago

Dawid G. · Reviewed over 1 year ago

Dmitry P. · Reviewed over 1 year ago

Task 3 check didn't work, but I was able to see the data in Task 4. Seems like something wrong with the check in Task 3.

Nick F. · Reviewed over 1 year ago