Como executar jobs do Apache Spark no Cloud Dataproc avaliações

Luigino N. · Revisado há almost 2 years

Hello, I found an issue where I had to replace the name "sparktodp" by the correct name of my cluster ("cluster-e93e") in the command and script below: export DP_STORAGE="gs://$(gcloud dataproc clusters describe sparktodp --region=us-east1 --format=json | jq -r '.config.configBucket')" #!/bin/bash gcloud dataproc jobs submit pyspark \ --cluster sparktodp \ --region us-east1 \ spark_analysis.py \ -- --bucket=$1

Crhistian S. · Revisado há almost 2 years

Great learning!

Jitendra J. · Revisado há almost 2 years

Sandra C. · Revisado há almost 2 years

Himanshu S. · Revisado há almost 2 years

Nayan P. · Revisado há almost 2 years

Dominik F. · Revisado há almost 2 years

Pankaj G. · Revisado há almost 2 years

R S. · Revisado há almost 2 years

Foo Hoo G. · Revisado há almost 2 years

kavan q. · Revisado há almost 2 years

Miguel F. · Revisado há almost 2 years

Robert P. · Revisado há almost 2 years

Sangeet B. · Revisado há almost 2 years

Good explanation about how to start with dataproc and how to migrate some pipelines.

Yadder A. · Revisado há almost 2 years

yasmine c. · Revisado há almost 2 years

Jared R. · Revisado há almost 2 years

JORGE ALEJANDRO C. · Revisado há almost 2 years

Srinivasa R. · Revisado há almost 2 years

Very technical lab but the instructions were well laid out

Litsietsi Moeketso M. · Revisado há almost 2 years

Dhanashree L. · Revisado há almost 2 years

FRANCISCO V. · Revisado há almost 2 years

Needs to be break down in parts , Its to overwhelming .

Supriya k. · Revisado há almost 2 years

Ashish O. · Revisado há almost 2 years

Venkat V. · Revisado há almost 2 years