Traitement de données sans serveur avec Dataflow : écrire un pipeline ETL à l'aide d'Apache Beam et de Dataflow (Java) avis

Leonardo S. · Examiné il y a 7 jours

Luis Antonio C. · Examiné il y a 7 jours

Sriyansh S. · Examiné il y a 7 jours

TARUN KUMAR S. · Examiné il y a 7 jours

Seems like a good lesson, but no workers available means it's not possible to go through it properly

Martin H. · Examiné il y a 7 jours

Sriyansh S. · Examiné il y a 7 jours

Sriyansh S. · Examiné il y a 7 jours

Aubin C. · Examiné il y a 7 jours

The first part of the lab was confusing. The lab gives an ide-url. This was the first time, I saw an ide-url. However, the lab didnt suggest how to use it. I had to do the following out of my own understanding: I had to find a VM Instance in the Project. SSH into it. And then do the following command: cd /home/theia-java-dataflow/training-data-analyst/quests/dataflow/ Maven was not installed, so I had to do the following: sudo apt install maven On running, the following command, I got an error ("ERROR: (gcloud) Invalid choice: 'storage'.") source create_batch_sinks.sh I had to run sudo gcloud components update. Even that didnt work so I had to use echo "Creating pipeline sinks" PROJECT_ID=$(gcloud config get-value project) # GCS buckets #TODO: Add try/catch for the first bucket since qwiklabs #gcloud storage buckets create --location=US gs://$PROJECT_ID gsutil mb -l US gs://$PROJECT_ID #gcloud storage buckets create --location=US --default-storage-class="COLDLINE" gs://$PROJECT_ID-coldline gsutil mb -l US -c COLDLINE gs://$PROJECT_ID-coldline But as several files contained the gcloud commands and I could not change all of the files to gsutil commands. So I had to install a local version of gcloud with the following statements: #Step0: cd ~ #Step1: curl -O https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-cli-linux-x86_64.tar.gz #Step2: tar -xf google-cloud-cli-linux-x86_64.tar.gz #Step3: sudo ./google-cloud-sdk/install.sh I also gto pip3 errors. So I had to install it with below statements: sudo apt-get update sudo apt-get install python3-pip -y Now I am almost at the endo of the lab. I have executed "bash generate_batch_events.sh" but it is stuck at "Installing Packages". I dont think, I would be able to complete the lab.

Sayed Fawad Ali S. · Examiné il y a 8 jours

Sriyansh S. · Examiné il y a 9 jours

Daniel A. · Examiné il y a 9 jours

Gustavo L. · Examiné il y a 10 jours

Ferdie O. · Examiné il y a 10 jours

Harsh A. · Examiné il y a 10 jours

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Examiné il y a 10 jours

Allan L. · Examiné il y a 10 jours

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Examiné il y a 11 jours

Emerson C. · Examiné il y a 11 jours

Iván Marcelo U. · Examiné il y a 12 jours

Francisco M. · Examiné il y a 12 jours

Leonardo M. · Examiné il y a 12 jours

IDE URL wouldn't work, restarting the lab.

Ferdie O. · Examiné il y a 12 jours

Selina C. · Examiné il y a 12 jours

the ide didn't work

Souhail L. · Examiné il y a 13 jours

Sriyansh S. · Examiné il y a 13 jours