Como treinar em larga escala com o serviço Vertex AI Training avaliações

Learnt about Cloud Storage , using buckets and configuring to use with Vertex AI for custom training of ML model

Anik k. · Revisado há 5 horas

Mohammadhossein G. · Revisado há 7 horas

The %%bigquery command cells never work for any labs.

Swapnil K. · Revisado há 12 horas

Seshadri Naidu B. · Revisado há 15 horas

Juan Pablo S. · Revisado há 15 horas

Putinun T. · Revisado há 19 horas

Carlos C. · Revisado há 20 horas

The lab just does not work. %%bigquery CREATE OR REPLACE TABLE taxifare.feateng_valid_data AS SELECT (tolls_amount + fare_amount) AS fare_amount, pickup_datetime, pickup_longitude AS pickuplon, pickup_latitude AS pickuplat, dropoff_longitude AS dropofflon, dropoff_latitude AS dropofflat, passenger_count*1.0 AS passengers, 'unused' AS key FROM `nyc-tlc.yellow.trips` WHERE ABS(MOD(FARM_FINGERPRINT(CAST(pickup_datetime AS STRING)), 10000)) = 2 AND trip_distance > 0 AND fare_amount >= 2.5 AND pickup_longitude > -78 AND pickup_longitude < -70 AND dropoff_longitude > -78 AND dropoff_longitude < -70 AND pickup_latitude > 37 AND pickup_latitude < 45 AND dropoff_latitude > 37 AND dropoff_latitude < 45 AND passenger_count > 0 --------------------------------------------------------------------------- ModuleNotFoundError Traceback (most recent call last) File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery/_versions_helpers.py:154, in BQStorageVersions.try_import(self, raise_if_error) 153 try: --> 154 from google.cloud import bigquery_storage # type: ignore 155 except ImportError: File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery_storage/__init__.py:17 1 # -*- coding: utf-8 -*- 2 # Copyright 2022 Google LLC 3 # (...) 14 # limitations under the License. 15 # ---> 17 from google.cloud.bigquery_storage_v1 import BigQueryReadClient 18 from google.cloud.bigquery_storage_v1.services.big_query_write.client import ( 19 BigQueryWriteClient, 20 ) File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery_storage_v1/__init__.py:19 17 from __future__ import absolute_import ---> 19 import pkg_resources 21 __version__ = pkg_resources.get_distribution( 22 "google-cloud-bigquery-storage" 23 ).version # noqa ModuleNotFoundError: No module named 'pkg_resources' During handling of the above exception, another exception occurred: BigQueryStorageNotFoundError Traceback (most recent call last) File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery/magics/magics.py:736, in _make_bqstorage_client(client, use_bqstorage_api, client_options) 735 try: --> 736 _versions_helpers.BQ_STORAGE_VERSIONS.try_import(raise_if_error=True) 737 except exceptions.BigQueryStorageNotFoundError as err: File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery/_versions_helpers.py:162, in BQStorageVersions.try_import(self, raise_if_error) 157 msg = ( 158 "Package google-cloud-bigquery-storage not found. " 159 "Install google-cloud-bigquery-storage version >= " 160 f"{_MIN_BQ_STORAGE_VERSION}." 161 ) --> 162 raise exceptions.BigQueryStorageNotFoundError(msg) 163 return None BigQueryStorageNotFoundError: Package google-cloud-bigquery-storage not found. Install google-cloud-bigquery-storage version >= 2.0.0. The above exception was the direct cause of the following exception: ImportError Traceback (most recent call last) Cell In[12], line 1 ----> 1 get_ipython().run_cell_magic('bigquery', '', "\nCREATE OR REPLACE TABLE taxifare.feateng_valid_data AS\n\nSELECT\n (tolls_amount + fare_amount) AS fare_amount,\n pickup_datetime,\n pickup_longitude AS pickuplon,\n pickup_latitude AS pickuplat,\n dropoff_longitude AS dropofflon,\n dropoff_latitude AS dropofflat,\n passenger_count*1.0 AS passengers,\n 'unused' AS key\nFROM `nyc-tlc.yellow.trips`\nWHERE ABS(MOD(FARM_FINGERPRINT(CAST(pickup_datetime AS STRING)), 10000)) = 2\nAND\n trip_distance > 0\n AND fare_amount >= 2.5\n AND pickup_longitude > -78\n AND pickup_longitude < -70\n AND dropoff_longitude > -78\n AND dropoff_longitude < -70\n AND pickup_latitude > 37\n AND pickup_latitude < 45\n AND dropoff_latitude > 37\n AND dropoff_latitude < 45\n AND passenger_count > 0\n") File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/IPython/core/interactiveshell.py:2543, in InteractiveShell.run_cell_magic(self, magic_name, line, cell) 2541 with self.builtin_trap: 2542 args = (magic_arg_s, cell) -> 2543 result = fn(*args, **kwargs) 2545 # The code below prevents the output from being displayed 2546 # when using magics with decorator @output_can_be_silenced 2547 # when the last Python token in the expression is a ';'. 2548 if getattr(fn, magic.MAGIC_OUTPUT_CAN_BE_SILENCED, False): File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery/magics/magics.py:557, in _cell_magic(line, query) 554 else: 555 bqstorage_client_options.api_endpoint = args.bqstorage_api_endpoint --> 557 bqstorage_client = _make_bqstorage_client( 558 client, 559 use_bqstorage_api, 560 bqstorage_client_options, 561 ) 563 close_transports = functools.partial(_close_transports, client, bqstorage_client) 565 try: File /opt/conda/envs/tensorflow/lib/python3.10/site-packages/google/cloud/bigquery/magics/magics.py:744, in _make_bqstorage_client(client, use_bqstorage_api, client_options) 737 except exceptions.BigQueryStorageNotFoundError as err: 738 customized_error = ImportError( 739 "The default BigQuery Storage API client cannot be used, install " 740 "the missing google-cloud-bigquery-storage and pyarrow packages " 741 "to use it. Alternatively, use the classic REST API by specifying " 742 "the --use_rest_api magic option." 743 ) --> 744 raise customized_error from err 745 except exceptions.LegacyBigQueryStorageError: 746 pass ImportError: The default BigQuery Storage API client cannot be used, install the missing google-cloud-bigquery-storage and pyarrow packages to use it. Alternatively, use the classic REST API by specifying the --use_rest_api magic option.

Teemu J. · Revisado há 23 horas

Pritam S. · Revisado há 1 day

東悟 松. · Revisado há 1 day

Arihant J. · Revisado há 1 day

Luise W. · Revisado há 1 day

Manasa P. · Revisado há 1 day

It's so buggy.

Eric D. · Revisado há 1 day

No funcionan las celdas con las que viene el notebook.

Joaquín M. · Revisado há 1 day

Kalyani C. · Revisado há 2 days

phani k. · Revisado há 2 days

Rutuja S. · Revisado há 2 days

phani k. · Revisado há 2 days

phani k. · Revisado há 2 days

phani k. · Revisado há 2 days

ANURAG D. · Revisado há 2 days

Swastik S. · Revisado há 2 days

Ryan M. · Revisado há 2 days

Vaishnavi P. · Revisado há 3 days