Your infrastructure includes a set of YouTube channels. You have been tasked with creating a process for sending the YouTube channel data to Google Cloud for analysis. You want to design a solution that allows your world-wide marketing teams to perform ANSI SQL and other types of analysis on up-to-date YouTube channels log data. How should you set up the log data transfer into Google Cloud?
A. Use Storage Transfer Service to transfer the offsite backup files to a Cloud Storage Multi-Regional storage bucket as a final destination.
B. Use Storage Transfer Service to transfer the offsite backup files to a Cloud Storage Regional bucket as a final destination.
C. Use BigQuery Data Transfer Service to transfer the offsite backup files to a Cloud Storage Multi-Regional storage bucket as a final destination.
D. Use BigQuery Data Transfer Service to transfer the offsite backup files to a Cloud Storage Regional storage bucket as a final destination.
Option C D talks about offsite backup files, to Bigquery and not from the SaaS application to bigquery,
IMO C D are ruled out.
Both C and D are invalid, because BigQuery Data Transfer Service can transfer data to BigQuery dataset only, cloud storage bucket is not possible as destination here.
https://cloud.google.com/bigquery-transfer/docs/transfer-service-overview
Between A and B, I will choose A.
BigQuery Data Transfer Service to move data from SaaS applications to BigQuery.
Transfer Service for on-premises data(beta) to move data from your on-premises machines to Cloud Storage.
https://cloud.google.com/storage-transfer/docs/overview
c
https://cloud.google.com/bigquery-transfer/docs/youtube-channel-transfer
The BigQuery Data Transfer Service automates data movement from SaaS applications to Google BigQuery on a scheduled, managed basis. THis is valid for youtube data.
Now between C and D, it has to be in a multiregional storage bucket since the querys will come from worldwide.
Thanks is C I guess
BigQuery Data Transfer Service can only transfer data into BigQuery. (cf: https://cloud.google.com/bigquery-transfer/docs/transfer-service-overview)
> Currently, you cannot use the BigQuery Data Transfer Service to transfer data out of BigQuery.
The data has to be analysed “worldwide”, says the brief.
To have perfomant queries, storage should be worldwide (cf: https://cloud.google.com/bigquery/external-data-sources?hl=en#data-locations)
> When you query data in an external data source such as Cloud Storage, the data you’re querying must be in the same location as your BigQuery dataset.