An external customer provides you with a daily dump of data from their database. The data flows into Google Cloud Storage GCS as comma-separated values (CSV) files. You want to analyze this data in Google BigQuery, but the data could have rows that are formatted incorrectly or corrupted. How should you build this pipeline?
A. Use federated data sources, and check data in the SQL query.
B. Enable BigQuery monitoring in Google Stackdriver and create an alert.
C. Import the data into BigQuery using the gcloud CLI and set max_bad_records to 0.
D. Run a Google Cloud Dataflow batch pipeline to import the data into BigQuery, and push errors to another dead-letter table for analysis.
|
Download Printable PDF. VALID exam to help you PASS. |
 |
Right D looks good as Dataflow is the solution
Looks like D, with C you will not import anything, stackdriver alerts will not help you with this and with federated resources you wont know what happened with those bad records. D is the most complete one.