Databricks Databricks-Certified-Professional-Data-Engineer 問題集

質問 1：
Each configuration below is identical to the extent that each cluster has 400 GB total of RAM, 160 total cores and only one Executor per VM.
Given a job with at least one wide transformation, which of the following cluster configurations will result in maximum performance?
A. * Total VMs: 8
* 50 GB per Executor
* 20 Cores / Executor
B. * Total VMs; 1
* 400 GB per Executor
* 160 Cores / Executor
正解：A
解説: (Topexam メンバーにのみ表示されます)

質問 2：
An upstream source writes Parquet data as hourly batches to directories named with the current date. A nightly batch job runs the following code to ingest all data from the previous day as indicated by the date variable:

Assume that the fields customer_id and order_id serve as a composite key to uniquely identify each order.
If the upstream system is known to occasionally produce duplicate entries for a single order hours apart, which statement is correct?
A. Each write to the orders table will run deduplication over the union of new and existing records, ensuring no duplicate records are present.
B. Each write to the orders table will only contain unique records; if existing records with the same key are present in the target table, these records will be overwritten.
C. Each write to the orders table will only contain unique records, and only those records without duplicates in the target table will be written.
D. Each write to the orders table will only contain unique records, but newly written records may have duplicates already present in the target table.
E. Each write to the orders table will only contain unique records; if existing records with the same key are present in the target table, the operation will tail.
正解：D
解説: (Topexam メンバーにのみ表示されます)

質問 3：
Where in the Spark UI can one diagnose a performance problem induced by not leveraging predicate push-down?
A. In the Stage's Detail screen, in the Completed Stages table, by noting the size of data read from the Input column
B. In the Query Detail screen, by interpreting the Physical Plan
C. In the Delta Lake transaction log. by noting the column statistics
D. In the Executor's log file, by gripping for "predicate push-down"
E. In the Storage Detail screen, by noting which RDDs are not stored on disk
正解：B
解説: (Topexam メンバーにのみ表示されます)

質問 4：
A distributed team of data analysts share computing resources on an interactive cluster with autoscaling configured. In order to better manage costs and query throughput, the workspace administrator is hoping to evaluate whether cluster upscaling is caused by many concurrent users or resource-intensive queries.
In which location can one review the timeline for cluster resizing events?
A. Executor's log file
B. Ganglia
C. Workspace audit logs
D. Driver's log file
E. Cluster Event Log
正解：E

質問 5：
A data engineer wants to reflector the following DLT code, which includes multiple definition with very similar code:

In an attempt to programmatically create these tables using a parameterized table definition, the data engineer writes the following code.

The pipeline runs an update with this refactored code, but generates a different DAG showing incorrect configuration values for tables.
How can the data engineer fix this?
A. Load the configuration values for these tables from a separate file, located at a path provided by a pipeline parameter.
B. Convert the list of configuration values to a dictionary of table settings, using table names as keys.
C. Convert the list of configuration values to a dictionary of table settings, using different input the for loop.
D. Wrap the loop inside another table definition, using generalized names and properties to replace with those from the inner table
正解：B
解説: (Topexam メンバーにのみ表示されます)

質問 6：
A table is registered with the following code:

Both users and orders are Delta Lake tables. Which statement describes the results of querying recent_orders?
A. All logic will execute when the table is defined and store the result of joining tables to the DBFS; this stored data will be returned when the table is queried.
B. Results will be computed and cached when the table is defined; these cached results will incrementally update as new records are inserted into source tables.
C. All logic will execute at query time and return the result of joining the valid versions of the source tables at the time the query finishes.
D. The versions of each source table will be stored in the table transaction log; query results will be saved to DBFS with each query.
E. All logic will execute at query time and return the result of joining the valid versions of the source tables at the time the query began.
正解：A