Databricks Databricks-Certified-Professional-Data-Engineer 問題集

質問 1：
Which REST API call can be used to review the notebooks configured to run as tasks in a multi-task job?
A. /jobs/get
B. /jobs/runs/get
C. /jobs/runs/list
D. /jobs/runs/get-output
E. /jobs/list
正解：A
解説: (Topexam メンバーにのみ表示されます)

質問 2：
A junior data engineer is working to implement logic for a Lakehouse table namedsilver_device_recordings.
The source data contains 100 unique fields in a highly nested JSON structure.
Thesilver_device_recordingstable will be used downstream to power several production monitoring dashboards and a production model. At present, 45 of the 100 fields are being used in at least one of these applications.
The data engineer is trying to determine the best approach for dealing with schema declaration given the highly-nested structure of the data and the numerous fields.
Which of the following accurately presents information about Delta Lake and Databricks that may impact their decision-making process?
A. Schema inference and evolution on .Databricks ensure that inferred types will always accurately match the data types used by downstream systems.
B. Because Databricks will infer schema using types that allow all observed data to be processed, setting types manually provides greater assurance of data quality enforcement.
C. Because Delta Lake uses Parquet for data storage, data types can be easily evolved by just modifying file footer information in place.
D. The Tungsten encoding used by Databricks is optimized for storing string data; newly-added native support for querying JSON strings means that string types are always most efficient.
E. Human labor in writing code is the largest cost associated with data engineering workloads; as such, automating table declaration logic should be a priority in all migration workloads.
正解：B
解説: (Topexam メンバーにのみ表示されます)

質問 3：
Which statement characterizes the general programming model used by Spark Structured Streaming?
A. Structured Streaming is implemented as a messaging bus and is derived from Apache Kafka.
B. Structured Streaming relies on a distributed network of nodes that hold incremental state values for cached stages.
C. Structured Streaming uses specialized hardware and I/O streams to achieve sub-second latency for data transfer.
D. Structured Streaming models new data arriving in a data stream as new rows appended to an unbounded table.
E. Structured Streaming leverages the parallel processing of GPUs to achieve highly parallel data throughput.
正解：D
解説: (Topexam メンバーにのみ表示されます)

質問 4：
A junior data engineer has been asked to develop a streaming data pipeline with a grouped aggregation using DataFramedf. The pipeline needs to calculate the average humidity and average temperature for each non- overlapping five-minute interval. Events are recorded once per minute per device.
Streaming DataFramedfhas the following schema:
"device_id INT, event_time TIMESTAMP, temp FLOAT, humidity FLOAT"
Code block:

Choose the response that correctly fills in the blank within the code block to complete this task.
A. "event_time"
B. window("event_time", "5 minutes").alias("time")
C. lag("event_time", "10 minutes").alias("time")
D. window("event_time", "10 minutes").alias("time")
E. to_interval("event_time", "5 minutes").alias("time")
正解：B
解説: (Topexam メンバーにのみ表示されます)

質問 5：
A small company based in the United States has recently contracted a consulting firm in India to implement several new data engineering pipelines to power artificial intelligence applications. All the company's data is stored in regional cloud storage in the United States.
The workspace administrator at the company is uncertain about where the Databricks workspace used by the contractors should be deployed.
Assuming that all data governance considerations are accounted for, which statement accurately informs this decision?
A. Databricks workspaces do not rely on any regional infrastructure; as such, the decision should be made based upon what is most convenient for the workspace administrator.
B. Cross-region reads and writes can incur significant costs and latency; whenever possible, compute should be deployed in the same region the data is stored.
C. Databricks leverages user workstations as the driver during interactive development; as such, users should always use a workspace deployed in a region they are physically near.
D. Databricks notebooks send all executable code from the user's browser to virtual machines over the open internet; whenever possible, choosing a workspace region near the end users is the most secure.
E. Databricks runs HDFS on cloud volume storage; as such, cloud virtual machines must be deployed in the region where the data is stored.
正解：B
解説: (Topexam メンバーにのみ表示されます)

質問 6：
A data engineer needs to capture pipeline settings from an existing in the workspace, and use them to create and version a JSON file to create a new pipeline.
Which command should the data engineer enter in a web terminal configured with the Databricks CLI?
A. Stop the existing pipeline; use the returned settings in a reset command
B. Use the get command to capture the settings for the existing pipeline; remove the pipeline_id and rename the pipeline; use this in a create command
C. Use list pipelines to get the specs for all pipelines; get the pipeline spec from the return results parse and use this to create a pipeline
D. Use the alone command to create a copy of an existing pipeline; use the get JSON command to get the pipeline definition; save this to git
正解：B
解説: (Topexam メンバーにのみ表示されます)