Preparing Practice Exam…
Please wait a moment while the system generates the exam questions, answers, and study session.
Please wait a moment while the system generates the exam questions, answers, and study session.
Databricks Certified Data Engineer Associate · Databricks
Select one answer.
Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.
The response is B
Wrapping the SQL program in PySpark allows the data engineering team to leverage Python’s control flow (e.g., if statements) to determine when the final query should execute. For example: The PySpark program can check the current day using Python's datetime module. If the current day is Sunday, it will execute all queries, including the final one. If it’s not Sunday, the program will skip the final query. This approach ensures flexibility and allows precise control over which queries run on which days, meeting the data analyst's requirements.
B. They could wrap the queries using PySpark and use Python’s control flow system to determine when to run the final query. This approach involves using PySpark to control the execution flow based on the day of the week, allowing the final query to execute conditionally while the other queries run daily.