DATABRICKS-SPARK Question 113

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose A0

  - Correct answer : A — No Spark job is submitted to the cluster; Spark only records `filtered` and `grouped` as logical plans built on top of `df`, since every call in the cell is a transformation. A . This is correct: `read`, `filter`, and `groupBy`/`sum` are all transformations, so the cell only builds up a logical plan referencing `df`. No job is submitted to the cluster because no action was called. B . This is incorrect because no action appears anywhere in the cell, so no job is submitted at all, let alone two separate ones. Filtering and grouping stay purely as plan-building steps until something forces execution. C . This is incorrect because being a wide transformation does not make `groupBy` eager. Wide transformations still only add to the logical plan and only cause a shuffle when a later action forces the plan to run. D . This is incorrect because leaving a DataFrame unused by an action is not an error condition in Spark; the cell simply finishes with `grouped` holding an unexecuted plan, and no exception is raised. E . This is incorrect because Spark does not selectively execute some transformations eagerly based on file metadata. Every transformation in the chain, including the filter, remains unexecuted until an action is called.