DATABRICKS-SPARK Question 88

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose A0

  - Best practices: use built-in functions (they're vectorized in JVM), project/filter early to reduce data volume through the plan, tune shuffle partitions (200 default is rarely optimal), and avoid collect() on large data.