DATABRICKS-SPARK Question 76

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose A0

  - limit followed by collect is a common pattern to sample a few rows. Spark can push the limit through the plan (LocalLimit + GlobalLimit) and avoid scanning more than necessary. Much safer than calling collect directly on a large DataFrame.