DATABRICKS-SPARK Question 84

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose A0

  - df.write.bucketBy(n, col).saveAsTable('t') hashes rows by col into n buckets. If both sides of a join are bucketed the same way, the join can avoid a shuffle. bucketBy requires saveAsTable (creates metadata). Pairs well with sortBy('col').