DATABRICKS-SPARK Question 71

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose A0

  - Broadcasting the small table (F.broadcast(lookup_df)) eliminates shuffle of the large table and makes the join a map-side hash join. AQE can also auto-convert a sort-merge join to broadcast when it detects one side is small at runtime.