DATABRICKS-SPARK Question 93

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose A0

  - df.transform(lambda d: d.withColumn(...).filter(...)) applies a function returning a DataFrame, enabling clean composition. pipe is pandas. apply is for Series/pandas_udf. transform makes pipelines more readable.