DATABRICKS-DEP Question 37

Question

Your team wants reusable PySpark cleansing steps that can be unit tested and chained cleanly across multiple DataFrames. Which pattern fits best?
A. Duplicate the logic in every notebook
B. Collect each DataFrame to pandas and transform locally
C. Hide the logic inside widget default values
D. Wrap transformations in functions and apply them with `DataFrame.transform(...)`

Accepted Answer

Marked answer: D. Wrap transformations in functions and apply them with `DataFrame.transform(...)`

DATABRICKS-DEP Question 37

Community Discussion

Preparing Practice Exam…

DATABRICKS-DEP Question 37

Community Discussion