PMLE Question 108

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose B2

  When you observe oscillations in the loss during training, it is often a sign that the learning rate is too high. A high learning rate can cause the optimizer to overshoot the minimum of the loss function

• Chose B2

  A. Decrease Batch Size: While a smaller batch size can sometimes help with convergence, it can also lead to slower training. It might not necessarily address the issue of oscillation. C. Increase Learning Rate: A higher learning rate can cause the loss to jump around more erratically, potentially worsening the oscillation problem. D. Increase Batch Size: A larger batch size can lead to smoother updates but might also make the model less sensitive to local gradients and hinder convergence, especially with an already oscillating loss.

• Chose C2

  I don't understand