Google Cloud Certified Professional Machine Learning Engineer Practice Mode

Community Discussion

Written by other learners. Comments can disagree with the marked answer — check the official documentation when in doubt.

• Chose D2

  A is wrong - Increasing max_batch_size reduces latency by batching more requests together, but this introduces delays since the system must wait to accumulate a full batch. - This approach can improve throughput but may increase per-query latency, which contradicts the goal of reducing latency.

• 1

  However, we are getting several 1000 QPS, so we should be filling a batch pretty quickly, and A will be ok. I think that D will change the architecture, which is explicitly not desired.

• Chose A2

  I do not think D is correct as D is focused on optimizing CPU utilization, not on the batching process or managing latency. Since our goal is to improve serving latency, optimizing batching via the max_batch_size parameter is a more straightforward and effective solution.