Batch vs realtime serving (step 5/7) · model serving, ci/cd, and mlops

promptdojo_

This mode-chooser is inverted: it returns "batch" when a user is waiting (which needs low latency) and "realtime" when nothing waits (wasting money). Fix line 3 so a waiting user gets realtime.

Expected output:

realtime

The break is on line 3 — but read the whole snippet first.

This mode-chooser is inverted: it returns "batch" when a user is waiting (which needs low latency) and "realtime" when nothing waits (wasting money). Fix line 3 so a waiting user gets realtime.

Expected output:

realtime

The break is on line 3 — but read the whole snippet first.

full-screen editor opens — close anytime to keep reading.

Batch vs realtime serving — step 5 of 7

Batch vs realtime serving — step 5 of 7