promptdojo_

Batch vs realtime — the 50% discount for work nobody is waiting on — step 4 of 7

A cache in front of the endpoint answers repeated queries for free — you only pay the provider for the MISSES. Measured hit rate is 62%, so the paid fraction is what's left over.

Fill the blank so misses is the fraction of calls the cache did NOT absorb.

Expected output:

paid calls: 38,000
bill: $76.00