Prompt caching

Week 45 · 2-8 Nov

1 source filed · KO 1

Week 44 · 26 Oct-1 Nov

3 sources filed · EN 2 · KO 1

Week 43 · 19-25 Oct

1 source filed · KO 1

  • A

    Why our LLM cost tripled when we only swapped the model

    Requests were a long fixed block (instructions and category list) followed by a short post body, sent as one message.

    20%lower unit price that motivated the switch from Gemini to GPT-5.6 in August 2026