OpenAI Developers

@OpenAIDevs

See what’s being reused and what’s preventing cache hits. Track cache-hit rates in the new Prompt Caching Dashboard on https://t.co/9eDbe9PbGF. Use the diagnostics API to identify changes that prevented reuse and estimate how many tokens were affected. https://t.co/M16n4rG1Cl
打开原帖#511482
  1. Industry

    Alexandr Wang: muse helps you with all the crap you don’t usually get to, and makes…
  2. Industry

    Alexandr Wang: alex is too modest to tell you that in addition to being the design v…
  3. Industry

    Alexandr Wang: "so muse lil guy, it's kind of hard to explain, but now whenever a ma…