Harrison Chase

@hwchase17

we're seeing our coding agent costs decrease significantly for second month in row longer blog on this later, but three quick steps we took 1/ cost visibility. you cant control what you cant measure. Start tracking everything to langsmith. This gives us super granular visibility into who is using what, how they are using it, etc. LangSmith supports first party integrations with all main coding harnesses https://www.langchain.com/blog/your-coding-agents-are-a-black-box-heres-how-to-crack-them-open 2/ cost controls. Through our LLM gateway, set user level cost caps. (You can increase your cap by talking to our VPE). This helps curb unexpected or accidental spend. https://docs.langchain.com/langsmith/llm-gateway 3/ optimize the harness. Obviously 3rd party harnesses are tougher to optimize, but we are doing more and more coding through OpenSWE, our open source cloud agent harness. Things like model routing help bring the cost down https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness feel free to reach out if you want help implementing these at your co!
打开原帖#511482
  1. Industry

    Timnit Gebru: Lol I shouldn't have named the actual places staffed by some of these…
  2. Industry

    Timnit Gebru: "I am aware, that if you are not lurking on the internet as much as I…
  3. Industry

    Tomasz Tunguz: Long way to go, but we are thankfully making progress.