Harrison Chase
@hwchase17
we're seeing our coding agent costs decrease significantly for second month in row
longer blog on this later, but three quick steps we took
1/ cost visibility. you cant control what you cant measure. Start tracking everything to langsmith. This gives us super granular visibility into who is using what, how they are using it, etc. LangSmith supports first party integrations with all main coding harnesses https://www.langchain.com/blog/your-coding-agents-are-a-black-box-heres-how-to-crack-them-open
2/ cost controls. Through our LLM gateway, set user level cost caps. (You can increase your cap by talking to our VPE). This helps curb unexpected or accidental spend. https://docs.langchain.com/langsmith/llm-gateway
3/ optimize the harness. Obviously 3rd party harnesses are tougher to optimize, but we are doing more and more coding through OpenSWE, our open source cloud agent harness. Things like model routing help bring the cost down https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness
feel free to reach out if you want help implementing these at your co!