Cohere

Some results: With North Mini Code (BF16 on 1×H100), we achieved 1.58x vs vLLM at BS=1 and 1.25x–1.41x end-to-end serving at BS=8