Charles Frye
@charles_irl
Much more to do here -- finer-grained capability & performance evals, more workloads & configurations, and, eventually, automated search over & bespoke construction of configurations per workload. Stay tuned!
But I hope this is already useful to folks looking to host inference.