Charles Frye
@charles_irl
Somewhat surprisingly, turns out you can serve very high interactivities without using annoying, bleeding-edge hardware like NVL72s.
We clocked this as far back as the earliest InferenceX releases from @SemiAnalysis_, and it made us more excited about high interactivity serving.