Shawn Wang
@swyx
@HarryStebbings harrison would say that :) you also want to take into account kv cache and dreaming optimizations that only harness-model colocation can achieve. ive had my own career ruined by trying to be switzerland without realizing the costs.
truth is his advice probably:
- low end: