Santiago Valdarrama
@svpino
These interactive characters are pretty cool.
They see what's on your screen, listen to you, and are smart enough to respond based on all that context.
We have seen different iterations of this since Microsoft Clippit, but never as realistic, fast, and interactive as this.
They are using Fable 23B model behind the scenes. It takes around 30 milliseconds to start streaming tokens, which makes it really fast.