Eric Jang
@ericjang11
The section on "Monitoring generalization" is particularly interesting. I wonder what the equivalent of COT monitoring looks like as capabilities become increasingly multimodal, e.g. generation and robotics, where the predicted quantity is something that might not have a natural function approximation in the space of words.
(quoted) I wrote about the state of AI, why I’m concerned about the next few years, and the choices we need to make to keep the future in humanity’s hands.
An Alien Mind: https://openai.com/index/an-alien-mind/