Rohan Paul

Emad Mostaque: AI models "have pretty much reached the efficiency of a human brain". Alibaba's Qwen 27B normally needs about 60GB of memory, and a team from Prism ML cut that to 6GB by storing its numbers with 1.5 bits instead of 16 while keeping 95% of its performance. At 6GB it runs on a Raspberry Pi, "which uses as much energy as your brain." ---- Full video on "Tom Bilyeu" YouTube channel, (link in comment)