Rohan Paul

@rohanpaul_ai

Chamath on all important “prefill” and “decode.” in AI compute. Prefill is compute-bound; massive parallel GPUs win, so Nvidia dominates as context grows. Decode is memory-bandwidth bound as each next token depends on scanning what’s already generated
打开原帖#511482
  1. Industry

    Alexandr Wang: S for superintelligence 😎
  2. Industry

    Alexandr Wang: seriously awesome use case for muse — clean up the neighborhood!
  3. Industry

    Yoshua Bengio: Automating more and more of the AI R&D could lead to AI progress radi…