Charles Frye
@charles_irl
We also took inspiration from high-quality open software and research.
Just a few:
- @nvidia FlashInfer's cascade attention (shouts @ye_combinator) and @ScalingIntelLab/@Research_Hazy's Hydragen attention (@jordanjuravsky toka still slaps)
- Hellerstein & Stonebraker for selectivity ordering (https://dsf.berkeley.edu/jmh/miscpapers/sigmod93.pdf)
- Literally the System R paper (https://dl.acm.org/doi/10.1145/320455.320457), @IBM still goated
- Patterson's Roofline Model (https://people.eecs.berkeley.edu/~kubitron/cs252/handouts/papers/RooflineVyNoYellow.pdf)
