Predictive Speculative KV Replication for Bursty LLM Inferencejwlabs.vercel.app21 points by shreybirmiwal 5 hours agohttps://github.com/jwlaboratory/bite-the-bullet
msp26 2 hours agothe hand drawn diagrams and highlights are charmingshreybirmiwal 13 minutes agothank you so much
the hand drawn diagrams and highlights are charming
thank you so much