#llm wow that’s fast. I’m averaging almost 300 T/s with <1s of latency (Llama2 70B): https://chat.groq.com/