Groq is an American semiconductor company that designs high-performance AI inference hardware. It is the creator of the Language Processing Unit (LPU), a new category of processor designed to handle the sequential nature of Large Language Models with significantly higher speed and lower latency than traditional GPUs.