Groq
101 14 04 May, 2024
Jupyter Notebook
What is Groq ?
Groq is an AI solutions company delivering ultra-low latency inference with the first ever LPU™ Inference Engine. Groq API enables developers to integrate state-of-the-art LLMs such as Llama-2 into low latency applications.
Groq API Models
| Models | Model ID |
|---|---|
| LLaMA3 8b | llama3-8b-8192 |
| LLaMA3 70b | llama3-70b-8192 |
| Mixtral 8x7b | mixtral-8x7b-32768 |
| Gemma 7b | gemma-7b-it |
