Groq

Jan supports Groq (opens in a new tab) API integration, allowing you to use Groq's high-performance LLM models (LLaMA 2, Mixtral and more) through Jan's interface.

Integrate Groq API with Jan

Step 1: Get Your API Key

Visit Groq Console (opens in a new tab) and sign in
Create & copy a new API key or copy your existing one

Ensure your API key has sufficient credits

Step 2: Configure Jan

There are two ways to add your Groq API keys in Jan:

Through Threads:

In Threads, click Model tab in the right sidebar or model selector in input field
Once the selector is poped up, choose the Cloud tab
Click Add () icon next to Groq
Once you are directed to Groq settings, insert your API Key

Through Settings:

Navigate to Settings ()
Under Remote Engines, select Groq
Insert your API Key

Groq

Step 3: Start Using Groq's Models

In any existing Threads or create a new one
Select a Groq model from model selector
Start chatting

Available Models Through Groq

Jan automatically includes Groq's available models. In case you want to use a specific Groq model that you cannot find in Jan, follow instructions in Manual Setup to add custom models:

See list of available models in Groq Documentation (opens in a new tab).
The id property must match the model name in the list. For example, if you want to use Llama3.3 70B, you must set the id property to llama-3.3-70b-versatile.

Troubleshooting

Common issues and solutions:

1. API Key Issues

Verify your API key is correct and not expired
Check if you have billing set up on your Groq account
Ensure you have access to the model you're trying to use

2. Connection Problems

Check your internet connection
Verify Groq's system status
Look for error messages in Jan's logs

3. Model Unavailable

Confirm your API key has access to the model
Check if you're using the correct model ID
Verify your Groq account has the necessary permissions

Need more help? Join our Discord community (opens in a new tab) or check the Groq documentation (opens in a new tab).

Cohere Martian