Documentation
Remote APIs
Groq API

Groq API

How to Integrate Groq API with Jan

This guide provides step-by-step instructions on integrating the Groq API with Jan, enabling users to leverage Groq's capabilities within Jan's conversational interface.

Before proceeding, ensure you have the following:

  • Access to the Jan application
  • Groq API credentials

Integration Steps

Step 1: Configure Groq API Key

  1. Obtain Groq API Keys from your Groq Console (opens in a new tab) dashboard.
  2. Copy your Groq API Key and the endpoint URL you want.
  3. Navigate to the Jan app > Settings.
  4. Select the Groq Inference Engine.
  5. Insert the API Key and the endpoint URL into their respective fields.

Server Setup

You can also manually edit the JSON file in ~/jan/settings/@janhq/inference-groq-extension.

Step 2: Select Model

  1. Navigate to the Hub section.
  2. Ensure you have downloaded the Groq model you want to use.

Select Model

The Groq Inference Engine is the default extension for the Jan application. All the Groq models are automatically installed when you install the Jan application.

Step 3: Start the Model

  1. Navigate to the Thread section.
  2. Under the Model section, click Remote.
  3. Select the Groq model you want to use.
  4. Start the conversation with the Groq API.

Start Model

Troubleshooting

If you encounter any issues during the integration process or while using Groq with Jan, consider the following troubleshooting steps:

  • Double-check your API credentials to ensure they are correct.
  • Check for error messages or logs that may provide insight into the issue.
  • Reach out to Groq API support for assistance if needed.