Documentation
Remote Engines
Nvidia NIM

NVIDIA NIM

Jan supports NVIDIA NIM (opens in a new tab) API integration, allowing you to use NVIDIA's Large Language Models through Jan's interface.

NVIDIA NIM extension is only supported on Jan version 0.5.1 or later.

Integrate Nvidia NIM API with Jan

Step 1: Get Your API Key

  1. Visit NVIDIA Docs (opens in a new tab) and generate an API key
  2. Copy your API key

Ensure your API key has sufficient credits

Step 2: Configure Jan

There are two ways to add your Nvidia NIM API keys in Jan:

Through Threads:

  1. In Threads, click Model tab in the right sidebar or model selector in input field
  2. Once the selector is poped up, choose the Cloud tab
  3. Click Add () icon next to Nvidia NIM
  4. Once you are directed to Nvidia NIM settings, insert your API Key

Through Settings:

  1. Navigate to Settings ()
  2. Under Remote Engines, select Nvidia NIM
  3. Insert your API Key

NVIDIA NIM


Step 3: Start Using Nvidia NIM Models

  1. In any existing Threads or create a new one
  2. Select a NVIDIA NIM model from model selector
  3. Start chatting

Available Nvidia NIM Models

Jan automatically includes NVIDIA NIM's available models. In case you want to use a specific model that you cannot find in Jan, follow instructions in Manual Setup to add custom models:

Troubleshooting

Common issues and solutions:

1. API Key Issues

  • Verify your API key is correct and not expired
  • Check if you have billing set up on your NVIDIA account
  • Ensure you have access to the model you're trying to use

2. Connection Problems

  • Check your internet connection
  • Verify NVIDIA's system status
  • Look for error messages in Jan's logs

3. Model Unavailable

  • Confirm your API key has access to the model
  • Check if you're using the correct model ID
  • Verify your NVIDIA account has the necessary permissions
  • Make sure you're using Jan version 0.5.1 or later

Need more help? Join our Discord community (opens in a new tab) or check the Nvidia documentation (opens in a new tab).

Mistral AIOpenAI