Continue.dev
Integrate with Continue VS Code
Continue (opens in a new tab) is an open-source autopilot compatible with Visual Studio Code and JetBrains, offering the simplest method to code with any LLM (Local Language Model).
To integrate Jan with a local AI language model, follow the steps below:
Step 1: Installing Continue on Visual Studio Code
Follow this guide (opens in a new tab) to install the Continue extension on Visual Studio Code.
Step 2: Enable the Jan API Server
To set up Continue for use with Jan's Local Server, you must activate the Jan API Server with your chosen model.
-
Press the
⚙️ Settings
button. -
Locate
Local API Server
. -
Setup the server, which includes the IP Port, Cross-Origin-Resource-Sharing (CORS) and Verbose Server Logs.
-
Include your user-defined API Key.
-
Press the Start Server button
Step 3: Configure Continue to Use Jan's Local Server
- Go to the
~/.continue
directory.
cd ~/.continue
name: Local Assistantversion: 1.0.0schema: v1models: - name: Jan provider: openai model: #MODEL_NAME (e.g. qwen3:0.6b) apiKey: #YOUR_USER_DEFINED_API_KEY_HERE (e.g. hello) apiBase: http://localhost:1337/v1context: - provider: code - provider: docs - provider: diff - provider: terminal - provider: problems - provider: folder - provider: codebase
- Ensure the file has the following configurations:
- Ensure
openai
is selected as theprovider
. - Match the
model
with the one enabled in the Jan API Server. - Set
apiBase
tohttp://localhost:1337/v1
.
Step 4: Ensure the Using Model Is Activated in Jan
- Navigate to
Settings
>Model Providers
. - Under Llama.cpp, find the model that you would want to use.
- Select the Start Model button to activate the model.
How to Use Jan Integration with Continue in Visual Studio Code
1. Exploring Code with Jan
- Highlight a code.
- Press
Command + Shift + M
to open the Left Panel. - Click "Jan" at the bottom of the panel and submit your query, such as
Explain this code
.
2. Enhancing Code with the Help of a Large Language Model
- Select a code snippet.
- Press
Command + Shift + L
. - Type in your specific request, for example,
Add comments to this code
.