Start Chatting
Step 1: Install Jan
- Download Jan
- Install the app (Mac, Windows, Linux)
- Launch Jan
Step 2: Download a Model
Jan requires a model to chat. Download one from the Hub:
- Go to the Hub Tab
- Browse available models (must be GGUF format)
- Select one matching your hardware specs
- Click Download
⚠️
Models consume memory and processing power. Choose based on your hardware specs.
HuggingFace models: Some require an access token. Add yours in Settings > Model Providers > Llama.cpp > Hugging Face Access Token.
Step 3: Enable GPU Acceleration (Optional)
For Windows/Linux with compatible graphics cards:
- Go to () Settings > Hardware
- Toggle GPUs to ON
Step 4: Start Chatting
- Click New Chat () icon
- Select your model in the input field dropdown
- Type your message and start chatting
Managing Conversations
Jan organizes conversations into threads for easy tracking and revisiting.
View Chat History
- Left sidebar shows all conversations
- Click any chat to open the full conversation
- Favorites: Pin important threads for quick access
- Recents: Access recently used threads
Edit Chat Titles
- Hover over a conversation in the sidebar
- Click three dots () icon
- Click Rename
- Enter new title and save
Delete Threads
⚠️
Thread deletion is permanent. No undo available.
Single thread:
- Hover over thread in sidebar
- Click three dots () icon
- Click Delete
All threads:
- Hover over
Recents
category - Click three dots () icon
- Select Delete All
Advanced Features
Custom Assistant Instructions
Customize how models respond:
- Use the assistant dropdown in the input field
- Or go to the Assistant tab to create custom instructions
- Instructions work across all models
Model Parameters
Fine-tune model behavior:
- Click the Gear icon next to your model
- Adjust parameters in Assistant Settings
- Switch models via the model selector
Connect Cloud Models (Optional)
Connect to OpenAI, Anthropic, Groq, Mistral, and others:
- Open any thread
- Select a cloud model from the dropdown
- Click the Gear icon beside the provider
- Add your API key (ensure sufficient credits)
For detailed setup, see Remote APIs.