Skip to main content
kRouter
All providers

Pay-per-token

together/

Together AI

Together AI — 100+ open-weight models.

together.ai

Quick setup

  1. Open the kRouter dashboard at http://localhost:20128

  2. Go to Providers → click Together AI

  3. Paste your API key, click Save

  4. Test the connection

Use in your IDE

Point any OpenAI-compatible client at kRouter using your local API key.

ide configbash
# Endpoint
http://localhost:20128/v1

# API key (from Dashboard → API Keys)
sk-krouter-XXXX

# Model
together/meta-llama/llama-4-405b

How Together AI billing works with kRouter

Together AI is pay-per-token. You bring your own API key and kRouter routes to it, so you keep your own rate limits and billing relationship. kRouter authenticates it via apikey. 6 models are routable as together/<model>.

Through kRouter, Together AI serves chat and code completion and embeddings, exposed on /v1/embeddings. Requests reach it through the same local OpenAI-compatible endpoint as every other provider, so switching to or from Together AI is a one-line model change in your client rather than a rewrite.

Together AI models & pricing

Prices are USD per 1M tokens, cheapest first. kRouter bills nothing on top; this is the provider's own rate.

ModelRoute asInput /1MOutput /1M
DeepSeek R1together/deepseek-ai/DeepSeek-R1$0.14$0.28
Qwen3 235Btogether/Qwen/Qwen3-235B-A22B$0.50$2.00
Llama 3.3 70B Turbotogether/meta-llama/Llama-3.3-70B-Instruct-Turbo——
Llama 4 Mavericktogether/meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8——
BGE Large EN v1.5together/BAAI/bge-large-en-v1.5——
M2 BERT 80M 8Ktogether/togethercomputer/m2-bert-80M-8k-retrieval——

Together AI links

Together AI FAQ

Is Together AI free through kRouter?

Together AI is pay-per-token: you bring your own API key and are billed by Together AI at their rates. kRouter adds nothing on top and is free and MIT-licensed.

How do I use Together AI with Claude Code or Cursor?

Connect Together AI in the kRouter dashboard, then point your tool at kRouter's local endpoint (http://localhost:20128/v1) with a kRouter API key. Any OpenAI-compatible client works, and models are addressed as together/<model>.

Which Together AI models can kRouter route to?

6 models, including Llama 3.3 70B Turbo, DeepSeek R1, Qwen3 235B. Every one is addressed as together/<model> from any client.

What happens when Together AI is rate limited?

kRouter detects the limit, parks that account until its real reset time, and fails over to your next connected account or provider — so the request still completes instead of erroring.