Skip to main content
The @cline/llms package provides provider registries, model catalogs, handlers, and a gateway. @cline/agents and @cline/core use this layer internally.

​
Configure a Provider

const agent = new Agent({
  providerId: "anthropic",
  modelId: "claude-sonnet-4-6",
  apiKey: process.env.ANTHROPIC_API_KEY,
  // ...
})
Provider config can include apiKey, baseUrl, headers, and provider-specific settings through core/provider config types. Common environment variables:
ProviderEnvironment variable
AnthropicANTHROPIC_API_KEY
OpenAIOPENAI_API_KEY
GoogleGOOGLE_API_KEY or GOOGLE_APPLICATION_CREDENTIALS
AWS BedrockAWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_SESSION_TOKEN
MistralMISTRAL_API_KEY

​
OpenAI-Compatible Providers

Use openai-compatible for providers that expose an OpenAI-compatible API: 
const agent = new Agent({
  providerId: "openai-compatible",
  modelId: "your-model-name",
  apiKey: process.env.PROVIDER_API_KEY,
  baseUrl: "https://your-provider.com/v1",
})

​
AWS Bedrock

Bedrock uses AWS credentials from the standard environment/SDK chain and provider-specific config: 
const agent = new Agent({
  providerId: "bedrock",
  modelId: "anthropic.claude-sonnet-4-6",
  providerConfig: {
    awsRegion: "us-east-1",
  },
})

​
Gateway API

Use DefaultGateway or createGateway when you need direct provider/model access: 
import { DefaultGateway } from "@cline/llms"

const gateway = new DefaultGateway()

const providers = gateway.listProviders()
const model = gateway.createAgentModel({
  providerId: "anthropic",
  modelId: "claude-sonnet-4-6",
})
The package also exports registry helpers such as getAllProviders, getProviderIds, getModelsForProvider, registerProvider, and registerModel. See Gateway reference for exact APIs.

​
Model Metadata

Models expose metadata for selection and cost calculations: 
interface ModelInfo {
  id: string
  name?: string
  contextWindow?: number
  maxTokens?: number
  pricing?: {
    input?: number
    output?: number
    cacheCreation?: number
    cacheRead?: number
  }
  capabilities?: Record<string, unknown>
}

​
Cost Tracking

Agent results and usage events include token usage: 
const result = await agent.run("Analyze this codebase")

console.log(result.usage.inputTokens)
console.log(result.usage.outputTokens)
console.log(result.usage.totalCost)