Open Source Models

Open source models on Inference.net are served serverless. Call them through the OpenAI-compatible API with your Inference API key and pay per token. There is nothing to deploy.

Call an open source model

Use the model id as the model parameter, the same as any other serverless call:

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inference.net/v1",
  apiKey: process.env.INFERENCE_API_KEY,
});

const response = await client.chat.completions.create({
  model: "glm-5.2",
  messages: [{ role: "user", content: "Hello, world!" }],
});

console.log(response.choices[0].message.content);

Browse the available models at inference.net/models. See the API quickstart for full examples.

Dedicated deployments

Running an open source model on its own dedicated GPU (your own instance, no shared capacity) is coming soon, as is bringing your own trained weights. Today, only models trained on the platform can be deployed on dedicated GPUs.