TypeScript models

Beta

warning

TypeScript models Beta

Target SDK design

typescript

import { BotConnectorClient } from "@botconnector/sdk";

const client = new BotConnectorClient();

// List locally available models
const models = await client.models.list();
for (const m of models) console.log(m.id, m.size);

// Download a quantization
await client.models.download("publisher/model", { quant: "Q4_K_M" });

// Load / unload
await client.models.load("publisher/model");
await client.models.unload();

The source SDK is implemented, but no npm package is published. The CLI remains the supported packaged path for model management: botconnector models, botconnector get, botconnector run. HTTP calls against the Native API are available today with fetch.