warning

Legacy managed-runtime reference. Command examples below describe the older desktop/managed llama.cpp preview and are legacy, not the current BCCLI v0.4 command surface. Use BCCLI and Local AI for current instructions.

Python models

Target SDK design

python

from botconnector import Client

client = Client()

# List models available locally
for m in client.models.list():
    print(m.id, m.size)

# Download a quantization
client.models.download("publisher/model", quant="Q4_K_M")

# Load / unload
client.models.load("publisher/model")
client.models.unload()

The source SDK is implemented, but no PyPI package is published. The CLI remains the supported packaged path for model management: botconnector models, botconnector get, botconnector run. The native HTTP management API is documented at Native API.