Python models

Beta

warning

Python models Beta

Target SDK design

python

from botconnector import Client

client = Client()

# List models available locally
for m in client.models.list():
    print(m.id, m.size)

# Download a quantization
client.models.download("publisher/model", quant="Q4_K_M")

# Load / unload
client.models.load("publisher/model")
client.models.unload()

The source SDK is implemented, but no PyPI package is published. The CLI remains the supported packaged path for model management: botconnector models, botconnector get, botconnector run. The native HTTP management API is documented at Native API.