Actions
Pull

Pull

Download & store a model from huggingface locally.

Usage

curl -X GET 'http://127.0.0.1:5000/delete?model=mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX'

Example

Python

from mlxserver import MLXServer
 
server = MLXServer(model="mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX")

Curl

curl -X GET 'http://127.0.0.1:5000/pull?model=mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX'

Parameters

model - The model you want to download.