Introduction
This Python library is the easist way to begin building on top of Apple's machine learning library, MLX.
Quick Example:
Python
from mlxserver import MLXServer
server = MLXServer(model="mlx-community/Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX")Curl
curl -X GET 'http://127.0.0.1:5000/generate?prompt=write%20me%20a%20poem%20about%the%20ocean&stream=true'Goals
This library's goal is to make it as easy as possible to build ML applications on top of the MLX library. The lower the barrier to entry for building in ML, the more great applications will be built.
Why MLX?
Because it's the fastest on Apple Silicon and it's going to be the best maintained for a while.
Credits & contributions
This library was created by Mustafa Aljadery (opens in a new tab) and Siddharth Sharma (opens in a new tab).
If you would like to contribute to this library please visit the GitHub Repo (opens in a new tab).