mlx-ruby-lm

https://github.com/skryl/mlx-ruby-lm

A Ruby port of mlx-lm providing large language model inference, quantization, LoRA fine-tuning, and an OpenAI-compatible server built on the mlx gem. Supports Llama, Gemma, Qwen2, Phi3, Mixtral, DeepSeek, and many more architectures.