Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for:
- Whisper for audio transcription
- Llama, phi and mistral models for text generation.
- Structured generation: You can generate text that fits your specific format by deriving a parser automatically with structured generation
- Bert for text embedding and search
The latest release adds support for deriving parsers and json schemas to use with structured text generation, real time audio transcription and a bunch of performance improvements
