Show HN: gline-rs – an inference engine for GLiNER models, in Rust (opens in new tab)

Hi everyone, wanted to share about gline-rs, an inference engine for GLiNER models written in Rust.

This family of lightweight language models proved to be efficient at zero-shot Named Entity Recognition (NER) and other tasks such as Relation Extraction, while consuming less resources than large generative models (LLMs).

This implementation has been written from the ground up in Rust, and supports both span- and token-oriented variants (for inference only). The goal is to provide a production-grade and user-friendly API in a modern and safe programming language, including a clean and maintainable implementation of the mechanics surrounding these models.

For those interested, it can also help getting a deep understanding of GLiNER's operation.

Thanks for any feedback or interest !