hi OP. We built an open-source library called, BentoML(https://github.com/bentoml/bentoml) to make model inferencing/serving a lot easier for Data scientists in various serving scenarios.

Love to hear your thoughts on our library