1Benchmarking LLM Inference Back Ends: VLLM, LMDeploy, MLC-LLM, TensorRT-LLM, TGI (opens in new tab)(bentoml.com)15chaoyu1y ago1Save
2Show HN: ML Serving orchestration framework on Kubernetes (opens in new tab)(github.com)GitHub2chaoyu3y ago0Save
3BentoML: The easiest way to build Machine Learning APIs (opens in new tab)(github.com)GitHub4chaoyu5y ago1Save
