Moreh & SGLang Demo Distributed Inference on AMD at AI Infra Summit
Introducing distributed inference systems on AMD with high efficiency, and unveiling collaborations with Tenstorrent and SGLang Moreh, an AI infrastructure software company, unveiled its distributed inference...