https://github.com/deepspeedai/deepspeed-mii
GitHub - deepspeedai/DeepSpeed-MII: MII makes low-latency and high-throughput inference possible,...
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed. - deepspeedai/DeepSpeed-MII
low latency
https://github.com/deepspeedai/deepspeed
GitHub - deepspeedai/DeepSpeed: DeepSpeed is a deep learning optimization library that makes...
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - deepspeedai/DeepSpeed
is adeep learninggithubdeepspeed