Disaggregated Inference at Scale with PyTorch and VLLM (pytorch.org)
2 points by djhu9 6 hours ago | 0 comments
912 points by djhu9 6 hours ago | 0 comments
915 points by Bogdanp 7 hours ago | 0 comments
9245 points by walterbell 7 hours ago | 34 comments
932 points by Indie_polestar 7 hours ago | 0 comments
943 points by thunderbong 7 hours ago | 0 comments
955 points by miletus 7 hours ago | 2 comments
962 points by adityaathalye 7 hours ago | 0 comments
973 points by teleforce 7 hours ago | 1 comment
985 points by wglb 7 hours ago | 1 comment
997 points by wpwd 7 hours ago | 1 comment
1006 points by bobbiechen 7 hours ago | 0 comments
1015 points by wglb 7 hours ago | 2 comments
1022 points by ko_pivot 7 hours ago | 0 comments
10332 points by krrishd 7 hours ago | 51 comments
1045 points by zzzeek 7 hours ago | 0 comments
1052 points by bookofjoe 8 hours ago | 0 comments
1065 points by zekrom 8 hours ago | 0 comments
10722 points by xqcgrek2 8 hours ago | 6 comments
1082 points by zekrom 8 hours ago | 0 comments
10910 points by PaulHoule 8 hours ago | 1 comment
11017 points by 1vuio0pswjnm7 8 hours ago | 7 comments
1112 points by kelvinquee 8 hours ago | 0 comments
1122 points by sadpig70 8 hours ago | 1 comment
11314 points by surprisetalk 8 hours ago | 4 comments
1146 points by surprisetalk 8 hours ago | 0 comments
11536 points by iamwil 8 hours ago | 14 comments
1163 points by pseudolus 8 hours ago | 1 comment
1172 points by pykello 9 hours ago | 0 comments
11822 points by yeknoda 9 hours ago | 10 comments
1193 points by pizlonator 9 hours ago | 0 comments
120