The creators of the open source project vLLM have announced that they transitioned the popular tool into a VC-backed startup, Inferact, raising $150 million in seed funding at an $800 million ...
SwiftKV optimizations developed and integrated into vLLM can improve LLM inference throughput by up to 50%, the company said. Cloud-based data warehouse company Snowflake has open-sourced a new ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results