vllmvllm-project
ADDEDvLLM is a high-throughput, memory-efficient library designed for Large Language Model (LLM) inference and serving.
Discover quality open-source projects, submit projects anonymously, and claim and edit your own project.
A little curiosity. A world of open source.
THE FIRST COLLECTIONvLLM is a high-throughput, memory-efficient library designed for Large Language Model (LLM) inference and serving.
Lexos is an event-driven AI document processing engine combining a Go gateway, Python workers, Redis queues and self-hosted models for offline RAG, summarization and speech transcription.