vLLM-Hook
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
What is vLLM-Hook?
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM