Results for “inference-endpoints”
3 skillsMore results
Serving Llms Vllm
Deploy and serve LLMs with high throughput using vLLM's PagedAttention and continuous batching. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism for production inference.
10.4k · bundle
Huggingface Hub
Operate Hugging Face Hub repositories, models, datasets, and Spaces via the hf CLI, including downloads, uploads, authentication, and compute jobs.
2