agentskillexchange Hugging Face Model Deployer
Deploys models from Hugging Face Hub to Inference Endpoints using the huggingface_hub client and REST API. Monitors endpoint health and autoscaling status and streams logs to the terminal. Supports private repos with HF_TOKEN and custom Docker containers.
Installation
Use the upstream install or setup path that matches your environment:
- uv venv .my-env
- pip install "transformers[torch]"
- uv pip install "transformers[torch]"
- git clone https://github.com/huggingface/transformers.git
Requirements and caveats from upstream:
- Transformers works with Python 3.10+, and PyTorch 2.4+.
- Create and activate a virtual environment with venv or uv, a fast Rust-based Python package and project manager.
- python -m venv .my-env
Basic usage or getting-started notes:
We pledge to help support new state-of-the-art models and democratize their usage by having their model definition be
py
venv
Extracted from upstream docs: https://raw.githubusercontent.com/huggingface/transformers/HEAD/README.md