Code
basic.py
Usage
1
Set up your virtual environment
2
Set your API key
3
Install dependencies
4
Run Agent
Save the code above as
basic.py, then run:Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Stream a HuggingFace model response through an Agno agent.
from agno.agent import Agent
from agno.models.huggingface import HuggingFace
agent = Agent(
model=HuggingFace(
id="mistralai/Mistral-7B-Instruct-v0.2", max_tokens=4096, temperature=0
),
)
agent.print_response(
"What is meaning of life and then recommend 5 best books to read about it",
stream=True,
)
Set up your virtual environment
uv venv --python 3.12
source .venv/bin/activate
uv venv --python 3.12
.venv\Scripts\activate
Set your API key
export HF_TOKEN=xxx
Install dependencies
uv pip install -U huggingface_hub agno
Run Agent
basic.py, then run:python basic.py
Was this page helpful?