;3h d dl mZ d dlZd dlmZmZmZmZmZm Z d dl
m Z m Z m
Z
ddlmZ ddlmZmZmZ G d d
e
Zy) ) annotationsN)AsyncGeneratorDictIterableListOptionalUnion)ChatCompletionInputMessageChatCompletionStreamOutput MCPClient )PROVIDER_OR_POLICY_T )DEFAULT_SYSTEM_PROMPTEXIT_LOOP_TOOLS
MAX_NUM_TURNSc ` e Zd ZdZdddd d fdZd dZdd d
dZ xZS ) Agenta
Implementation of a Simple Agent, which is a simple while loop built right on top of an [`MCPClient`].
This class is experimental and might be subject to breaking changes in the future without prior notice.
Args:
model (`str`):
The model to run inference with. Can be a model id hosted on the Hugging Face Hub, e.g. `meta-llama/Meta-Llama-3-8B-Instruct`
or a URL to a deployed Inference Endpoint or other local or remote endpoint.
servers (`Iterable[Dict]`):
MCP servers to connect to. Each server is a dictionary containing a `type` key and a `config` key. The `type` key can be `"stdio"` or `"sse"`, and the `config` key is a dictionary of arguments for the server.
provider (`str`, *optional*):
Name of the provider to use for inference. Defaults to "auto" i.e. the first of the providers available for the model, sorted by the user's order in https://hf.co/settings/inference-providers.
If model is a URL or `base_url` is passed, then `provider` is not used.
api_key (`str`, *optional*):
Token to use for authentication. Will default to the locally Hugging Face saved token if not provided. You can also use your own provider API key to interact directly with the provider's service.
prompt (`str`, *optional*):
The system prompt to use for the agent. Defaults to the default system prompt in `constants.py`.
N)providerapi_keypromptc p t | ||| t | | _ d|xs t dg| _ y )N)modelr r systemrolecontent)super__init__list _servers_cfgr messages)selfr serversr r r __class__s d/var/www/html/audio-gradio/venv/lib/python3.12/site-packages/huggingface_hub/inference/_mcp/agent.pyr zAgent.__init__% s= uxI M &*I4I JH
c t K | j D ]# } | j |d fi |d d { % y 7 w)Ntypeconfig)r! add_mcp_server)r# cfgs r&
load_toolszAgent.load_tools4 sC $$ DC%$%%c&kCS]C C C D Cs ,868) abort_eventc R K | j j d|d d}d} |r|j ry| j | j t |dkD xr | 2 3 d{ }| 7
6 |dz
}| j d }|j d d
k( r@|j d t D ch c] }|j j nc c}w c}v ry|j d d
k7 r
|t kD ry|j d d
k7 r|ry|j d d
k7 }w) aF
Run the agent with the given user input.
Args:
user_input (`str`):
The user input to run the agent with.
abort_event (`asyncio.Event`, *optional*):
An event that can be used to abort the agent. If the event is set, the agent will stop running.
userr r TN)exit_loop_toolsexit_if_first_chunk_no_toolr r toolname) r" appendis_set process_single_turn_with_toolsr getfunctionr5 r )r#
user_inputr. num_turnsnext_turn_should_call_toolsitemlastts r& runz Agent.run8 s'
f DE &*#{ 1 1 3 " A A
/-6]-Z?Z B
d
NI==$Dxx 6)dhhv.>\kBlWX1::??BlBl.lxx 6)i-.Gxx 6).I*.((6*:f*D '/ s8 A D'"A3&A1'A3*D'1A33AD'4 CAD')
r strr$ zIterable[Dict]r z Optional[PROVIDER_OR_POLICY_T]r
Optional[str]r rC )returnNone)r; rB r. zOptional[asyncio.Event]rD zSAsyncGenerator[Union[ChatCompletionStreamOutput, ChatCompletionInputMessage], None])__name__
__module__ __qualname____doc__r r- rA
__classcell__)r% s @r& r r s{ : 48!% $
1
D 04 +E+E - +E
] +Er' r )
__future__r asynciotypingr r r r r r huggingface_hubr
r r
_providersr constantsr r r r r' r& rR s0 " H H ] ] - L LWEI WEr'