;3hdZddlmZddlZddlZddlZddlZddlZddlm Z m Z ddl m Z ddl mZmZddlZddlZddlmZddlmZdd lmZdd lmZdd lmZddlZdd lmZmZm Z dd l!m"Z"ddl#m$Z$ddl%m&Z&m'Z'ddl(m)Z)m*Z*er$ddl+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6e d$ d%dZ7 d& d'dZ8 d( d)dZ9 d( d*dZ:d+dZ; d,dZ d-dZ?e d(d dd!d" d.d#Z@y)/zThis module should not be used directly as its API is subject to change. Instead, use the `gr.Blocks.load()` or `gr.load()` functions.) annotationsN)Callable Generator)Path) TYPE_CHECKINGLiteral)Client)Endpoint)document)encode_url_or_file_to_base64)version) componentsexternal_utilsutils)MultimodalValue)Context)GradioVersionIncompatibleErrorTooManyRequestsError)save_base64_to_cache to_binary) PROVIDER_T)Blocks ChatInterface) MessageDict) LoginButton) Interfacec |||}tjdCjd}t|dkr t d|ddj |ddJt tsdvr t d|Bd vr>tjjd tjjd }t tr |fiS|std|d St |tjrjtjd 5}|js|j!tj |j"gdfd } ddd|Stjd 5}tj$d5} tj&ddd} tj(ddd} tj*} dddtj, j.g d}tj,| j. j0g| | g | gd}tj,|j"| g| | gd}tj | g| j.gfd}ddd|S#1swYSxYw#1swYxYw#1swYSxYw)a Constructs a Gradio app automatically from a Hugging Face model/Space repo name or a 3rd-party API provider. Note that if a Space repo is loaded, certain high-level attributes of the Blocks (e.g. custom `css`, `js`, and `head` attributes) will not be loaded. Parameters: name: the name of the model (e.g. "google/vit-base-patch16-224") or Space (e.g. "flax-community/spanish-gpt2"). This is the first parameter passed into the `src` function. Can also be formatted as {src}/{repo name} (e.g. "models/google/vit-base-patch16-224") if `src` is not provided. src: function that accepts a string model `name` and a string or None `token` and returns a Gradio app. Alternatively, this parameter takes one of two strings for convenience: "models" (for loading a Hugging Face model through the Inference API) or "spaces" (for loading a Hugging Face Space). If None, uses the prefix of the `name` parameter to determine `src`. token: optional token that is passed as the second parameter to the `src` function. If not explicitly provided, will use the HF_TOKEN environment variable or fallback to the locally-saved HF token when loading models but not Spaces (when loading Spaces, only provide a token if you are loading a trusted private Space as the token can be read by the Space you are loading). Find your HF tokens here: https://huggingface.co/settings/tokens. accept_token: if True, a Textbox component is first rendered to allow the user to provide a token, which will be used instead of the `token` parameter when calling the loaded model or Space. Can also provide an instance of a gr.LoginButton in the same Blocks scope, which allows the user to login with a Hugging Face account whose token will be used instead of the `token` parameter when calling the loaded model or Space. kwargs: additional keyword parameters to pass into the `src` function. If `src` is "models" or "Spaces", these parameters are passed into the `gr.Interface` or `gr.ChatInterface` constructor. provider: the name of the third-party (non-Hugging Face) providers to use for model inference (e.g. "replicate", "sambanova", "fal-ai", etc). Should be one of the providers supported by `huggingface_hub.InferenceClient`. This parameter is only used when `src` is "models" Returns: a Gradio Blocks app for the given model Example: import gradio as gr demo = gr.load("gradio/question-answering", src="spaces") demo.launch() Nz\The `hf_token` parameter is deprecated. Please use the equivalent `token` parameter instead./zYEither `src` parameter must be provided, or `name` must be formatted as {src}/{repo name}r)modelsspaces huggingfacezThe `src` parameter must be one of 'huggingface', 'models', 'spaces', or a function that accepts a model name (and optionally, a token), and returns a Gradio app.)r!r#HF_TOKENnamesrchf_tokenproviderT) fill_height)triggerscD|dn |j}td|dSNr%)tokenload_blocks_from_huggingface) oauth_token token_valuekwargsr&r)r's O/var/www/html/audio-gradio/venv/lib/python3.12/site-packages/gradio/external.py create_blockszload..create_blocksms=&1&9d{?P?P 3(%   z Enter your token and press enterpasswordF)type show_label containerRemember me on this device)labelvaluer:)outputsc0tjddS)NzToken settingsF)open)gr Accordionr.r6r4hide_accordionzload..hide_accordions||$45AAr6)inputsr>cl|r|r|tjddfSdtjdfS)Nz#Remember me on this device (saved!)T)r<r=r;r<)rACheckbox)r2remember_token_values r4 save_tokenzload..save_tokens= (K& C4)r{{1MNNNr6c|r|dfSy)NT)rFFr.)r2s r4 load_tokenzload..load_tokens&,,$r6)rDr+c$td|dSr-)r0)r2r3r&r)r's r4createzload..creates+3(%   r6r.)r1zgr.OAuthToken | None)warningswarnsplitlen ValueErrorjoin isinstancerosenvirongetr0rArr is_renderedrenderloadrBTextboxrH BrowserStateonsubmitchange)r&r'r/r( accept_tokenr)r3partsdemor5 accordiontextboxremember_token browser_staterCrJrLrNs`` `` r4r[r[+s8  j  { 3 u:?k Ahxxab " ?? c8 $4W)W q    , , JJNN: & 2 z*#x 4)&)) + 3 EK   L".. 1 YY4 ( D++##% YY , -   YY4 (, D@A 2Y**#$# "$6eu"!# 1  2UUGNN#Y 7 B8 BUU!6!670&7  O   OUU499m_w>W X %Y % YYwi7>>2B C D K, \    2 2, \ s3(A J8K(AK-CK8KK KKc |Ctj(tj|k7rtjd|t_|dk(r|dn|}t |f|||d|}|St |f|||d|}|S)zNCreates and returns a Blocks instance from a Hugging Face model or Space repo.zYou are loading a model/Space with a different access token than the one you used to load a previous model/Space. This is not recommended, as it may cause unexpected behavior.r"F)r(aliasr))rr(rOrP from_spaces from_model)r&r'r(rir)r3r/blockss r4r0r0s    'G,<,<,H MMF $ h!)x    DJ  M  #58 GM  Mr6c dditj|||}tj||\}}d|tj j dxs)tttjdz fd}ddd} |dk(rNtjd d } tjd } tjdg} |jn|dk(r4tjd d } tjd } dg} |nl|dk(rAtjd d } tj d } dg} |j"dn&|dk(rJtj d } tj$d } |j&t(j*n|dk(rMtj d } tjd } dg} tj,|j.n|dk(rNtj0d d } tjd } tjdg} |j2n2|dk(r|tj d tj ddg} tj d tjd g} d!d"gg} tj4|j6n|d#k(rAtj d } tj d$ } d%gg} d&|j8nk|d'k(rMtj d } tjd } d(g} tj|j:n|d)k(r|rPd*|vrLd+d,lm} d+d-l m!} tjD|gd.} d/| i}tG|fi|}| d0d1d23}| f|d1d4|Stj d5 } | } d6g} tjH|n|d7k(r=tj d } tj d8 } d9g} |jJnN|d:k(r@tj d } tj d; } d<d=g} |jLn |d>k(rtj d tj d? tjNd@ g} tjd } tjgdAg} tjP|n|dBk(ratj dCdDEtj ddFdGHg} tjRdI } dJdKgg} tjT|n|dLk(r=tj d } tjdM } d=g} |jVn|dNk(r=tj d } tj0d } dOg} |jXn|dPk(rFtj d } tjZd } dQg} tj\|nL|dRk(ratj0d dS tj d g} tjtjdT } |j^n|dUk(rftj0d d tj d g} tjdT } tj`ddVgg} |jbn{|dWk(r>tj0d d } tj d8 } dg} |jdn8|dXvrtjf|} tjh| \}} | r| ggnd} tj$dYdZ|tk|d[fd\]} tj$d^d_d`ga} tjln|dbk(rCtj0d d } tjndc } tjp|nh|ddk(rUtj0d d tj d g} tj0d } ddegg} |jrntudf|fdg}|xs||_;|| | || d\dh}tG|fi|}tyjzdii|}|S)jNzX-Wait-For-Modeltrue)modelheadersr/r)z,https://api-inference.huggingface.co/models/GRADIO_TEMP_DIRgradioctd|i}tjd|}tt j |S)NpathPOST)rpcontent) cache_dir)rhttpxrequestrrencode_to_base64)dataresponse GRADIO_CACHEapi_urlrps r4custom_post_binaryz&from_model..custom_post_binarysB&$(=='4P#  + +H 5  r6zaudio-classificationfilepathInput)r8r<ClassrGzBhttps://gradio-builds.s3.amazonaws.com/demo-files/audio_sample.wavzaudio-to-audioOutputzautomatic-speech-recognitionc|jSN)textxs r4zfrom_model..s r6zfeature-extractionz fill-maskClassificationzIHugging Face is the AI community, working together, to [MASK] the future.zimage-classificationz Input ImagezAhttps://gradio-builds.s3.amazonaws.com/demo-files/cheetah-002.jpgzquestion-answeringQuestionr)linesr<AnswerScorez3What entity was responsible for the Apollo program?zThe Apollo program, also known as Project Apollo, was the third United States human spaceflight program carried out by the National Aeronautics and Space Administration (NASA), which accomplished landing the first humans on the Moon from 1969 to 1972. summarizationSummaryaThe tower is 324 metres (1,063 ft) tall, about the same height as an 81-storey building, and the tallest structure in Paris. Its base is square, measuring 125 metres (410 ft) on each side. During its construction, the Eiffel Tower surpassed the Washington Monument to become the tallest man-made structure in the world, a title it held for 41 years until the Chrysler Building in New York City was finished in 1930. It was the first structure to reach a height of 300 metres. Due to the addition of a broadcasting aerial at the top of the tower in 1957, it is now taller than the Chrysler Building by 5.2 metres (17 ft). Excluding transmitters, the Eiffel Tower is the second tallest free-standing structure in France after the Millau Viaduct.c|jSr) summary_textrs r4rzfrom_model..3s r6ztext-classification I feel greatztext-generationconversationalrrChatbot)z What is the capital of Pakistan?zTell me a joke about calculus.z Explain gravity to a 5-year-old.z)What were the main causes of World War I?examplesr messagesT)scaler8 allow_tags)chatbotr8TextzOnce upon a timeztext2text-generationzGenerated Textz)Translate English to Arabic: How are you? translation Translationc|jSr)translation_textrs r4rzfrom_model..^s  2 2r6zHello, how are you?zzero-shot-classificationz&Possible class names (comma-separated)zAllow multiple true classes)rz happy, sadFzsentence-similarityzSource SentencezEnter an original sentence)r< placeholderz>Sentences to compare to -- separate each sentence by a newlinezSentences to compare to)rrr<zSimilarity scoreszThat is a happy personzThat person is very happyztext-to-speechAudioz text-to-imagezA beautiful sunsetztoken-classificationzXHugging Face is a company based in Paris and New York City that acquired Gradio in 2021.zdocument-question-answeringzInput DocumentLabelzvisual-question-answeringzWhat animal is in the image?z image-to-text)ztabular-classificationztabular-regressionz Input RowspandasfixedF)r<r8rp col_countrZ Predictionsarray prediction)r<r8rpzobject-detection Annotationszimage-to-imagez"Photo of a cheetah with green eyeszUnsupported pipeline type: c|} |}|}|S#t$r}tj|Yd}~/d}~wwxYwr) Exceptionrhandle_hf_error)r{efn postprocess preprocesss r4%query_huggingface_inference_endpointsz9from_model..query_huggingface_inference_endpointss[  !t$D .t9D  "t$D  .  * *1 - - .s A>A)rrDr>titlercache_examplesr.)>huggingface_hubInferenceClientrget_model_inforVrWrXstrrtempfile gettempdirrrrpostprocess_labelaudio_classificationr\automatic_speech_recognition Dataframefeature_extractionrresolve_singletonpostprocess_mask_tokens fill_maskImageimage_classificationpostprocess_question_answeringquestion_answeringrtext_classificationrrrgradio.componentsrconversational_wrapperdicttext_generation_wrappertext_generationrrH zero_shot_classification_wrapperJSONsentence_similarity_wrappertext_to_speech text_to_imageHighlightedTexttoken_classification_wrapperdocument_question_answering%postprocess_visual_question_answeringvisual_question_answering image_to_textget_tabular_examples cols_to_rowsrRtabular_wrapperAnnotatedImageobject_detection_wrapperimage_to_imagerS__name__rAr) model_namer(rir)r3clientptagsrrrDr>rrchat_interface_kwargsr col_namesrinterface_info interfacer}r~rrprrs @@@@@@r4rkrks"6*G  , ,'HF++JAGAt=ZLIG::>>"34 X "#h.9L JKH ""!!zA""1$66 P  ( (  !!zA""2 P   , ,!!zA$$84 P  0 0& " "##'2&&X6  & &-- k ##'2"")9: W %<<    $ $!!zG"")9:$66 WX  ( ( " "   Z 0   Qi 8    X .   7 +  FK  %CC  & & o ##'2$$95z    /  ! ! # ###'2"")9:"#$66  ' '   $, , 166v>BHH% !/:6:FAJ4HG PW:PP P##&1&'  3 3F ; $ $##'2$$+;<?@  # # m ##'2$$=92 )*    ( (   W -   %M N   &C D  "")9:$66 9:  < >!66zB,99(C 8#+XJ<%%9~w/  &&g ~  + +  !!zG++-@  4 4V <     *M B   W - ""2T4    " "6qc:;; 6;5Hj)24 N. +F +F &v&I r6c |tjdd|}td|i}|dvrd||d<tjd|d| j j d }|t d |d tj|d z| }|jdk(r]tj|| } tjd| j} t j| jd} n/|jdk(r|j } nt d|dd| vrt|| |||fi|S|rtjdt||S#t$r} t d|| d} ~ wwxYw)NzRThe `provider` parameter is not supported when loading Spaces. It will be ignored.zhttps://huggingface.co/spaces/zFetching Space from: FNBearer Authorizationz"https://huggingface.co/api/spaces/z/host)rphostzCould not find Space: z. If it is a private or gated Space, please provide your Hugging Face access token (https://huggingface.co/settings/tokens) as the argument for the `hf_token` parameter.z/configiz+window.gradio_config = (.*?);[\s]*r zCould not load the Space: z) because the config could not be fetched.allow_flaggingzYou cannot override parameters for this Space by passing in kwargs. Instead, please load the Space as a function and use it to create a Blocks or Interface locally. You may find this Guide helpful: https://gradio.app/using_blocks_like_functions/)spacer()rOrPprintrxrXjsonrS status_coderesearchrloadsgroupAttributeErrorfrom_spaces_interfacefrom_spaces_blocks) space_namer(rir)r3 space_urlrp iframe_urlconfig_requestrresultconfigaes r4rjrjs ` 1 =I !) -.G}$%,XJ#7  0 E BG   V $ZL1Z [  YYzI5wGN!!S( IIj' 2 :AFF  PZZ Q0F  # #s *$$&( 4] ^  6!$ x ?E    MMB  " XFF) P9*FGR O Ps#$E// F 8FF c4t||dd}|jtjdkrt d|jdg}|j j D]{\}}t|tstdt||j|}|jr!|j|j|k|jd}tj j#|j$||j&S)NF)r(download_files_skip_componentsz4.0.0b14zCGradio version 4.x cannot load spaces with versions less than 4.x (z3).Please downgrade to version 3 to load this space.z-Expected endpoint to be an Endpoint, but got )r app_versionr Versionr endpointsitemsrUr TypeErrorr8 new_helper backend_fnappendmake_end_to_end_fnrAr from_configrr')rr(r predict_fnsfn_indexendpointhelpers r4rr0s   FGOOJ77,QRXRdRdQef@ @  K$..446 %((H-?X?OP ""8,      x::6B C   t $ % 99  VZZ HHr6c  tj|dddi |dvrd| d< fd}||n||_|d<tfi|}d |d <t j d i|}|S) Nz /api/predict/z Content-Typezapplication/jsonrrrctjd|i}tj|}tj|j j d}d|vrd|dvr td |d}tdd k(r|d }tdd k(rt|tr|d }|S#t$r}td||d}~wwxYw) Nr{)rpr{zutf-8error429z)Too many requests to the Hugging Face APIzNCould not find 'data' key in response from external Space. Response received: r>r r) rdumpsrxpostrrvdecoderKeyErrorrRrUlist)r{r|routputker~rrps r4rz!from_spaces_interface..fn^szz64.)::gwTBH,,33G<= f &/!9&'RS S F^F y! "a 'AYF y! "a 'Jvt,DAYF  `ag`hi  s6B99 CCCrT _api_moder.)rstreamline_spaces_interfacerrrAr) rrrir(rr3rrr~rps ` @@r4rrOs 7 7 ?F M*G12G}$%,XJ#7 ,"-%JBKF4L & #F #FF; &v&I r6)=z.docz.docxz.rtfz.epubz.odtz.odpz.pptxz.txtz.mdz.pyz.ipynbz.jsz.jsxz.htmlz.cssz.javaz.csz.phpz.cz.ccz.cppz.cxxz.ctsz.hz.hhz.hppz.rsz.Rz.Rmdz.swiftz.goz.rbz.ktz.ktsz.tsz.tsxz.mz.mmz.mtsz.scalaz.dartz.luaz.plz.pmz.tz.shz.bashz.zshz.batz.coffeez.csvz.logz.iniz.cfgz.configz.jsonz.protoz.yamlz.ymlz.tomlz.sql)z.pngz.jpgz.jpegz.gifz.webpc tg}|D]}t|dtr|j|d|dd1t|dtr/|dddt |ddidgd}|j|st d|dd t|tr|}g}n$|j d d}|j d g}gg}}|D]H} | jjtr|j| 8|j| J|D]%} |jd ddt | idgd'|s|rp|xsd }|dj|D cgc]4} dt| jdt| j6c} z }|jd d |dgd|Scc} w)Nrvroler!rv image_urlurlr)r8r#zInvalid message format: z,. Messages must be either strings or tuples.rfilesuserrF z ## )r8r)rUrr tupler rSrXlowerendswithTEXT_FILE_EXTENSIONSrTrr& read_text) history new_message conversationmessage image_messagerr% image_files text_encodedfileimages r4format_conversationr6sL gi(# .    WY5GH  *E 2!,!#? @RST@U#V& M    .*79+=*>>jk ',+s#vt,, "BK% ::< !5 6    %   t $ %   !,&+-I%-P%Q     |zr  ) T (4:+?+?+A*BC    &$)G(H I   s9F5 r3T) file_typessystem_message streamingc  ddlm}ddlm||||rd|dgngt j |}dfd } dfd } g} |D].} | d k(r | tz } | d k(r | tz } !td | dd|vrddl m } | ddd|d<|r| n| fdt||rtj| ndd|S#t$r}td|d}~wwxYw)aN Load a chat interface from an OpenAI API chat compatible endpoint. Parameters: base_url: The base URL of the endpoint, e.g. "http://localhost:11434/v1/" model: The name of the model you are loading, e.g. "llama3.2" token: The API token or a placeholder string if you are using a local model, e.g. "ollama" file_types: The file types allowed to be uploaded by the user. "text_encoded" allows uploading any text-encoded file (which is simply appended to the prompt), and "image" adds image upload support. Set to None to disable file uploads. system_message: The system message to use for the conversation, if any. streaming: Whether the response should be streamed. kwargs: Additional keyword arguments to pass into ChatInterface for customization. Example: import gradio as gr gr.load_chat( "http://localhost:11434/v1/", model="qwen2.5", token="***", file_types=["text_encoded", "image"], system_message="You are a silly assistant.", ).launch() r)OpenAIznTo use OpenAI API Client, you must install the `openai` package. You can install it with `pip install openai`.Nr)api_keybase_urlsystemr"c*|xs}t|dkDr+t|dttfrj|}t ||}j jj|jdjjS)Nr)ror) rRrUrr(_tuples_to_messagesr6chat completionsrNchoicesr0rv)r0r-r/rrro start_messages r4open_apizload_chat..open_api/s*] w.open_api_stream=s*] wros8# /)  )0<44@"D?$35:*  ',"&| | |  |  |%| | | |D "&        B#' eee e e  eX #' =G=G)=G =G =G  =G@I>++ + +* +  ++\>~C> >-B>>B f!%ff f f  ffff fr6