Q^(h8 UdZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZmZmZmZddlmZddlmZmZmZm Z m!Z!m"Z"d d l#m$Z$m%Z%m&Z&m'Z'd d l(m)Z)m*Z*e rdd l+m,Z,m-Z-ddl.m/Z/e0Z1ee0e fZ2ee3efZ4ee4e2e1fZ5ddhZ6ejne8Z9eGddZ:eGddZ;dZede5dee4fdZ?ededdeedfdZ?edee5deee4ddffdZ?de5de0fdZ@de0ddfd ZAde3defd!ZBde3defd"ZCde3ddfd#ZDd$ee3efdefd%ZEd&ee3d'eFdeee0ee*ffd(ZGd&ee3d'eFdeee0ee*ffd)ZHd*e3d'eFdeee0e*ffd+ZId,ee3dee)fd-ZJd,ee3dee)fd.ZKd*e3dee)fd/ZLd0d1d$d2dee3fd3ZMiZNeee0ee0feOd4<d5ee0d6ee0ddfd7ZPd5ee0dee0fd8ZQd9edefd:ZRd;ee0dzEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImagez text-to-imagezimage-to-imagecreZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<y)RequestParametersurltaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__rrr rContentTr_/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/huggingface_hub/inference/_common.pyr(r(HsE H I C= 5dD) ** 8  #s(^r6r(c:eZdZUdZeed<eed<eed<eed<y) ModelStatusas This Dataclass represents the model status in the HF Inference API. Args: loaded (`bool`): If the model is currently loaded into HF's Inference API. Models are loaded on-demand, leading to the user's first request taking longer. If a model is loaded, you can be assured that it is in a healthy state. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig'. If a model's state is 'Loadable', it's not too big and has a supported backend. Loadable models are automatically loaded when the user first requests inference on the endpoint. This means it is transparent for the user to load a model, except that the first call takes longer to complete. compute_type (`Dict`): Information about the compute resource the model is using or will use, such as 'gpu' type and number of replicas. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. loadedstate compute_type frameworkN)r/r0r1__doc__boolr3r2r r5r6r7r9r9Ss, L JNr6r9c8ts tdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)rBs r7_import_aiohttprCts  !ijj Nr6c8ts tdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rrAnumpy)rEs r7 _import_numpyrF}s  cdd Lr6c<ts tdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr%)rrAPILr&r%s r7_import_pil_imagerIs%   `   Lr6contentreturncyNr5rJs r7_open_as_binaryrOs"r6cyrMr5rNs r7rOrOs%(r6c#Kt|tr|jds|jdr>tj d|t j |jyt|}|jstd|dt|tr7tj d||jd5}|dddy|y#1swYyxYww) zOpen `content` as a binary file, either from a URL, a local path, or raw bytes. Do nothing if `content` is None, TODO: handle a PIL.Image as input TODO: handle base64 as input zhttps://zhttp://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rb) isinstancer2 startswithloggerdebugrgetrJrexistsFileNotFoundErroropen)rJfs r7rOrOs'3   j )W-?-? -J LL4WI> ?-##G,44 4 w-~~#$WI.OO  '4  ,WI67 \\$  1G     sCC5C)C5)C2.C5ct|5}t|tr|n|j}t j |j cdddS#1swYyxYw)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.N)rOrSbytesreadbase64 b64encodedecode)rJr- data_as_bytess r7 _b64_encodercsN  !8T *4 7TYY[  .557888s AAA$ encoded_imager&ct}|jtjt j |S)z/Parse a base64-encoded string into a PIL Image.)rIrZioBytesIOr_ b64decode)rdr&s r7 _b64_to_imageris/  E 5::bjj!1!1-!@A BBr6cHtj|jS)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r,loadsrarNs r7_bytes_to_listrm ::gnn& ''r6cHtj|jS)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rkrNs r7_bytes_to_dictrprnr6c`t}|jtj|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rIrZrfrg)rJr&s r7_bytes_to_imagerrs&  E 5::bjj) **r6responsecPt|trtj|S|SrM)rSr]r,rl)rss r7_as_dictrus#-h#>4::h LHLr6bytes_output_as_linesdetailsc#bK|D]} t||}||y#t$rYywxYww)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrvrw byte_payloadoutputs r7 _stream_text_generation_responsersH .  :<QF  L    s / // ,/,/ctK|23d{} t||}||7#t$rYywxYw6yw)z/Used in `AsyncInferenceClient.text_generation`.Nryr|s r7&_async_stream_text_generation_responsersS 4l :<QF  L    4s486$68 &886 3838r}c|jdsy|jdk(r td|jd}t j |j djd}|jdt|d|jdtj|}|s|jjS|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8zdata:z/nerror error_type)rTstripr{rar,rllstriprstriprW_parse_text_generation_errorr"parse_obj_as_instancetokentext)r}rwpayload json_payloadr~s r7rzrzs  " "8 ,.566!!'*G::gnnW5<EcI\I\IaIaIc G$[[. 0 C Z'  s A A A,rrc|dk(r t|S|dk(r t|S|dk(r t|S|dk(r t|St |S)N generationincomplete_generation overloaded validation)rrrrr)rrs r7rrsZ\!u%%,,(//\!u%%\!u%%  r6)Tr>r_rfr,logging contextlibr dataclassesrpathlibrtypingrrrr r r r r rrrrrrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesr!r"rBr#r$ PIL.Imager&r2UrlTPathTr]BinaryTr4TASKS_EXPECTING_IMAGES getLoggerr/rUr(r9rCrFrIrOrcrirmrprrrur?rrrzrrrrrr3rrrrr5r6r7rsL %!"_^T5  c4i x  %% &*+;<   8 $    @  " "G" "  ( T](GDM"( ( Xh/Ihw>OQUW[>[4\>88c8CCC (E(d((E(d(+U+w+MuUD[)MdM #E? 59  8C=(#=> >?  (/ :>  = }-GH HI 88"&8 eC33458, %  ()  u% -. JJ ()J*O?OTabgTh0GI#T(3-c*B%CHY8C=YVZ[^V_YdhY>8C=>T#Y>I(6  8C= Uh r6