Q^(hcUdZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z ddl mZmZmZmZmZmZmZddlZddlmZmZddlmZdd lmZdd lmZd d lmZd d l m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'ddlm(Z(ddl)m*Z*ddl+m,Z,ddl-m.Z.e(j^e0Z1dZ2dZ3ejhdejjZ6GddeZ7GddeZ8dejrfdZ:egejrfZ;e:adejrfd Z?d?d!Z@ed"eAd#eAdejrfd$ZBd%dd&ejejfe jd'd(e.d)eFd*eAd+eGd,eGd-eeeHeeeHd.ffd/eeAeeAd.ffdefd0ZId)eFd1eeFdeFfd2ZJd@d3ed4eeFddfd5ZKd6ee%d7eFd3ede%fd8ZLd9ej6deFfd:ZMejhd;ejZOdZPy)Az>Contains utilities to handle HTTP requests in Huggingface Hub.N) lru_cache) HTTPStatus)quote)AnyCallableListOptionalTupleTypeUnion) HTTPErrorResponse) HTTPAdapter)PreparedRequest)OfflineModeIsEnabled) constants)BadRequestErrorDisabledRepoErrorEntryNotFoundErrorGatedRepoErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundError)logging)JSONDecodeError) SliceFileObj) HTTP_METHOD_TX-Amzn-Trace-Idz x-request-ida  # staging or production endpoint ^https://[^/]+ ( # on /api/repo_type/repo_id /api/(models|datasets|spaces)/(.+) | # or /repo_id/resolve/revision/... /(.+)/resolve/(.+) ) )flagsc6eZdZdZfdZdedeffd ZxZS)UniqueRequestIdAdapterr c t||fi|t|jvrO|jj t xst tj|jt<tt |jj dddkD}tjd|jtd|jd|jd|d y) N authorizationrzRequest z:  z (authenticated: ))super add_headersX_AMZN_TRACE_IDheadersget X_REQUEST_IDstruuiduuid4lenloggerdebugmethodurl)selfrequestkwargs has_token __class__s Y/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.pyr*z"UniqueRequestIdAdapter.add_headersNs G.v. '// 1/6/B/B

>:J!GKK=Xijsittu v r8returnc<tjr!tjdt | t ||g|i|S#tj$rA}|jjt}|g|jd|d|_ d}~wwxYw)zSCatch any RequestException to append request id to the error message for debugging.zSend: Nz (Request ID: r() rHF_DEBUGr3r4_curlifyr)sendrequestsRequestExceptionr,r-r+args)r7r8rEr9e request_idr;s r<rBzUniqueRequestIdAdapter.send[s    LL6(7"3!45 6 7<9$9&9 9((  ,,_=J%A166A]:,a#@A   sABc4td|jd)Nz Cannot reach za: offline mode is enabled. To disable it, please unset the `HF_HUB_OFFLINE` environment variable.)rr6)r7r8rEr9s r<rBzOfflineAdapter.sendjs&"GKK=)J K  r=N)rHrIrJrrrBr=r<rMrMis O  r=rMr>c"tj}tjr6|j dt |j dt |S|j dt |j dt |S)Nzhttp://zhttps://)rCSessionrHF_HUB_OFFLINEmountrMr#)sessions r<_default_backend_factoryrUpsm G i!12 j."23 N  i!7!9: j"8":; Nr=_GLOBAL_BACKEND_FACTORYbackend_factoryc|aty)a Configure the HTTP backend by providing a `backend_factory`. Any HTTP calls made by `huggingface_hub` will use a Session object instantiated by this factory. This can be useful if you are running your scripts in a specific environment requiring custom configuration (e.g. custom proxy or certifications). Use [`get_session`] to get a configured Session. Since `requests.Session` is not guaranteed to be thread-safe, `huggingface_hub` creates 1 Session instance per thread. They are all instantiated using the same `backend_factory` set in [`configure_http_backend`]. A LRU cache is used to cache the created sessions (and connections) between calls. Max size is 128 to avoid memory leaks if thousands of threads are spawned. See [this issue](https://github.com/psf/requests/issues/2766) to know more about thread-safety in `requests`. Example: ```py import requests from huggingface_hub import configure_http_backend, get_session # Create a factory function that returns a Session with configured proxies def backend_factory() -> requests.Session: session = requests.Session() session.proxies = {"http": "http://10.10.1.10:3128", "https": "https://10.10.1.11:1080"} return session # Set it as the default session factory configure_http_backend(backend_factory=backend_factory) # In practice, this is mostly done internally in `huggingface_hub` session = get_session() ``` N)rVreset_sessions)rWs r<configure_http_backendrZs@.r=cdttjtjS)a Get a `requests.Session` object, using the session factory from the user. Use [`get_session`] to get a configured Session. Since `requests.Session` is not guaranteed to be thread-safe, `huggingface_hub` creates 1 Session instance per thread. They are all instantiated using the same `backend_factory` set in [`configure_http_backend`]. A LRU cache is used to cache the created sessions (and connections) between calls. Max size is 128 to avoid memory leaks if thousands of threads are spawned. See [this issue](https://github.com/psf/requests/issues/2766) to know more about thread-safety in `requests`. Example: ```py import requests from huggingface_hub import configure_http_backend, get_session # Create a factory function that returns a Session with configured proxies def backend_factory() -> requests.Session: session = requests.Session() session.proxies = {"http": "http://10.10.1.10:3128", "https": "https://10.10.1.11:1080"} return session # Set it as the default session factory configure_http_backend(backend_factory=backend_factory) # In practice, this is mostly done internally in `huggingface_hub` session = get_session() ```  process_id thread_id)_get_session_from_cacheosgetpid threading get_identrOr=r< get_sessionrds : #biikYEXEXEZ [[r=c,tjy)zReset the cache of sessions. Mostly used internally when sessions are reconfigured or an SSLError is raised. See [`configure_http_backend`] for more details. N)r_ cache_clearrOr=r<rYrYs '')r=r]r^ctS)z Create a new session per thread using global factory. Using LRU cache (maxsize 128) to avoid memory leaks when using thousands of threads. Cache is cleared when `configure_http_backend` is called. )rVr\s r<r_r_s # $$r=) max_retriesbase_wait_time max_wait_timeretry_on_exceptionsretry_on_status_codesr5r6rjrkrlrm.rnc $t|tr|f}t|tr|f}d}|} d} d|vr6t|dtjt fr|dj } t} |dz } | |dj| | jd||d|} | j|vr| Stjd| jd|d|||kDr| j| S tjd | d |d |dt#j$| t'|| dz} #|$rS} tjd | d |d|t| tjr t!||kDr| Yd} ~ d} ~ wwxYw)a# Wrapper around requests to retry calls on an endpoint, with exponential backoff. Endpoint call is retried on exceptions (ex: connection timeout, proxy error,...) and/or on specific status codes (ex: service unavailable). If the call failed more than `max_retries`, the exception is thrown or `raise_for_status` is called on the response object. Re-implement mechanisms from the `backoff` library to avoid adding an external dependencies to `hugging_face_hub`. See https://github.com/litl/backoff. Args: method (`Literal["GET", "OPTIONS", "HEAD", "POST", "PUT", "PATCH", "DELETE"]`): HTTP method to perform. url (`str`): The URL of the resource to fetch. max_retries (`int`, *optional*, defaults to `5`): Maximum number of retries, defaults to 5 (no retries). base_wait_time (`float`, *optional*, defaults to `1`): Duration (in seconds) to wait before retrying the first time. Wait time between retries then grows exponentially, capped by `max_wait_time`. max_wait_time (`float`, *optional*, defaults to `8`): Maximum duration (in seconds) to wait before retrying. retry_on_exceptions (`Type[Exception]` or `Tuple[Type[Exception]]`, *optional*): Define which exceptions must be caught to retry the request. Can be a single type or a tuple of types. By default, retry on `requests.Timeout` and `requests.ConnectionError`. retry_on_status_codes (`int` or `Tuple[int]`, *optional*, defaults to `503`): Define on which status codes the request must be retried. By default, only HTTP 503 Service Unavailable is retried. **kwargs (`dict`, *optional*): kwargs to pass to `requests.request`. Example: ``` >>> from huggingface_hub.utils import http_backoff # Same usage as "requests.request". >>> response = http_backoff("GET", "https://www.google.com") >>> response.raise_for_status() # If you expect a Gateway Timeout from time to time >>> http_backoff("PUT", upload_url, data=data, retry_on_status_codes=504) >>> response.raise_for_status() ``` When using `requests` it is possible to stream data by passing an iterator to the `data` argument. On http backoff this is a problem as the iterator is not reset after a failed call. This issue is mitigated for file objects or any IO streams by saving the initial position of the cursor (with `data.tell()`) and resetting the cursor between each call (with `data.seek()`). For arbitrary iterators, http backoff will fail. If this is a hard constraint for you, please let us know by opening an issue on [Github](https://github.com/huggingface/huggingface_hub). rNdatar)r5r6z HTTP Error z thrown while requesting r''z' thrown while requesting z Retrying in z s [Retry /z].rrO) isinstancetypeintioIOBasertellrdseekr8 status_coder3warningraise_for_statusrCConnectionErrorrYtimesleepmin)r5r6rjrkrlrmrnr9nb_tries sleep_timeio_obj_initial_posrTresponseerrs r< http_backoffrsN%t,24'-!6 8HJ  Jvf~ <7PQ#F^002mG A  "-v##$67'wHf#HHH##+@@ NN[)=)=(>>WX^W__`ad`ef g+%))+  & j\8*Ak]RTUV : Q7 G *#  NNQse#=fXQseL M#x778 +% &  s8:D73>D77F Raises when the request has failed: - [`~utils.RepositoryNotFoundError`] If the repository to download from cannot be found. This may be because it doesn't exist, because `repo_type` is not set correctly, or because the repo is `private` and you do not have access. - [`~utils.GatedRepoError`] If the repository exists but is gated and the user is not on the authorized list. - [`~utils.RevisionNotFoundError`] If the repository exists but the revision couldn't be find. - [`~utils.EntryNotFoundError`] If the repository exists but the entry (e.g. the requested file) couldn't be find. - [`~utils.BadRequestError`] If request failed with a HTTP 400 BadRequest error. - [`~utils.HfHubHTTPError`] If request failed for a reason not listed above. z X-Error-CodeX-Error-MessageRevisionNotFoundz Client Error. zRevision Not Found for url: . EntryNotFoundzEntry Not Found for url: GatedRepoz!Cannot access gated repo for url z$Access to this resource is disabled.z!Cannot access repository for url  RepoNotFoundiz+Invalid credentials in Authorization headerNzRepository Not Found for url: z Please make sure you specified the correct `repo_id` and `repo_type`. If you are trying to access a private or gated repo, make sure you are authenticated. For more details, see https://huggingface.co/docs/huggingface_hub/authenticationiz Bad request for z endpoint:z Bad request:iz Forbidden: z Cannot access content at: z2 Make sure your token has the correct permissions.iRangez. Requested range: z. Content-Range: z Content-Range)r|r r,r-rzr6_formatrrrrr8REPO_API_REGEXsearchrrrr/)rrrF error_code error_messagemessage range_headers r<hf_raise_for_statusr`sfpJ?!!# H?%%)).9  ((,,->? + +!--.n=FKghphthtguuvIwwG/(C J ? *!--.n=FKdemeqeqdrrsIttG,gx@a G ; &''(7&@EfgogsgsfttuCvv .'8 )  C '!NN  ,  $$0%%h&6&6&:&:;G''(728<<.BCNN 17HE1 L  ! !S (DQD]&}oZ@cu /7H=1 D  ! !S (x++,LqI0a@AGH  .'8QH?s KJ8KK error_typecustom_messagec0g}|jjd}||j| |j}|jd}|3t |t r|j |n|j||jd}| |D]}d|vs|j|d|D cgc]5} t| jst| j7}} t tj|}dj|} |} | r5| j|jvrd |vr | d| zz } n| d | zz } t|jjtd} | rd | d } n1t|jjt d} | rd | d } | rI| j| jvr)d| vr | j#d}| d| z| |dz} n|  z } || j|| xsd S#t$rY|jjdd}|jr-d|jvr|j|jYwxYwcc} w)Nrerrorerrorsrz Content-Typer&htmlrrz (Request ID: r(z (Amzn Trace ID: )rserver_message)r,r-appendjsonrslistextendrtextlowerr/stripdictfromkeysjoinr.r+index)rrr server_errors from_headersrprr content_typelinerfinal_error_messagerGrequest_id_message newline_indexs r<rrsM##''(9:L\*0}}!  %&$$U+$$U+(#   ;%!((y)9: ;4AV4CIOODUSY__&VMV}56MYY}-N)...08L8L8NN ^ # 4.#8 8  6N#: : X%%)),;\}}|r|jt||s%|jt|@dj!|S)zConvert a `requests.PreparedRequest` into a curl command (str). Used for debug purposes only. Implementation vendored from https://github.com/ofw/curlify/blob/master/curlify.py. MIT License Copyright (c) 2016 Egor. )curlNz-Xr%zz-Hz{0}: {1}zutf-8ignore)rreadziNz ... [truncated]z-drr&r')r5sortedr,itemsrformatbodyrsbytesdecodehasattrr2rr6rrr)r8partskvr flat_partss r<rArA/sS  w~~$E w,,./31 779 'A 4**1a01223 |||| dE ";;wx;8D T6 "'D t9t ;!33D 4dB/011 tW[[! ""EJ(1   eAh '   eAh ' ( 88J r=z%^\s*bytes\s*=\s*(\d*)\s*-\s*(\d*)\s*$original_range resume_sizec|sd|dSd|vrtd|dtj|}|std|d|j \}}|s:|std|dt ||z }d|}|d krtd |d|St |}||z}|r)t |}d|d|}||kDrtd |d|Sd|dS) zB Adjust HTTP Range header to account for resume position. zbytes=-,zMultiple ranges detected - z, not supported yet.zInvalid range format - rzbytes=-rzEmpty new range - ) ValueError RANGE_REGEXmatch RuntimeErrorgroupsru)rrrstartend new_suffix new_range new_starts r<_adjust_range_headerr[s'  }A&& n6~6HH\]^^   n -E 4^4FaHIIJE3 !88J!LM MX + j\* ?!3I=BC C JE #I #hYKq. s?!3I=BC C I;a  r=)r>N)N)Q__doc__rvr`rerbr~r0 functoolsrhttprshlexrtypingrrrr r r r rCr rrequests.adaptersrrequests.modelsrhuggingface_hub.errorsrr&rrrrrrrrrr_fixesr_lfsr_typingr get_loggerrHr3r+r.compileVERBOSErr#rMrQrUBACKEND_FACTORY_TrV__annotations__rZrdrYrur_Timeoutr}SERVICE_UNAVAILABLEr/float ExceptionrrrrrA IGNORECASErrrOr=r<rsE  DDD()+7#"   H % $   **  [< [ ("2"2R!1!112-E*EAY!,=!]a!H\X%%\@* %%%@P@P% %  P:D9W9W{8 {8 {8 {8  {8  {8tId9os6J0KKL{8!eCHo!56{8{8|  x}  B?(B?8C=B?TXB?JGm^,GmcGmXGmZhGmT% h..% 3% RbjjA2==Q "!#"!S"!XVY]"!r=