$%hjx4ddlmZddlZddlmZddlmZmZmZm Z m Z m Z m Z m Z ddlmZmZmZddlmZddlmZmZmZdd lmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$d d l%m&Z&d d lm'Z'm(Z(m)Z)d dl*m+Z+m,Z,m-Z-d dl.m/Z/d dl0m1Z1m2Z2ddl3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:d dl;mm?Z?m@Z@mAZAd dlBmCZCmDZDd dlEmFZFd dlGmHZId dlJmKZLGddee4ZMGddee4ZNGddee4ZOGdd ee4ZPGd!d"ee4ZQGd#d$ZRd'd%ZSd(d&ZTy))) annotationsN) TracebackType) TYPE_CHECKINGAnyGenericCallableIterable Awaitable AsyncIteratorcast)SelfIterator assert_never) from_json)ParsedChoiceSnapshotParsedChatCompletionSnapshot#ParsedChatCompletionMessageSnapshot) ChunkEventContentDoneEventRefusalDoneEventContentDeltaEventRefusalDeltaEventLogprobsContentDoneEventLogprobsRefusalDoneEventChatCompletionStreamEventLogprobsContentDeltaEventLogprobsRefusalDeltaEvent"FunctionToolCallArgumentsDoneEvent#FunctionToolCallArgumentsDeltaEvent)accumulate_delta) NOT_GIVENIncExNotGiven)is_givenconsume_sync_iteratorconsume_async_iterator) model_dump)buildconstruct_type)ResponseFormatThas_parseable_inputmaybe_parse_contentparse_chat_completionget_input_tool_by_namesolve_response_format_tparse_function_tool_arguments)Stream AsyncStream)ChatCompletionChunkParsedChatCompletionChatCompletionToolParam)LengthFinishReasonErrorContentFilterFinishReasonError)ChoiceLogprobs)Choice)ResponseFormatceZdZdZ d dZddZddZddZ ddZddZ ddZ dd Z e dd Z dd Zy )ChatCompletionStream+Wrapper over the Chat Completions streaming API that adds helpful events such as `content.done`, supports automatically parsing responses & tool calls and accumulates a `ChatCompletion` object from each individual chunk. https://platform.openai.com/docs/api-reference/streaming c||_|j|_|j|_t |||_yNresponse_format input_tools _raw_streamresponse _response __stream__ _iteratorChatCompletionStreamState_stateself raw_streamrErFs d/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/openai/lib/streaming/chat/_completions.py__init__zChatCompletionStream.__init__86&#,,*/]hi c6|jjSN)rL__next__rPs rRrXzChatCompletionStream.__next__Ds~~&&((rUc#6K|jD]}|ywrWrLrPitems rR__iter__zChatCompletionStream.__iter__GsNN DJ sc|SrWrYs rR __enter__zChatCompletionStream.__enter__Ks rUc$|jyrWcloserPexc_typeexcexc_tbs rR__exit__zChatCompletionStream.__exit__Ns rUc8|jjyz Close the response and release the connection. Automatically called if the response body is read to completion. N)rJrdrYs rRrdzChatCompletionStream.closeVs rUcV|j|jjS)VWaits until the stream has been read to completion and returns the accumulated `ParsedChatCompletion` object. If you passed a class type to `.stream()`, the `completion.choices[0].message.parsed` property will be the content deserialised into that class, if there was any content returned by the API.  until_donerNget_final_completionrYs rRrpz)ChatCompletionStream.get_final_completion^s! {{//11rUct||S)*Blocks until the stream has been consumed.)r(rYs rRrozChatCompletionStream.until_doneisd# rUc.|jjSrWrNcurrent_completion_snapshotrYs rRruz0ChatCompletionStream.current_completion_snapshotn{{666rUc#K|jD]4}t|s|jj|}|D]}|6ywrWrH$_is_valid_chat_completion_chunk_weakrN handle_chunkrP sse_eventevents_to_fireevents rRrKzChatCompletionStream.__stream__rsN)) I7 B![[55i@N'     sAAN)rQzStream[ChatCompletionChunk]rE6type[ResponseFormatT] | ResponseFormatParam | NotGivenrF,Iterable[ChatCompletionToolParam] | NotGivenreturnNonerz*ChatCompletionStreamEvent[ResponseFormatT])rz4Iterator[ChatCompletionStreamEvent[ResponseFormatT]]rr rfztype[BaseException] | NonergzBaseException | NonerhzTracebackType | Nonerrrrrz%ParsedChatCompletion[ResponseFormatT]rr)__name__ __module__ __qualname____doc__rSrXr^rarirdrpropropertyrurKr`rUrRr@r@/s j0 jP j B j  j),"%    2 77rUr@cHeZdZdZ ddZddZ ddZy) ChatCompletionStreamManageraKContext manager over a `ChatCompletionStream` that is returned by `.stream()`. This context manager ensures the response cannot be leaked if you don't read the stream to completion. Usage: ```py with client.beta.chat.completions.stream(...) as stream: for event in stream: ... ``` c<d|_||_||_||_yrW)$_ChatCompletionStreamManager__stream)_ChatCompletionStreamManager__api_request-_ChatCompletionStreamManager__response_format)_ChatCompletionStreamManager__input_toolsrP api_requestrErFs rRrSz$ChatCompletionStreamManager.__init__s%GK (!0(rUc|j}t||j|j|_|jSN)rQrErF)rr@rrrrPrQs rRraz%ChatCompletionStreamManager.__enter__s='') ,! 22**  }}rUcR|j|jjyyrW)rrdres rRriz$ChatCompletionStreamManager.__exit__s# == $ MM   ! %rUN)rz)Callable[[], Stream[ChatCompletionChunk]]rErrFrrr)rz%ChatCompletionStream[ResponseFormatT]r)rrrrrSrarir`rUrRrr{sd  )> )P ) B )  ) ","""% "  "rUrceZdZdZ d dZddZddZddZ ddZddZ ddZ dd Z e dd Z dd Zy )AsyncChatCompletionStreamrAc||_|j|_|j|_t |||_yrCrGrOs rRrSz"AsyncChatCompletionStream.__init__rTrUcRK|jjd{S7wrW)rL __anext__rYs rRrz#AsyncChatCompletionStream.__anext__s^^--////s '%'cHK|j23d{}|7 6ywrWr[r\s rR __aiter__z#AsyncChatCompletionStream.__aiter__s&..  $J .s "  " "cK|SwrWr`rYs rR __aenter__z$AsyncChatCompletionStream.__aenter__s  sc@K|jd{y7wrWrcres rR __aexit__z#AsyncChatCompletionStream.__aexit__s jjls cTK|jjd{y7wrk)rJacloserYs rRrdzAsyncChatCompletionStream.closes nn##%%%s (&(crK|jd{|jjS7w)rmNrnrYs rRrpz.AsyncChatCompletionStream.get_final_completions0oo{{//11 s 757c8Kt|d{|S7w)rrN)r)rYs rRroz$AsyncChatCompletionStream.until_dones$T***  +s c.|jjSrWrtrYs rRruz5AsyncChatCompletionStream.current_completion_snapshotrvrUcK|j23d{}t|s|jj|}|D]}| =786ywrWrxr{s rRrKz$AsyncChatCompletionStream.__stream__sW#//  )7 B![[55i@N'     /s% AAA A5A AAN)rQz AsyncStream[ChatCompletionChunk]rErrFrrrr)rz9AsyncIterator[ChatCompletionStreamEvent[ResponseFormatT]]rrrrr)rrrrrSrrrrrdrprorrurKr`rUrRrrs j5 jP j B j  j0,"%   & 2 77rUrcHeZdZdZ ddZddZ ddZy) AsyncChatCompletionStreamManageraVContext manager over a `AsyncChatCompletionStream` that is returned by `.stream()`. This context manager ensures the response cannot be leaked if you don't read the stream to completion. Usage: ```py async with client.beta.chat.completions.stream(...) as stream: for event in stream: ... ``` c<d|_||_||_||_yrW))_AsyncChatCompletionStreamManager__stream._AsyncChatCompletionStreamManager__api_request2_AsyncChatCompletionStreamManager__response_format._AsyncChatCompletionStreamManager__input_toolsrs rRrSz)AsyncChatCompletionStreamManager.__init__s%LP (!0(rUcK|jd{}t||j|j|_|jS77wr)rrrrrrs rRrz+AsyncChatCompletionStreamManager.__aenter__sF--- 1! 22**  }}.sA A 8A cnK|j#|jjd{yy7wrW)rrdres rRrz*AsyncChatCompletionStreamManager.__aexit__s0 == $--%%' ' ' % 's *535N)rz+Awaitable[AsyncStream[ChatCompletionChunk]]rErrFrrr)rz*AsyncChatCompletionStream[ResponseFormatT]r)rrrrrSrrr`rUrRrrsd  )@ )P ) B )  ) (,("(% (  (rUrcpeZdZdZeed d dZd dZed dZddZ ddZ ddZ dd Z y )rMaSHelper class for manually accumulating `ChatCompletionChunk`s into a final `ChatCompletion` object. This is useful in cases where you can't always use the `.stream()` method, e.g. ```py from openai.lib.streaming.chat import ChatCompletionStreamState state = ChatCompletionStreamState() stream = client.chat.completions.create(..., stream=True) for chunk in response: state.handle_chunk(chunk) # can also access the accumulated `ChatCompletion` mid-stream state.current_completion_snapshot print(state.get_final_completion()) ``` )rFrEcd|_g|_t|r|Dcgc]}|c}ng|_||_t j |r||_yt|_ycc}wrW) 7_ChatCompletionStreamState__current_completion_snapshot/_ChatCompletionStreamState__choice_event_statesr' _input_tools_response_formatinspectisclassr$_rich_response_format)rPrFrEtools rRrSz"ChatCompletionStreamState.__init__:s\ SW*=?">F{>Sk:dT:Y[ /IPYhIio"ox";s A!cZt|j|j|jS)zParse the final completion object. Note this does not provide any guarantees that the stream has actually finished, you must only call this method when the stream is finished. )chat_completionrErF)r1rurrrYs rRrpz.ChatCompletionStreamState.get_final_completionGs, % << 66))  rUc6|jJ|jSrW)rrYs rRruz5ChatCompletionStreamState.current_completion_snapshotSs 11===111rUch|j||_|j||jS)zTAccumulate a new chunk into the snapshot and returns an iterable of events to yield.)chunkcompletion_snapshot)_accumulate_chunkr _build_events)rPrs rRrzz&ChatCompletionStreamState.handle_chunkXs9-1-C-CE-J*!! $ B B"  rUc |j|jS#t$r6t|j}|jj ||cYSwxYw)N)rF)rindex IndexErrorChoiceEventStaterappend)rPchoice choice_states rR_get_choice_statez+ChatCompletionStreamState._get_choice_stateasU --fll; ; +8I8IJL  & & - -l ;  s >mmx YF7 D"5"="=fll"K&5&=&=&H&H&NB#*.7"A. 6 *$3$;$;-1(-6:?HH_H_HjHjHpnp>q;.4:C14jCUW[B\5]0];.)* -& !"(!!79M9M9OP++'@.77J-K0)J / 7 7 B B Hb*UH ~~3'}} :::=F=O=O=`=`)):&$Y/0*##060D0D-&t7L7LZ^ZkZkl++x76ATUU++/??<>> ''//'//77T778#++33::<1:/11997C!%2''. $*<<#:#:#@b 5&5&=&=&H&H&NBP_PePe%f"%**j8!7$($5$5>xH.77AAGP!"4"="="G"GQ)-H*33D# !34% 5(*"++3/4& & 7 7 & 7 70O, ..*33;;C?AO44<'0088??@W@WX..*33;;C?AO44<'0088??@W@WXqx Yt%*KK!161I1I.""O;.. D"&("2$//dWI/V%v||';';'= #$++22?C Ds,BT0>T*,CT0 T0*T00A3V'&V'cFg}|jttd|||jD]l}|j |}|j|j }|j ju|jj_|jttd|j j|jj|jj|j j`|jjJ|jttd|j j|jj|j jr|jj}|J|j jD]}||j } | jdk(r|jJ|jtt d| jj"|j | jj$| jj&|jj$xsd t(st+| |j,|j,|j,jr`|j,jrJ|jtt.d |j,j|j,j |j,jr`|j,jrJ|jtt0d |j,j|j,j|j3|j5|||j6o|S)Nr)rrsnapshotz content.delta)rrrrz refusal.delta)rrrrz#tool_calls.function.arguments.delta)rrrrrarguments_deltazlogprobs.content.delta)rrrzlogprobs.refusal.delta)rrr) choice_chunkrrE)rr+rrrrrrrrrrrrrrr rrrrrrrrrget_done_eventsr) rPrrr}rrrrtool_call_delta tool_calls rRrz'ChatCompletionStreamState._build_eventss LN *7%BU V mmK F11&9L199&,,GO||##/O4K4K4S4S4_%%),$ll22!0!8!8!@!@.66== ||##/O4K4K4S4S4_%%),$ll22!0!8!8!@!@ ||&&,44?? !---'-||'>'>0O *?+@+@ AI ~~3.77CCC&--! C%J%.%7%7%<%<&5&;&;*3*<*<*F*F1:1C1C1T1T0?0H0H0R0R0XVX '$Y/#0&*/G/G/S??**/G/G/O/O"))5!9$*OO$;$;%4%=%=%E%E ??**/G/G/O/O"))5!9$*OO$;$;%4%=%=%E%E   ! !,,!'$3$($9$9- KK ZrUN)rFrrErrrrr)rr7rz4Iterable[ChatCompletionStreamEvent[ResponseFormatT]])r ChoiceChunkrrrr7rr)rr7rrr0list[ChatCompletionStreamEvent[ResponseFormatT]]) rrrrr$rSrprrurzrrrr`rUrRrMrM%s.ENR[ yB yP y  y  22  C#JY#Y: Y : YrUrMcXeZdZddZ ddZ ddZ d dZy) rcv||_d|_d|_d|_d|_t |_d|_y)NF)r _content_done _refusal_done_logprobs_content_done_logprobs_refusal_doneset_done_tool_calls*_ChoiceEventState__current_tool_call_index)rPrFs rRrSzChoiceEventState.__init__Ks<'""&+#&+#*-%59&rUcg}|jrd|j|j|||j6|j|jvr|j |||j|j jxsgD]x}|j|jk7rL|j|j|||j|j |||j|j|_z|S)N)rrE)r}rr) rr_content_done_eventsrr_add_tool_done_eventrrr)rPrrrEr}rs rRrz ChoiceEventState.get_done_eventsUsLN  ( (  ! !))/[j)k  ..:22$:O:OO))#1$3#==* &++66<" =I--@%%--o_n-o11=--'5(7#'#A#A. .7__D * =rUc g}|jjr|jsd|_t||j}||j_|j t tdtttt|d|jj||jjH|js.>P > : >@$-I$-. $-  $-  $-rUrc .|j}td|d}|jD]A}i|jddhd|jji||j <Ctt tt ddi|dd i S) Nz list[object]rTrrrrobjectzchat.completionr)rr rr*rrrr,)rdatarrs rRrrs ==?D>4 ?3G-- ! dWIF! v||++-!   $.$d+   rUc |jdk(S)Nzchat.completion.chunk)r)r|s rRryrys   6 66rUr)r|r7rbool)U __future__rrtypesrtypingrrrrr r r r typing_extensionsr rrjiterr_typesrrr_eventsrrrrrrrrrrrr _deltasr"r$r%r&_utilsr'r(r)_compatr*_modelsr+r,_parsingr.r/r0r1r2r3r4 _streamingr5r6 types.chatr7r8r9 _exceptionsr:r;types.chat.chat_completionr< types.chat.chat_completion_chunkr=r#types.chat.completion_create_paramsr>ResponseFormatParamr@rrrrMrrryr`rUrRr/s"bbb::kk    '11NN"-/]]S9FYI7?3IX,"'/":,"^I 8IX,(w'?,(^b 8bJ X-X-v.7rU