f^(h<ddlZddlZddlmZddlmZddlmZmZddl Z ddl m cm Z ddlmZmZmZddlmZddlmZmZddlmZmZd d lmZd d lmZd d lmZm Z m!Z!m"Z"d e jFde$fdZ%e jLjNdZ(de jRjTdeee+de,e-e+e jRj\fe-e+e jRj\fffdZ/de jRjTdeee+de-e+e jRj\fde-e+e jRj\fddf dZ0 d*d e jFdee jFdee$e+defdZ1 d*de jRjTdeee+deee+d e jFdee jFde-e+efde-e+efdee$e+fdZ2de jRjTde de-e+efde-e+efddf d Z3Gd!d"e4Z5Gd#d$e jRjTe5%Z6d&e jRjTd'ede6fd(Z7d'ede jpjrfd)Z:y)+N)Sequence)chain)AnyOptional),_enter_enable_graph_inputs_of_type_nn_module+_exit_enable_graph_inputs_of_type_nn_module#_get_graph_inputs_of_type_nn_module)"_check_input_constraints_for_graph) _assign_attr _AttrKind)_PyTreeCodeGen _PyTreeInfo)_remove_effect_tokens)reorder_kwargs)ExportedProgramExportGraphSignature InputKind OutputKindin_specreturnct||}tj||f\}}||k7rtd|d|d|S)Nz>Trying to flatten user inputs with exported input tree spec: z- but actually got inputs with tree spec of: zi. Please check that the inputs have the same number of args and kwargs as the ones you used when tracing.)rpytreetree_flatten_with_path ValueError)argskwargsrreordered_kwargsflat_args_with_path received_specs R/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/torch/export/_unlift.py_check_inputs_matchr"si%fg6)/)F)F  *& Mi<o< <   c|jsyt|||j}t|jj Dcgc]}|j dk(s|c}||jycc}w)N placeholder)validate_inputsr"_in_specr graphnodesoprange_constraints)selfrrrnodes r!!_check_input_constraints_pre_hookr.0s[   -dFDMMJ&****G$dgg.FG Gs A/A/gm lifted_inputsci}i}|jjDcgc]}|jdk(s|}}t|t|k(sJt ||D]\}}||||j <|jj |5|jj|}|j||j} |jj|| |_ |||<ddd||fScc}w#1swYxYw)z_ Unlift inputs referring to params/buffers/constants as getattr nodes in the graph r%N) r(r)r*lenzipnameinserting_afterget_attrreplace_all_uses_withmeta erase_node) r/r0unlifted_name_to_nodeinput_name_to_noder-placeholder_nodes input_node lifted_node getattr_nodemetadatas r!_unlift_inputs_as_getattrrA>s*,((..U$DGG}%??##J/$, !5A%k2  B B B !"4 44V B BsC>C>A DD mutated_outputsr:r;c&d}|jjD]}|jdk(s|}n|Jtj|j d}t |t |k(sJg}i}t||D]\} } | |j| | |vr|| } n| |vr|| } ntd| d|jj|5|jjtjjjj | | f} | || <ddd|Dcgc] }||vr||n|} }|jj|5|jj#t%| }|j'||jj)||j*|_|j,j/|j,dddy#1swYxYwcc}w#1swYyxYw)zt Find the all the buffers and inputs that were mutated and insert copy_ operators to reflect mutations. NoutputrzCould not find z in either buffer or input nodes)r(r)r*r tree_flattenrr2r3append RuntimeErrorinserting_before call_functiontorchopsatencopy_defaultrDtupler7r9r4r8update)r/rBr:r; output_noder-outputsuser_output_nodesreturn_nodes_to_copy return_nodemutated_node_name mutated_node copy_node output_args new_outputs r!_insert_copy_for_mutationsr[[s$K 77h K   "" "!!+"2"23A6G w<3/ // /*-g*G:& &  $  $ $[ 1   5 501BCL "4 4-.?@L!"3!44TU XX & &{ 3 :.. $$,,|[.II1:  -  : ::,& '+.B&BT"LK  " "; /1XX__U;%78 ))*5 K(%** {//0 11 : : 11s AG56H%BH5G? Hout_specforward_arg_namesc|r|}n|jtk(r|jdk(r|jdjtk(r{|jdjtk(r[t |jdjDcgc]}d| }}|j |jdjn%t |jDcgc]}d| }}tt|||Scc}wcc}w)zK Create the codegen for the graph module based on the in/out specs rrarg_) typerO num_childrenchildren_specsdictrangeextendcontextr r)rr\r]namesis r! _get_codegenrjs! LLE !$$)&&q)..%7&&q)..$6*/w/E/Ea/H/U/U)VWAtA3ZWEW LL//2:: ;).w/C/C)DEAtA3ZEEE       XFs C> D state_dict constantsct||\}} t|||| t||||j_|jj |j |S)a  Args: lifted_inputs: A list matching the graph module's input nodes. For an input node that is referring to a lifted parameter/buffer, this list will contain the fqn the corresponding attribute. Otherwise, this list will contain None. This is used to unlift the lifted parameters as get_attr nodes. mutated_outputs: A list matching the graph module's output nodes. For an output node that is referring to a mutated buffer or user input, this list will contain the name of the corresponding buffer or user input that needs to be mutated. Otherwise, this list will contain None. This is used to re-insert an inplace copy_ operator to copy the mutated values back to the original node. )rAr[rjr(_codegenlint recompile) r/r0rBrr\rkrlr]r:r;s r!_unliftrqsc21J M1-- O24F%Wh8IJBHHHHMMOLLN Ir#new_gmgraph_signaturect|j}|jD]3}||vrd}||}nd}||}t|||tj |5|j D]$}||}t|||tj&t|j|jD]$}||}t|||tj&y)NFT attr_kind persistentrv) setnon_persistent_buffersbuffersr r BUFFER parameters PARAMETERrlifted_custom_objslifted_tensor_constantsCONSTANT)rrrsrkrlrzr4rwvalues r!_register_attrs_to_new_gmrs !!G!GH''   ) )JdOEJt$E 649+;+;     ** 4    ))   **O,S,S  $   ((   r#c*eZdZdZdZdfd ZxZS)_StatefulGraphModuleFactoryzO Metaclass that ensures a private constructor for _StatefulGraphModule cLt|jd|jd)N.z has no public constructor. ) TypeError __module__ __qualname__)clsrrs r!__call__z$_StatefulGraphModuleFactory.__call__s,~~a 0 011M N  r#c(t||||S)Nr+)superr)rrootr(r+ __class__s r!_createz#_StatefulGraphModuleFactory._create s#w  /   r#N)__name__rr__doc__rr __classcell__rs@r!rrs   r#rc eZdZdfd ZxZS)_StatefulGraphModulecJt||||xsg|_d|_y)NT)r__init__r+r&)r,rr(r+rs r!rz_StatefulGraphModule.__init__s' u%!2!8b#r#r)rrrrrrs@r!rrs $$r#r) metaclassplain_graph_moduleepctj||j|}t|j|j fd|j t d|jfddi}|jjD]}|j|}|jr0tjd|d|j}|||<|}|jd ^}} t j"j$j'||} t)| | t+|||t,j. |j0j3D]\} } t j"j$j5|| r1t7| t j8rF| jr:tjd| d | |vr|| } n| j} | || <| } t+| || t,j. |jj:D]/}t+|j|||t,j<d 1|S)NrctSr)rrr module_typess r!z/_create_stateful_graph_module..'s L ! r#T) with_kwargsctSr)rrs r!rz/_create_stateful_graph_module..0s K ! r#) always_callzA model attribute `z` requires gradient. but it's not properly registered as a parameter. torch.export will detach it and treat it as a constant tensor but please register it as parameter instead.rrxz` requires gradient but it's not properly registered as a parameter. torch.export will detach it and treat it as a constant tensor but please register it as parameter instead.Fru)rrr(r example_inputsregister_forward_pre_hookr.register_forward_hookrsr get_buffer requires_gradwarningswarndetachrsplitrJfx graph_module_get_attr_via_attr_listdelattrr r rrlitems _has_attr isinstanceTensorrzr|)rr+r stateful_gm"original_tensor_to_detached_tensor constant_fqnbufferdetached_bufferprefixfieldsubmod const_namerdetached_valuers @r!_create_stateful_graph_modulers\ '..  +/K 7r7H7HIL))  )))t*%%  &*,&**BBV '' 5    MM%l^4?@  %mmoO9H .v 6$F%,,S1&&>>{FSV[,)BTBTU)V. \\//1 Exx$$..{JG%.&&MM-j\:GH  BB B5 I).DR:5A . #,,  !4$$;;   ) )& 1  &&    r#c r|jdjdk7r t|}tjj |j tj|j}t||j|j|j|jdjx}r |j nd}|jj"Dcgc]Z}|j$t&j(t&j*t&j,t&j.fvr |j0nd\}}|jj2Dcgc]<}|j$t4j6t4j8fvr |j0nd>}}t;||||j<j>|j<j@|j|j|}tC||jD|}|jFjI|j jF|Scc}wcc}w)NrTRAINING)r])% verifiersdialectrrJr GraphModulercopydeepcopyr(rrsrkrlmodule_call_graph signaturer] input_specskindrr|CONSTANT_TENSORr~ CUSTOM_OBJtarget output_specsrBUFFER_MUTATIONUSER_INPUT_MUTATIONrq call_specrr\rr+r8rP) rrrsigr]rr0r\rB unlift_gms r!&_unlift_exported_program_lifted_statesrs ||A*, "2 & XX ! !"//4==3J KFfb&8&8"--V)+)=)=a)@)J)J"J#"JQU))55 * ||  ))##$$  NN  *M *,**77,  }}**J,J,JKL OO ,O,    + F.fb6J6JBOI NN"//../ K *,sAH/AH4r);rrcollections.abcr itertoolsrtypingrrrJtorch.utils._pytreeutils_pytreertorch._export.non_strict_utilsrrr torch._export.utilsr torch.export.unflattenr r torch.fx.graphr r_remove_effect_tokens_passr _tree_utilsrexported_programrrrrTreeSpeclistr"_dynamodisabler.rrstrrOrdNoderAr[rjrqrrarrrnnModulerr#r!rs $ $$ C:6='v4&  5 5HSM*5 4UXX]]" #T#uxx}}*<%= =>5:31 31hsm,31 UXX]] 2331S%((--/0 31  31r.2 __v' S * R.2" "HSM*"hsm,"__ " v' " S#X "CH~" S *"J& HH & )& S#X& CH~ &  & R $ $$588//;V$b,,b b bJ..588??.r#