g^(h1ddlZddlZddlmZmZmZmZddlZddlm Z ddl m Z eje ZGddZGddZGd d eZGd d ZeZd Zdej*defdZdej*deeej*ffdZd deefdZdZdefdZdeefdZdedefdZdedefdZdede eeffdZ!dej*defdZ"dZ#defdZ$y)!N)AnyOptionalProtocolUnionparse_namespace_disable_current_modesc4eZdZdededej fdZy)FakeScriptObject wrapped_objscript_class_namexc||_||_ t5tj||_dddy#1swYyxYw#t $r tjd|||_YywxYw)NzUnable to deepcopy the custom object %s. Defaulting to the user given object. This might be dangerous as side effects may be directly applied to the object.) r rr copydeepcopyreal_obj RuntimeErrorlogwarning)selfr rrs `/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/torch/_library/fake_class_registry.py__init__zFakeScriptObject.__init__sq&"3 ') 1 $ a 0  1 1 1  KK!"  DM s+ A >A AA A &A32A3N)__name__ __module__ __qualname__rstrtorch ScriptObjectrrr r s"CCEDVDVr!r c@eZdZdededeejfdZdZ y)FakeScriptMethod self_fake_obj method_nameschemac.||_||_||_yN)r$r%r&)rr$r%r&s rrzFakeScriptMethod.__init__#s +& r!cPddlm}||j|jg|i|S)Nr)call_torchbind)!torch._higher_order_ops.torchbindr*r$r%)rargskwargsr*s r__call__zFakeScriptMethod.__call__-s(Dd00$2B2BTTTVTTr!N) rrrr rrrFunctionSchemarr.r r!rr#r#"s4'--. Ur!r#c6eZdZedej fdZy)HasStaticMethodFromRealrcyr(r )clsrs r from_realz!HasStaticMethodFromReal.from_real4s r!N)rrr classmethodrrr4r r!rr1r13s! !3!3  r!r1cneZdZd dZdedefdZdedefdZd deddfdZ dedefdZ d d Z deddfd Z y) FakeClassRegistryreturnNci|_yr(_registered_classrs rrzFakeClassRegistry.__init__:s 13r! full_qualnamec||jvSr(r:rr=s rhas_implzFakeClassRegistry.has_impl=s 6 666r!cB|j||j|Sr()_check_registeredr;r?s rget_implzFakeClassRegistry.get_impl@s! }-%%m44r!cr|j|rtjd||||j|<y)NzE%s is already registered. Previous fake class is overridden with %s.)r@rrr;)rr= fake_classs rregisterzFakeClassRegistry.registerDs5 == ' KKW  1;}-r!c|j|stjd|y|jj |S)NziCannot deregister %s. Please use register_fake_class to register it first. Or do you dereigster it twice?)r@rrr;popr?s r deregisterzFakeClassRegistry.deregisterMs;}}]+ KK2  ))--m< >   M :!..:J9KLM  >> v %%r!c ddlmcm}ddlm}t |r|S|5|j }dddt|jtjfd|}t|j|}t||jj|}|j!D]}t#||d} | rjt%| st'd|d| dt#||} d} t)| tj*r | j,} t/||t1||| |hd} || vst2j5d|||S#1swY,xYw) Nrr c&j|Sr() from_tensor)t fake_modes rz#maybe_to_fake_obj..s)''*r!zExpect z to be a callable but got .> __get_state__ __set_state____obj_flatten__z.fake object of %s doesn't implement method %s.)torch.utils._pytreeutils_pytreetorch.utils._python_dispatchr r[rerU tree_map_onlyrTensor"_find_fake_class_for_script_object__obj_unflatten__r _typequalified_name _method_namesgetattrcallablerrP ScriptMethodr&setattrr#rr) r`rpytreer rSfake_flattenedfake_xfake_x_wrappednameattr real_attr method_schemaoverride_skip_lists ` rmaybe_to_fake_objr~~se)(C !%""$%!()) *N 0 2 D D^ TF%faggi.F.F.H!LN!WvtT* D>"WTF2LTFRS#TUU4(I=AM)U%7%78 ) 0 0  }E  "W -- LaQUV+W, K%%s E  E*rEc4dtffd }||S||S)a Register a fake implementation for this class. It's in the same spirit of registering a fake implementation for an operator but with the difference that it associates a fake class with the original torch bind class (registered with torch::class_). In this way, torch.compile can handle them properly in components such as Dynamo and AOTAutograd. This API may be used as a decorator (see example). For the fake class, users are required to provide a from_real classmethod that takes a real object and returns an instance of the fake class. All tensors in the fake object should also be properly fakified with to_fake_tensor() in from_real. Examples: # For a custom class Foo defined in test_custom_class_registration.cpp: TORCH_LIBRARY(_TorchScriptTesting, m) { m.class_("_TensorQueue") .def(torch::init()) .def("push", &TensorQueue::push) .def("pop", &TensorQueue::pop) .def("top", &TensorQueue::top) .def("size", &TensorQueue::size) .def("clone_queue", &TensorQueue::clone_queue) .def("__obj_flatten__", &TensorQueue::__obj_flatten__) .def_pickle( // __getstate__ [](const c10::intrusive_ptr& self) -> c10::Dict { return self->serialize(); }, // __setstate__ [](c10::Dict data) -> c10::intrusive_ptr { return c10::make_intrusive(std::move(data)); }); }; # We could register a fake class FakeTensorQueue in Python as follows: import torch @torch._library.register_fake_class("_TorchScriptTesting::_TensorQueue") class FakeTensorQueue: def __init__(self, queue): self.queue = queue @classmethod def __obj_unflatten__(cls, flattened_ctx): return cls(**dict(ctx)) def push(self, x): self.queue.append(x) def pop(self): return self.queue.pop(0) def size(self): return len(self.queue) In this example, the original TensorQeue need to addd a __obj_flatten__ method to the class TensorQueue and the flattend result is passed into FakeTensorQueue's __obj_unflatten__ as inputs to create a fake class. This protocol allows pytorch to look at the contents of the script object and properly handle them in the subsystems like dynamo, aot_aotugrad or more. rEcXt\}}tjj||t |t d}|st |dt dt|jt tst t dtjt||S)Nz doesn't define a classmethod rbz method is not a classmethod.) rr_C _get_custom_class_python_wrapperrq_CONVERT_FROM_REAL_NAMErrP__dict__r5global_fake_class_registryrF_full_qual_class_name)rEnsry from_methodqualnames rinnerz"register_fake_class..inners"8,D 11"d;j*A4H ,<=Ttjt|Sr()rrIr)rs rderegister_fake_classrs % 0 01Fx1P QQr!c,tj|Sr()rr@r=s rhas_fake_classrs % . .} ==r!cDt|sytj|Sr()rrrCrs rfind_fake_classrs - ( % . .} ==r!rc4t|\}}d|zdz|zS)Nz__torch__.torch.classes.rbr)rrrys rrrs%x(HB % *S 04 77r!objct|tjxr-|jj j dS)Nz__torch__.torch.classes)rPrrrnro startswith)rs r_is_script_objectr$s?  U     ))+ $ $ & 1 1! r!r=cl|jd}t|dk(s Jd||\}}}}}||fS)NrbzCould not split full_qualname=)splitrR)r=splits_torch _torch_ns_classesr class_names r_ns_and_class_namer-sL   %F v;! @> /?@@ 28/FIxZ z>r!c |jj}t|\}}t|}|t d|d|d|dt d |S)Nz ScriptObject's zA haven't registered a fake class. Please use register_fake_class(z::a) to annotate a fake class for the script obj. Specifically, create a python class that implements a fake version for all the methods that're used in the program and put annotated class in the program e.g. after loading the library. The fake methods can be written in the same way as a meta kernel for an operator but need to additionally simulate the object's states. Be sure to add a z; classmethod to enable creating a fake obj from a real one.)rnrorrrr)rr=rrrEs rrlrl4s{GGI,,.M' 6NB  /J}o.//1d"ZLA?@W>WX>  ?   r!rmcdt|}t|td}|st|dtdtj j j|dtj j jfd5|j|cdddS#1swYyxYw)Nz must define a classmethod z2 that converts the real object to the fake object.cSr(r )ctxsrraz%_fake_obj_from_real..Tsr!) rlrqrrr_library fake_impl FakeImplCtxset_ctx_getterr4)r`rrEfrom_real_methodrs @r_fake_obj_from_realrHs3A6Jz+BDI l56M5N@ B  .. " " . .y$ ?C  ! ! 0 0 ='##A&'''s B&&B/r()%rloggingtypingrrrrrtorch._library.utilsrrir getLoggerrrr r#r1r7rrUrrMr[r~rrrrrrrrQrrlrrr r!rrsV 11 0?g!(UU" h %%P/0 &++&&4$$4 U// /04nYh7N.OYxR>T>>hsm> 8C8C8 34ceCHo%*<*<". ' 'r!