f^(hddlZddlZddlZddlmZddlmZddlmZdejde ejde ejdffd Z dd ed ed e fd Zde efdZdej j"fdZy)N)symbolic_trace)Node)legalize_graphresultinputsreturn.ct|tjjrdgt |z}n|Dcgc]}|j d}}tj ||Scc}w)a A free function for use in the merge_matmul graph transformation below that splits the output from a merged matmul into the individual results for each input tensor. Arguments: result: The merged matmul result tensor. inputs: The list of inputs that were merged into one for the matmul. Returns: List of matmul results for each input tensor. r) isinstancetorchfxProxylenshapesplit)rrsplitsxs `/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/torch/fx/experimental/merge_matmul.pysplit_result_tensorsr sW"&%((..)s6{"&,-!''!*-- ;;vv &&.sA'ab search_depthc||k(ryt|jdk(ry|dk(ry|jD]}t|||dz syy)a^ Determine if one node depends on another in a torch.fx.Graph. Arguments: a: The node that may have a dependency on b. b: The node that a may have a dependency on. search_depth: In the case of an indirect dependency, this function searches upto this many nodes away in search of a data dependency. If none is found, the function makes the conservative assumption that there is a dependency. Returns: True if a may depend on b, False if it definitely does not. TrF)rall_input_nodes may_depend_on)rrrinps rrr$sc" Av 1  "q   a!1 2 nodescttj|dD]\}}t||s t||syy)z Check if all of the given nodes are pairwise-data independent. Arguments: nodes: The nodes to check for data dependencies. Returns: True if any pair in nodes has a data dependency. FT) itertools combinationsr)rijs rare_nodes_independentr%Is?&&ua01 A -1"5 rin_modc t|}i}i}|jjD]}|jdk7s|jt j ur/|j\}}|jdk(r |jn|}|jdk(r |jn|}|j|gj||j|gj||jD]\}}t|dkrt|s"|Dcgc]}|jd} }| D cgc]/} t| tr|jj| n| 1}} t|tr|jj|n|}|jj!t j"|fi} |jj!t j | |fi} |jj!t$| |fi} t't|Dcgc]/}|jj!t(j*| |fi1}}t-||D]1\}}|j/||jj1|3t3||j5|jj7|Scc}wcc} wcc}w)a A graph transformation that merges matrix multiplication operations that share the same right-hand side operand into one large matrix multiplication. ____ _________ _________ ---- | | | | M| A * C | M| A | T| B | * K| C | = |---------| ---- , | | | | T| B * C | K ---- --------- --------- K R R call_functionget_attrr r)rgraphroptargetr matmulargs setdefaultappenditemsrr%r strr)r(catrrangeoperatorgetitemzipreplace_all_uses_with erase_noder recompilelint)r&gm rhs_users lhs_usersnodelhsrhsmmsmmlhs_valsl merge_mm_catmerge_mmmerge_mm_splitout merge_mm_resoldnews r merge_matmulrM[s  B(*I(*I 3 77o %ELL)H 99S  FFj0cjjcFFj0cjjcS"%,,T2S"%,,T2 3OO%1S s8a< %S) ),-2BGGAJ--KSSQz!S'9rxx  #q@SS(23(rYs 37' LL'"&u||"4' 5<< '2"T"d"#"Jd$VVr