f^(h#lddlZddlZddlmZddlmZddlmZddlm Z ddl m Z GddeZ d Zy) N)FakeTensorProp)CapabilityBasedPartitioner)OperatorSupport)CALLABLE_NODE_OPS)_pytreecDeZdZdejj defdZy)CudaGraphsSupportnodereturnc|jtvry|jtjj j jfvry|jtjfvrydd}fd}|jD](}tj|||j*tj|||j S)NFTcd|vr|dS|dS)Nval fake_result)metas a/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/torch/fx/passes/backends/cudagraphs.pymeta_fkz4CudaGraphsSupport.is_node_supported..meta_fks"'4-4; HT-5H Hctt|tjr|jjdk7rdyyy)NcudaT) isinstancetorchTensordevicetype)tfound_not_cudas r find_not_cudaz:CudaGraphsSupport.is_node_supported..find_not_cudas.!U\\*qxx}}/F!%0G*r)oprtargetropsatenembedding_dense_backwarddefaultoperatorgetitemall_input_nodespytree tree_map_r)self submodulesr rrnrs @ris_node_supportedz#CudaGraphsSupport.is_node_supporteds 77+ + ;;599>>BBJJK K ;;8++, , I & %% =A   ]GAFFO < =  (:; "!!rN)__name__ __module__ __qualname__rfxNodeboolr-rrrr r s"%((--"D"rr ct|j|t}t||d}|j }|j |}|S)z Partition an FX graph into sub-GraphModules that can be validly run under CUDA graphs. For a subgraph to be runnable under CUDA, all of the operations must involve CUDA tensors only/ T)allows_single_node_partition)r propagater rpropose_partitionsfuse_partitions)gminputs supported_ops partitioner partitions fused_graphs rpartition_cudagraphsr?-sZ!N2  &)%'M- MK//1J--j9K r)r%r torch.fx.passes.fake_tensor_propr!torch.fx.passes.infra.partitionerr torch.fx.passes.operator_supportrtorch.fx.passes.tools_commonr torch.utilsrr(r r?rrrrEs, ;H<:)""Br