g^(hdZddlZddlmZddlmZddlmZmZ dejde fdZ dejde e ee ejffdZdejde efd Zdejde fd Zy) z NOTE: This file must be imported like ``import torch.distributed.fsdp._traversal_utils`` and not like ``from torch.distirbuted.fsdp._traversal_utils import ...`` to avoid circular imports. For brevity, we may import the file as ``traversal_utils``. N _get_registry) _FSDPState_get_module_fsdp_statemodulereturnc&t|}|yd|vS)zA Returns if ``module`` can compose with ``fully_shard``. T replicater)rregistrys e/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/torch/distributed/fsdp/_traversal_utils.py _composabler "s" V$H h &&cg}g}t}t}tj|g}|r|j}|j |t |s/t t|jD]}||vs|j|t|}|7||vr3|j ||j||j||r||fS)a Returns a tuple containing: 1. A list of the ``_FSDPState`` instances in the module tree rooted at ``module`` without any duplicates and following the ``module.modules()`` traversal order (which is assumed to be depth-first). 2. A corresponding list of the modules owning the states in the first list. For the wrapper code path, both returned lists are the same, each containing all ``FullyShardedDataParallel`` instances. For the composable code path, this returns a list of all composable state instances and a list of the corresponding fully sharded modules. See [Note: Fully Sharded Module]. NOTE: The traversal does not proceed into any module annotated by an incompatible API (e.g. ``replicate``). ) set collectionsdequepopleftaddr reversedlistchildren appendleftrappend) r fsdp_states fsdp_modulesvisited_fsdp_statesvisited_modulesr submodule child_moduleoptional_states r _get_fsdp_states_with_modulesr!0s&%'K$&L,/5'*eO +6*;*;VH*EE MMO I&9% $T)*<*<*>%?@ /L?2  . /0 :  %.@S*S  # #N 3   ~ .    *   $$rc"t|\}}|S)z*See :func:`_get_fsdp_states_with_modules`.)r!)rr_s r _get_fsdp_statesr$`s26:NK rclt|Dcgc]}|j |j}}|Scc}w)z Returns all ``FlatParamHandle`` s in the module tree rooted at ``module`` following the rules in :func:`_get_fsdp_state`. )r$_handle)r fsdp_statehandless r _get_fsdp_handlesr)fsD+62     ) G N s1)__doc__rtorch.nnnn&torch.distributed._composable.contractr$torch.distributed.fsdp._common_utilsrrModuleboolr tuplerr!r$r)rr r3s@S&' 'd'-% II-% 4 T"))_ ,--%`RYY4 +; bii D r