S^(hr@ddlmZddlmZddlmZerddlmZddZy) ) annotations) TYPE_CHECKING)is_torch_available)nnctsyddl}|jjsyddl}t ||jj jxs t|ddS)NFr_is_fsdp_managed_module) rtorch distributed is_availabletorch.distributed.fsdp isinstancefsdpFullyShardedDataParallelgetattr)moduler s \/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/transformers/integrations/fsdp.pyis_fsdp_managed_modulers]      ) ) +! fe//44MM N RY)5SN)rz nn.Modulereturnbool) __future__rtypingrutilsrr rrrrrs# & r