offload.py

[tmpHero]

mmgp
Version: 3.6.8

In the fast_load_transformers_model function in offload.py, when modelClass is None and "_class_name" is in transformer_config, class_name should be hardcoded as "Transformer3DModel" instead of transformer_config["_class_name"] or transformer_config.get("_class_name").

[deepbeepmeep]

I dont understand why we should ignore the class_name if it is the transfomer_config. it would make sense to default to Transformer3DModel only if no classname is provided.

[tmpHero]

I dont understand why we should ignore the class_name if it is the transfomer_config. it would make sense to default to Transformer3DModel only if no classname is provided.

Thank you for your reply.
I apologize, it might be a problem with my translation. What I meant was...

elif "_class_name" in transformer_config:
      # class_name  = 'Transformer3DModel'
      class_name = transformer_config["_class_name"]

In line 1416 of offload.py, if modelClass is not specified, shouldn't it read transformer_config["_class_name"] if "_class_name" is present in transformer_config? Using "Transformer3DModel" directly seems incorrect within the condition "_class_name" in transformer_config.