Failed to import transformers.modeling_utils because of the following error

[Mike-ihr]

when I run the generate.py, I meet with the following bug.

Traceback (most recent call last):
File "/media/ubuntu/data/jixin/cobra/scripts/generate.py", line 19, in
from cobra.models import load
File "/media/ubuntu/data/jixin/cobra/cobra/init.py", line 1, in
from .models import available_model_names, available_models, get_model_description, load
File "/media/ubuntu/data/jixin/cobra/cobra/models/init.py", line 1, in
from .load import available_model_names, available_models, get_model_description, load
File "/media/ubuntu/data/jixin/cobra/cobra/models/load.py", line 14, in
from cobra.models.materialize import get_llm_backbone_and_tokenizer, get_vision_backbone_and_transform
File "/media/ubuntu/data/jixin/cobra/cobra/models/materialize.py", line 11, in
from cobra.models.backbones.llm import LLMBackbone, MambaLLMBackbone
File "/media/ubuntu/data/jixin/cobra/cobra/models/backbones/llm/init.py", line 1, in
from .base_llm import LLMBackbone
File "/media/ubuntu/data/jixin/cobra/cobra/models/backbones/llm/base_llm.py", line 22, in
from transformers import AutoConfig, AutoTokenizer, PreTrainedModel, PreTrainedTokenizerBase
File "", line 1075, in _handle_fromlist
File "/media/ubuntu/data/jixin/anaconda3/envs/cobra/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1272, in getattr
module = self._get_module(self._class_to_module[name])
File "/media/ubuntu/data/jixin/anaconda3/envs/cobra/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1284, in _get_module
raise RuntimeError(
RuntimeError: Failed to import transformers.modeling_utils because of the following error (look up to see its traceback):
Failed to import transformers.generation.utils because of the following error (look up to see its traceback):
cannot import name 'split_torch_state_dict_into_shards' from 'huggingface_hub' (/media/ubuntu/data/jixin/anaconda3/envs/cobra/lib/python3.10/site-packages/huggingface_hub/init.py)

And my pip list is:
accelerate 0.32.1
attrs 24.2.0
causal-conv1d 1.4.0
certifi 2024.8.30
charset-normalizer 3.3.2
click 8.1.7
cobra-vlm 0.0.1 /media/ubuntu/data/jixin/cobra
docker-pycreds 0.4.0
draccus 0.8.0
einops 0.8.0
filelock 3.16.0
fsspec 2024.9.0
gitdb 4.0.11
GitPython 3.1.43
huggingface-hub 0.17.3
idna 3.8
Jinja2 3.1.4
jsonlines 4.0.0
mamba-ssm 1.2.2
markdown-it-py 3.0.0
MarkupSafe 2.1.5
mdurl 0.1.2
mergedeep 1.3.4
mpmath 1.3.0
mypy-extensions 1.0.0
networkx 3.3
ninja 1.11.1.1
numpy 1.26.4
nvidia-cublas-cu12 12.1.3.1
nvidia-cuda-cupti-cu12 12.1.105
nvidia-cuda-nvrtc-cu12 12.1.105
nvidia-cuda-runtime-cu12 12.1.105
nvidia-cudnn-cu12 8.9.2.26
nvidia-cufft-cu12 11.0.2.54
nvidia-curand-cu12 10.3.2.106
nvidia-cusolver-cu12 11.4.5.107
nvidia-cusparse-cu12 12.1.0.106
nvidia-nccl-cu12 2.18.1
nvidia-nvjitlink-cu12 12.6.68
nvidia-nvtx-cu12 12.1.105
packaging 24.1
pillow 10.4.0
pip 24.2
platformdirs 4.3.2
protobuf 5.28.0
psutil 6.0.0
Pygments 2.18.0
PyYAML 6.0.2
pyyaml-include 1.4.1
regex 2024.7.24
requests 2.32.3
rich 13.8.0
safetensors 0.4.5
sentry-sdk 2.14.0
setproctitle 1.3.3
setuptools 72.1.0
six 1.16.0
smmap 5.0.1
sympy 1.13.2
timm 0.9.10
tokenizers 0.14.1
toml 0.10.2
torch 2.1.0
torchaudio 2.1.0
torchvision 0.16.0
tqdm 4.66.5
transformers 4.34.1
triton 2.1.0
typing_extensions 4.12.2
typing-inspect 0.9.0
urllib3 2.2.2
wandb 0.17.9
wheel 0.43.0