Skip to content

llama3_8b_mmlu:pytorch_2.1 推理测试失败 #766

@RockGo

Description

@RockGo

2024-11-15 01:49:23.288 | INFO | main:main:623 - -== Testcase llama3_8b_mmlu:pytorch_2.1 finished ==-
2024-11-15 01:49:23.288 | INFO | main:main:624 - === 2.2 Setup container and run testcases finished. ===
2024-11-15 01:49:23.288 | INFO | main:main:626 - === 2.3 Compilation Case Performance ===
2024-11-15 01:49:23.288 | ERROR | main:compilation_result:450 - Case Run Failed, Please Check Log!
[root@localhost inference]# cat /root/FlagPerf/inference/result/run20241115014707/llama3_8b_mmlu:pytorch_2.1/127.0.0.1_noderank0/stdout_er
2024-11-15 06:48:54.179 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_mode
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_dynamic
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_wamrup_iters
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_wamrup_times
2024-11-15 06:48:55.002 | Init Begin | main:main:26 - building dataloader and model
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions