2024-11-15 01:49:23.288 | INFO | main:main:623 - -== Testcase llama3_8b_mmlu:pytorch_2.1 finished ==-
2024-11-15 01:49:23.288 | INFO | main:main:624 - === 2.2 Setup container and run testcases finished. ===
2024-11-15 01:49:23.288 | INFO | main:main:626 - === 2.3 Compilation Case Performance ===
2024-11-15 01:49:23.288 | ERROR | main:compilation_result:450 - Case Run Failed, Please Check Log!
[root@localhost inference]# cat /root/FlagPerf/inference/result/run20241115014707/llama3_8b_mmlu:pytorch_2.1/127.0.0.1_noderank0/stdout_er
2024-11-15 06:48:54.179 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_mode
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_dynamic
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_wamrup_iters
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_wamrup_times
2024-11-15 06:48:55.002 | Init Begin | main:main:26 - building dataloader and model
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-11-15 01:49:23.288 | INFO | main:main:623 - -== Testcase llama3_8b_mmlu:pytorch_2.1 finished ==-
2024-11-15 01:49:23.288 | INFO | main:main:624 - === 2.2 Setup container and run testcases finished. ===
2024-11-15 01:49:23.288 | INFO | main:main:626 - === 2.3 Compilation Case Performance ===
2024-11-15 01:49:23.288 | ERROR | main:compilation_result:450 - Case Run Failed, Please Check Log!
[root@localhost inference]# cat /root/FlagPerf/inference/result/run20241115014707/llama3_8b_mmlu:pytorch_2.1/127.0.0.1_noderank0/stdout_er
2024-11-15 06:48:54.179 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_mode
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_dynamic
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_wamrup_iters
2024-11-15 06:48:54.180 | WARNING | tools.config_manager:merge_vendor:18 - New Config Set by nvidia: dynamo_wamrup_times
2024-11-15 06:48:55.002 | Init Begin | main:main:26 - building dataloader and model
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.