Support swa mha #18603

Job	Run time
FD-Clone-Linux / check_bypass / Check bypass	13s
FD-Clone-Linux / code-clone	50s
FD-Build-Linux / check_bypass / Check bypass	13s
FD-Build-Linux / fd-build	5m 34s
Use Build Output	9s
Run FastDeploy Unit Tests and Coverage / check_cov_skip / Check bypass	14s
Run Base Tests / check_bypass / Check bypass	13s
Extracted partial CE model tasks to run in CI. / check_bypass / Check bypass	12s
Run Stable Tests / check_bypass / Check bypass	13s
Run Four Cards Tests / check_bypass / Check bypass	12s
Run FastDeploy LogProb Tests / check_bypass / Check bypass	12s
Extracted partial CE model tasks to run in CI. / run_ce_cases	25m 29s
Run Base Tests / base_tests	12m 40s
Run Stable Tests / stable_tests	4m 24s
Run FastDeploy Unit Tests and Coverage / run_tests_with_coverage	1h 29m 30s
Run Four Cards Tests / run_4_cards_tests	13m 47s
Run FastDeploy LogProb Tests / run_tests_logprob	2m 14s
Run FastDeploy Unit Tests and Coverage / diff_coverage_report	29s
	2h 36m 48s

Provide feedback