Add new engine for MoE using Expert&Tokens parallelism#530

abenmao wants to merge 1 commit intointel:mainintel/xFasterTransformer:mainfrom

abenmao:perf/moe/engine2abenmao/xFasterTransformer:perf/moe/engine2Copy head branch name to clipboard