Skip to content

2025年昇腾AI创新大赛-昇思模型开发挑战赛(S1赛季)--MoE赛题--HUST_ASCEND队提交#108

Open
Mr-Xiao2021 wants to merge 4 commits intomindspore-lab:devfrom
Mr-Xiao2021:dev
Open

2025年昇腾AI创新大赛-昇思模型开发挑战赛(S1赛季)--MoE赛题--HUST_ASCEND队提交#108
Mr-Xiao2021 wants to merge 4 commits intomindspore-lab:devfrom
Mr-Xiao2021:dev

Conversation

@Mr-Xiao2021
Copy link
Copy Markdown

Description

2025年昇腾AI创新大赛-昇思模型开发挑战赛(S1赛季)--MoE赛题--HUST_ASCEND队提交

Changes

Testing & Benchmark

Checklist

  • Read and followed the Contributing Guidelines.
  • Self-tested locally to ensure the code runs correctly and achieves expected results (all CI checks expected to pass).
  • Updated documentation if needed.
  • Verified accuracy or performance benchmarks if applicable.

Reviewers

@@ -0,0 +1,144 @@
# MoE模型昇腾迁移优化技术报告
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


### 1. MindSpore算子适配优化

#### 1.1 使用mint算子替代ops算子
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

下面的代码是用ops.split代替切片,不是用mint替代ops, 可以补充下原来的代码作为对比

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

### Prefill阶段优化

| 优化项 | 技术手段 | 预估收益 |
|-------|---------|---------|
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

你这里的预估收益是指的在基线上提升40%吗? 你已经做了优化, 这里不应该是预估收益

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants