2025年昇腾AI创新大赛-昇思模型开发挑战赛（S1赛季)--MultiModal赛题--905队提交#112
Open
SHX112 wants to merge 5 commits intomindspore-lab:devfrom
Open
2025年昇腾AI创新大赛-昇思模型开发挑战赛（S1赛季)--MultiModal赛题--905队提交#112SHX112 wants to merge 5 commits intomindspore-lab:devfrom
SHX112 wants to merge 5 commits intomindspore-lab:devfrom
Conversation
qhzhuang
requested changes
Dec 3, 2025
| @@ -0,0 +1,5 @@ | |||
| 前期曾尝试调换算子api以提升推理性能，发现在精度上和时长上的提升极不明显，最后代码工程的精度无法对齐。 | |||
| @@ -0,0 +1,5 @@ | |||
| 前期曾尝试调换算子api以提升推理性能，发现在精度上和时长上的提升极不明显，最后代码工程的精度无法对齐。 | |||
| 后通过profiler工具，查看到原有的代码中查询特殊token花费的时间非常长. | |||
Collaborator
There was a problem hiding this comment.
写的非常好但是有点简略,可以稍微补充下具体的改动的代码片段. 另外这个优化推荐你也合入到mindspore one代码仓中https://github.com/mindspore-lab/mindone/tree/master/examples/janus/janus.
qhzhuang
approved these changes
Dec 16, 2025
| 后通过profiler工具，查看到原有的代码中查询特殊token花费的时间非常长. | ||
| 查看到源代码中实际的操作为在字典中查询特殊token，尝试重构原有的image_id, image_start_id, image_end_id, 和 pad_id 属性方法。 | ||
| 现在它们直接返回在构造函数中计算好的值，而不是每次调用时都重新查询tokenizer.vocab。 | ||
| 测试结果发现prefill的性能得到极大提升。 No newline at end of file |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
2025年昇腾AI创新大赛-昇思模型开发挑战赛（S1赛季)--multimodal赛题--905队提交Changes
Testing & Benchmark
Checklist
Reviewers