https://github.com/TianyuCodings/EdiVal/blob/master/baseline_generate/qwen_image_edit.py
The current implementation uses a fixed seed across different editing steps for the qwen image edit models. This amplifies the noise from the qwen models. The observation in Appendix G of the paper will not appear if you use different seeds. Please fix this in the repository and the paper.