Thank you very much for your efforts to bring local translation to android! On paper the HY-MT-1.5-1.8b 1.25bit sounds revolutionary and I couldn't wait to try it!
However, I and other users do not seem to be getting the same translation quality and speed results as those stated in your benchmarks. Translation speed is quite slow, around five to ten seconds on this example prompt (Image One), and the translation quality seems to be worse than general models such as Gemma-4b-E2B-it (which has slightly better but still incorrect translations). Furthermore, when I tried to run the prompt myself on the demo app I received Chinese rather than English output as desired (Image Two).
Prompt: 星期五有哪些人要甜點嗎? 豆花, 愛玉, 仙草跟奶酪都三罐 一百
A good translation: Does anyone want dessert on Friday? Tofu pudding, aiyu jelly, grass jelly, and milk pudding are all 3 jars for 100
Image One:
Image Two:
Thank you very much for your efforts to bring local translation to android! On paper the HY-MT-1.5-1.8b 1.25bit sounds revolutionary and I couldn't wait to try it!
However, I and other users do not seem to be getting the same translation quality and speed results as those stated in your benchmarks. Translation speed is quite slow, around five to ten seconds on this example prompt (Image One), and the translation quality seems to be worse than general models such as Gemma-4b-E2B-it (which has slightly better but still incorrect translations). Furthermore, when I tried to run the prompt myself on the demo app I received Chinese rather than English output as desired (Image Two).
Prompt: 星期五有哪些人要甜點嗎? 豆花, 愛玉, 仙草跟奶酪都三罐 一百
A good translation: Does anyone want dessert on Friday? Tofu pudding, aiyu jelly, grass jelly, and milk pudding are all 3 jars for 100
Image One:
Image Two: