When using SimpleT5, what optimizer will be used? Adafactor or AdamX? Can this be changed?
When using SimpleT5, what optimizer will be used? Adafactor or AdamX? Can this be changed?