CNN(backbone) + WDRO

[beaumelon]

Can transformer based backbone (i.e., ViT) be applied for training WDRO?

[bisno]

Yes, during training stage, our method substitute the gradient of last hidden layer. You can try ViT by substituting the gradient with the solved gradients.