论文标题

部分可观测时空混沌系统的无模型预测

Improving Diversity with Adversarially Learned Transformations for Domain Generalization

论文作者

Gokhale, Tejas, Anirudh, Rushil, Thiagarajan, Jayaraman J., Kailkhura, Bhavya, Baral, Chitta, Yang, Yezhou

论文摘要

为了在单一源领域的概括中取得成功,最大化合成域的多样性已成为最有效的策略之一。最近的许多成功都来自预先指定模型在训练过程中暴露的多样性类型的方法,因此它最终可以很好地推广到新领域。但是,基于幼稚的多样性增强因素无法对域的概括有效地起作用,因为它们不能对大型域移动进行建模,或者是因为预先指定的变换的跨度不能涵盖域概括中通常发生的转移类型。为了解决这个问题,我们提出了一个新颖的框架,该框架使用神经网络使用对手学习的转换(ALT)来模拟欺骗分类器的合理但硬的图像转换。该网络是为每个批次的随机初始初始初始初始初始初始化的,并培训了固定数量的步骤以最大化分类错误。此外,我们在分类器对清洁图像和转换的图像上的预测之间实现了一致性。通过广泛的经验分析,我们发现,这种新形式的对抗变换同时实现了多样性和硬度的目标,在单一源领域概括方面优于竞争性基准上的所有现有技术。我们还表明,ALT可以自然地与现有的多样性模块合作,从而产生源域的高度不同的变换,从而导致最先进的性能。

To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of diversity that a model is exposed to during training, so that it can ultimately generalize well to new domains. However, naïve diversity based augmentations do not work effectively for domain generalization either because they cannot model large domain shift, or because the span of transforms that are pre-specified do not cover the types of shift commonly occurring in domain generalization. To address this issue, we present a novel framework that uses adversarially learned transformations (ALT) using a neural network to model plausible, yet hard image transformations that fool the classifier. This network is randomly initialized for each batch and trained for a fixed number of steps to maximize classification error. Further, we enforce consistency between the classifier's predictions on the clean and transformed images. With extensive empirical analysis, we find that this new form of adversarial transformations achieve both objectives of diversity and hardness simultaneously, outperforming all existing techniques on competitive benchmarks for single source domain generalization. We also show that ALT can naturally work with existing diversity modules to produce highly distinct, and large transformations of the source domain leading to state-of-the-art performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源