# Domain-generalization **Repository Path**: lilujunai/Domain-generalization ## Basic Information - **Project Name**: Domain-generalization - **Description**: All about domain generalization - **Primary Language**: Unknown - **License**: MIT - **Default Branch**: master - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2020-08-22 - **Last Updated**: 2021-03-18 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # Domain generalization [![MIT License](https://img.shields.io/badge/license-MIT-green.svg)](https://opensource.org/licenses/MIT) ----- ## Table of contents * [Research papers](#Research-papers) * [Pathfinder](#Pathfinder) * [arXiv](#arXiv) * [Computer vision venues](#Computer-vision-venues) * [Machine learning venues](#Machine-learning-venues) * [DG variants](#DG-variants) * [Datasets](#Datasets) * [References](#References) * [Contact](#Contact) * [License](#License) ----- ## Research papers ### Pathfinder - [Generalizing from several related classification tasks to a new unlabeled sample](http://papers.nips.cc/paper/4312-generalizing-from-several-related-classification-tasks-to-a-new-unlabeled-sample.pdf) Blanchard, Gilles, Gyemin Lee, and Clayton Scott. *Advances in neural information processing systems.* (**NIPS**) 2011. ### arXiv - (**CSD**) [Efficient Domain Generalization via Common-Specific Low-Rank Decomposition](https://arxiv.org/abs/2003.12815) Vihari Piratla, Praneeth Netrapalli, Sunita Sarawagi *arXiv preprint arXiv:2003.12815* (2020). [[code]](https://github.com/vihari/CSD) - [Adversarial target-invariant representation learning for domain generalization](https://arxiv.org/abs/1911.00804) Isabela Albuquerque, João Monteiro, Mohammad Darvishi, Tiago H. Falk, Ioannis Mitliagkas *arXiv preprint arXiv:1911.00804* (2019). [[code]](https://github.com/belaalb/TI-DG) - [DIVA: Domain Invariant Variational Autoencoders](https://arxiv.org/abs/1905.10427) Maximilian Ilse, Jakub M. Tomczak, Christos Louizos, Max Welling *arXiv preprint arXiv:1905.10427* (2019). [[code]](https://github.com/AMLab-Amsterdam/DIVA) - [Invariant Risk Minimization](https://arxiv.org/abs/1907.02893) Arjovsky, Martin and Bottou, Leon and Gulrajani, Ishaan and Lopez-Paz, David. *arXiv preprint arXiv:1907.02893* (2019). [[code]](https://github.com/facebookresearch/InvariantRiskMinimization) - [A Generalization Error Bound for Multi-class Domain Generalization](https://arxiv.org/abs/1905.10392) Deshmukh, Aniket Anand, Yunwen Lei, Srinagesh Sharma, Urun Dogan, James W. Cutler, and Clayton Scott. *arXiv preprint arXiv:1905.10392* (2019). [[code]](https://www.dropbox.com/sh/bls758ro5762mtf/AACbn3UXJItY9uwtmCAdi7E3a?dl=0) - [Domain generalization by marginal transfer learning](https://arxiv.org/abs/1711.07910) Blanchard, Gilles, Aniket Anand Deshmukh, Urun Dogan, Gyemin Lee, and Clayton Scott. *arXiv preprint arXiv:1711.07910* (2017). [[code]](https://github.com/aniketde/DomainGeneralizationMarginal) ### Computer vision venues #### Autoencoder-based methods - (**MMD-AAE**) [Domain generalization with adversarial feature learning](http://openaccess.thecvf.com/content_cvpr_2018/CameraReady/2932.pdf) Li, Haoliang, Sinno Jialin Pan, Shiqi Wang, and Alex C. Kot. *Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition* (**CVPR**) 2018. - (**MTAE**) [Domain generalization for object recognition with multi-task autoencoders](https://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Ghifary_Domain_Generalization_for_ICCV_2015_paper.pdf) Ghifary, Muhammad, W. Bastiaan Kleijn, Mengjie Zhang, and David Balduzzi. *Proceedings of the IEEE International Conference on Computer Vision* (**ICCV**) 2015. [[code]](https://github.com/ghif/mtae) #### Deep neural network-based methods - (**Epi-FCR**) [Episodic Training for Domain Generalization](https://arxiv.org/abs/1902.00113) Li, Da, Jianshu Zhang, Yongxin Yang, Cong Liu, Yi-Zhe Song, and Timothy M. Hospedales. *Proceedings of the IEEE International Conference on Computer Vision* (**ICCV**) 2019. [[code]](https://github.com/HAHA-DL/Episodic-DG) - (**JiGen**) [Domain Generalization by Solving Jigsaw Puzzles](https://arxiv.org/abs/1903.06864) Carlucci, Fabio Maria, Antonio D'Innocente, Silvia Bucci, Barbara Caputo, and Tatiana Tommasi. *Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition* (**CVPR**) 2019. [[code]](https://github.com/fmcarlucci/JigenDG) - (**CIDDG**) [Deep Domain Generalization via Conditional Invariant Adversarial Networks](http://openaccess.thecvf.com/content_ECCV_2018/papers/Ya_Li_Deep_Domain_Generalization_ECCV_2018_paper.pdf) Li, Ya, Xinmei Tian, Mingming Gong, Yajing Liu, Tongliang Liu, Kun Zhang, and Dacheng Tao. *Proceedings of the European Conference on Computer Vision* (**ECCV**) 2018. - [Deep Domain Generalization With Structured Low-Rank Constraint](https://ieeexplore.ieee.org/document/8053784) Ding, Zhengming, and Yun Fu. *IEEE Transactions on Image Processing* (**TIP**) 27.1 (2017): 304-313. - (**CCSA**) [Unified deep supervised domain adaptation and generalization](http://openaccess.thecvf.com/content_ICCV_2017/papers/Motiian_Unified_Deep_Supervised_ICCV_2017_paper.pdf) Motiian, Saeid, Marco Piccirilli, Donald A. Adjeroh, and Gianfranco Doretto. *Proceedings of the IEEE International Conference on Computer Vision* (**ICCV**) 2017. [[code]](https://github.com/samotiian/CCSA) - [Deeper, broader and artier domain generalization](https://ieeexplore.ieee.org/abstract/document/8237853) Li, Da, Yongxin Yang, Yi-Zhe Song, and Timothy M. Hospedales. *Proceedings of the IEEE International Conference on Computer Vision* (**ICCV**) 2017. [[code]](http://www.eecs.qmul.ac.uk/~dl307/project_iccv2017) #### Metric learning-based methods - (**UML**) [Unbiased metric learning: On the utilization of multiple datasets and web images for softening bias](https://www.cv-foundation.org/openaccess/content_iccv_2013/papers/Fang_Unbiased_Metric_Learning_2013_ICCV_paper.pdf) Fang, Chen, Ye Xu, and Daniel N. Rockmore. *Proceedings of the IEEE International Conference on Computer Vision* (**ICCV**) 2013. #### Support vector machine (SVM)-based methods - (**MVDG**) [Multi-view domain generalization for visual recognition](https://ieeexplore.ieee.org/document/7410834) Niu, Li, Wen Li, and Dong Xu. *Proceedings of the IEEE International Conference on Computer Vision* (**ICCV**) 2015. - (**LRE-SVM**) [Exploiting low-rank structure from latent domains for domain generalization](https://link.springer.com/chapter/10.1007/978-3-319-10578-9_41) Xu, Zheng, Wen Li, Li Niu, and Dong Xu. *European Conference on Computer Vision* (**ECCV**) 2014. [[code]](http://www.vision.ee.ethz.ch/~liwenw/papers/Xu_ECCV2014_codes.zip) - (**Undo-Bias**) [Undoing the damage of dataset bias](https://link.springer.com/chapter/10.1007/978-3-642-33718-5_12) Khosla, Aditya, Tinghui Zhou, Tomasz Malisiewicz, Alexei A. Efros, and Antonio Torralba. *European Conference on Computer Vision* (**ECCV**) 2012. [[code]](https://github.com/adikhosla/undoing-bias/archive/master.zip) ### Machine learning venues #### Neural network-based methods - (**MASF**) [Domain Generalization via Model-Agnostic Learning of Semantic Features.](https://arxiv.org/abs/1910.13580) Qi Dou, Daniel C. Castro, Konstantinos Kamnitsas, and Ben Glocker. *Advances in Neural Information Processing Systems* (**NeurIPS**) 2019. [[code]](https://github.com/biomedia-mira/masf) - (**CAADA**) [Correlation-aware Adversarial Domain Adaptation and Generalization](https://www.sciencedirect.com/science/article/pii/S003132031930425X) Rahman, Mohammad Mahfujur, Clinton Fookes, Mahsa Baktashmotlagh, and Sridha Sridharan. *Pattern Recognition* (2019): 107124. - (**CROSSGRAD**) [Generalizing Across Domains via Cross-Gradient Training](https://openreview.net/pdf?id=r1Dx7fbCW) Shankar, Shiv, Vihari Piratla, Soumen Chakrabarti, Siddhartha Chaudhuri, Preethi Jyothi, and Sunita Sarawagi. *International Conference on Learning Representations* (**ICLR**) 2018. - (**MetaReg**) [MetaReg: Towards Domain Generalization using Meta-Regularization](http://papers.nips.cc/paper/7378-metareg-towards-domain-generalization-using-meta-regularization.pdf) Balaji, Yogesh, Swami Sankaranarayanan, and Rama Chellappa. *Advances in Neural Information Processing Systems* (**NeurIPS**) 2018. - (**MLDG**) [Learning to generalize: Meta-learning for domain generalization](https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/viewFile/16595/16558) Li, Da, Yongxin Yang, Yi-Zhe Song, and Timothy M. Hospedales. *AAAI Conference on Artificial Intelligence* (**AAAI**) 2018. [[code]](https://github.com/HAHA-DL/MLDG) #### Kernel-based methods - (**MDA**) [Domain Generalization via Multidomain Discriminant Analysis](http://auai.org/uai2019/proceedings/papers/101.pdf) Hu, Shoubo, Kun Zhang, Zhitang Chen, Laiwan Chan. *Conference on Uncertainty in Artificial Intelligence* (**UAI**) 2019. [[code]](https://github.com/amber0309/Multidomain-Discriminant-Analysis) - (**CIDG**) [Domain Generalization via Conditional Invariant Representation](https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/viewFile/16595/16558) Li, Ya, Mingming Gong, Xinmei Tian, Tongliang Liu, and Dacheng Tao. *AAAI Conference on Artificial Intelligence* (**AAAI**) 2018. [[code]](https://mgong2.github.io/papers/CIDG.zip) - (**SCA**) [Scatter component analysis: A unified framework for domain adaptation and domain generalization](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7542175) Ghifary, Muhammad, David Balduzzi, W. Bastiaan Kleijn, and Mengjie Zhang. *IEEE Transactions on Pattern Analysis & Machine Intelligence* (**TPAMI**) 39.7 (2016): 1414-1430. [[code(unofficial)]](https://github.com/amber0309/SCA) - (**DICA**) [Domain generalization via invariant feature representation](http://proceedings.mlr.press/v28/muandet13.pdf) Muandet, Krikamol, David Balduzzi, and Bernhard Schölkopf. *International Conference on Machine Learning* (**ICML**) 2013. [[code]](http://krikamol.org/research/codes/dica.zip) ----- ## DG variants - [Learning to Learn Single Domain Generalization](https://arxiv.org/abs/2003.13216) Fengchun Qiao, Long Zhao, Xi Peng. *Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition* (**CVPR**) 2020. - [Domain Generalization Using a Mixture of Multiple Latent Domains](https://aaai.org/Papers/AAAI/2020GB/AAAI-MatsuuraT.3100.pdf) Toshihiko Matsuura, Tatsuya Harada. *AAAI Conference on Artificial Intelligence* (**AAAI**) 2020. [[code]](https://github.com/mil-tokyo/dg_mmld) - (**APN**) [Adversarial Pyramid Network for Video Domain Generalization](https://arxiv.org/abs/1912.03716) Zhiyu Yao, Yunbo Wang, Xingqiang Du, Mingsheng Long, Jianmin Wang *arXiv preprint arXiv:1912.03716* (2019). - (**FC**) [Feature-Critic Networks for Heterogeneous Domain Generalization](https://arxiv.org/abs/1901.11448) Li, Yiying, Yongxin Yang, Wei Zhou, and Timothy M. Hospedales *International Conference on Machine Learning* (**ICML**) 2019. [[code]](https://github.com/liyiying/Feature_Critic) - [Learning Robust Representations by Projecting Superficial Statistics Out](https://openreview.net/pdf?id=rJEjjoR9K7) Wang, Haohan, Zexue He, Zachary C. Lipton, and Eric P. Xing. *International Conference on Learning Representations* (**ICLR**) 2019. ----- ## Datasets | Dataset | #Sample | #Feature | #Class | Subdomain | Reference | |:--------------:|:-------:|:-------------------:|:------:|:------------:|:--------:| | [Office+Caltech](#Office+Caltech) | 2533 | SURF: 800, DeCAF: 4096 | 10 | A, W, D, C | [[1]](#1) | | [VOC2007](#vlcs) | 3376 | DeCAF: 4096 | 5 | V | [[2]](#2) | | [LabelMe](#vlcs) | 2656 | DeCAF: 4096 | 5 | L | [[3]](#3) | | [Caltech101](#vlcs) | 1415 | DeCAF: 4096 | 5 | C | [[4]](#4) | | [SUN09](#vlcs) | 3282 | DeCAF: 4096 | 5 | S | [[5]](#5) | ### Office+Caltech #### Introduction This dataset is constructed by collecting common classes in two datasets: Office-31 (which contains A, W and D) and Caltech-256 (which is C). Four domains: A(Amazon, 958 instances), W(Webcam, 295 instances), D(DSLR, 157 instances), and C(Caltech, 1123 instances). Ten common classes: back pack, bike, calculator, headphones, keyboard, laptop_computer, monitor, mouse, mug, and projector. #### Download Download Office+Caltech original images [[Google Drive](https://drive.google.com/file/d/14OIlzWFmi5455AjeBZLak2Ku-cFUrfEo/view?usp=sharing)] Download Office+Caltech SURF dataset [[Google Drive](https://drive.google.com/file/d/1TKot-lmTy5h797YaAeydkOD6kWqii5fa/view?usp=sharing)] Download Office+Caltech DeCAF dataset [[Google Drive](https://drive.google.com/file/d/1mgEyml0ZoZjUlUQfWNfr-Srxmlot3yq6/view?usp=sharing)] ### VLCS #### Introduction Four domains: V(VOC2007), L(LabelMe), C(Caltech), and S(SUN09). Five common classes: bird, car, chair, dog, and person. #### Download Download the VLCS DeCAF dataset [[Google Drive](https://drive.google.com/drive/folders/1yvIpp0kg8e-GHESF6jJjCO4M7mjOJHLS?usp=sharing)] ### ImageNet-C #### Introduction Fifteen Corruptions spanning noise, blur, weather, and digital corruptions. 1000 common classes, the ImageNet-1K classes. The paper is [here](https://arxiv.org/abs/1903.12261). #### Download Download links are available at https://github.com/hendrycks/robustness/ ----- ## References 1. Gong, Boqing, Yuan Shi, Fei Sha, and Kristen Grauman. "Geodesic flow kernel for unsupervised domain adaptation." In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pp. 2066-2073. IEEE, 2012. 2. Everingham, Mark, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman. "The pascal visual object classes (voc) challenge." International journal of computer vision 88, no. 2 (2010): 303-338. 3. Russell, Bryan C., Antonio Torralba, Kevin P. Murphy, and William T. Freeman. "LabelMe: a database and web-based tool for image annotation." International journal of computer vision 77, no. 1-3 (2008): 157-173. 4. Griffin, Gregory, Alex Holub, and Pietro Perona. "Caltech-256 object category dataset." (2007). 5. Choi, Myung Jin, Joseph J. Lim, Antonio Torralba, and Alan S. Willsky. "Exploiting hierarchical context on a large database of object categories." (2010). ----- ## Contact * **Shoubo Hu** - shoubo.sub [at] gmail.com See also the list of [contributors](https://github.com/amber0309/Domain-generalization/graphs/contributors) who participated in this project. ----- ## License This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.