TY - GEN
T1 - Adversarial Graph Contrastive Learning with Information Regularization
AU - Feng, Shengyu
AU - Jing, Baoyu
AU - Zhu, Yada
AU - Tong, Hanghang
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/4/25
Y1 - 2022/4/25
N2 - Contrastive learning is an effective unsupervised method in graph representation learning. Recently, the data augmentation based contrastive learning method has been extended from images to graphs. However, most prior works are directly adapted from the models designed for images. Unlike the data augmentation on images, the data augmentation on graphs is far less intuitive and much harder to provide high-quality contrastive samples, which are the key to the performance of contrastive learning models. This leaves much space for improvement over the existing graph contrastive learning frameworks. In this work, by introducing an adversarial graph view and an information regularizer, we propose a simple but effective method, Adversarial Graph Contrastive Learning (ArieL), to extract informative contrastive samples within a reasonable constraint. It consistently outperforms the current graph contrastive learning methods in the node classification task over various real-world datasets and further improves the robustness of graph contrastive learning.
AB - Contrastive learning is an effective unsupervised method in graph representation learning. Recently, the data augmentation based contrastive learning method has been extended from images to graphs. However, most prior works are directly adapted from the models designed for images. Unlike the data augmentation on images, the data augmentation on graphs is far less intuitive and much harder to provide high-quality contrastive samples, which are the key to the performance of contrastive learning models. This leaves much space for improvement over the existing graph contrastive learning frameworks. In this work, by introducing an adversarial graph view and an information regularizer, we propose a simple but effective method, Adversarial Graph Contrastive Learning (ArieL), to extract informative contrastive samples within a reasonable constraint. It consistently outperforms the current graph contrastive learning methods in the node classification task over various real-world datasets and further improves the robustness of graph contrastive learning.
KW - adversarial training
KW - contrastive learning
KW - graph representation learning
KW - mutual information
UR - http://www.scopus.com/inward/record.url?scp=85129866291&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85129866291&partnerID=8YFLogxK
U2 - 10.1145/3485447.3512183
DO - 10.1145/3485447.3512183
M3 - Conference contribution
AN - SCOPUS:85129866291
T3 - WWW 2022 - Proceedings of the ACM Web Conference 2022
SP - 1362
EP - 1371
BT - WWW 2022 - Proceedings of the ACM Web Conference 2022
PB - Association for Computing Machinery
T2 - 31st ACM World Wide Web Conference, WWW 2022
Y2 - 25 April 2022 through 29 April 2022
ER -