TY - JOUR
T1 - SLOG
T2 - 41st International Conference on Machine Learning, ICML 2024
AU - Xu, Haobo
AU - Yan, Yuchen
AU - Wang, Dingsu
AU - Xu, Zhe
AU - Zeng, Zhichen
AU - Abdelzaher, Tarek F.
AU - Han, Jiawei
AU - Tong, Hanghang
N1 - This work is supported by NSF (IIS-19-56151, 2134079, 2316233, and 2324770), DARPA (HR001121C0165), AFOSR (FA9550-24-1-0002). The content of the information in this document does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation here on.
PY - 2024
Y1 - 2024
N2 - Graph neural networks (GNNs) have exhibited superb power in many graph related tasks. Existing GNNs can be categorized into spatial GNNs and spectral GNNs. The spatial GNNs primarily capture the local information around each node, while the spectral GNNs are able to operate on the frequency signals of the entire graph. However, most, if not all, existing spectral GNNs are faced with two limitations: (1) the polynomial limitation that for most spectral GNNs, the expressive power in the spectral domain is limited to polynomial filters; and (2) the transductive limitation that for the node-level task, most spectral GNNs can only be applied on relatively small-scale graphs in transductive setting. In this paper, we propose a novel spectral graph neural network named SLOG to solve the above two limitations. For the polynomial limitation, SLOG proposes a novel filter with real-valued order with geometric interpretability, mathematical feasibility and adaptive filtering ability to go beyond polynomial. For the transductive limitation, SLOG combines the subgraph sampling technique in spatial GNNs and the signal processing technique in spectral GNNs together to make itself tailored to the inductive node-level tasks on large-scale graphs. Extensive experimental results on 16 datasets demonstrate the superiority of SLOG in inductive homophilic and heterophilic node classification task.
AB - Graph neural networks (GNNs) have exhibited superb power in many graph related tasks. Existing GNNs can be categorized into spatial GNNs and spectral GNNs. The spatial GNNs primarily capture the local information around each node, while the spectral GNNs are able to operate on the frequency signals of the entire graph. However, most, if not all, existing spectral GNNs are faced with two limitations: (1) the polynomial limitation that for most spectral GNNs, the expressive power in the spectral domain is limited to polynomial filters; and (2) the transductive limitation that for the node-level task, most spectral GNNs can only be applied on relatively small-scale graphs in transductive setting. In this paper, we propose a novel spectral graph neural network named SLOG to solve the above two limitations. For the polynomial limitation, SLOG proposes a novel filter with real-valued order with geometric interpretability, mathematical feasibility and adaptive filtering ability to go beyond polynomial. For the transductive limitation, SLOG combines the subgraph sampling technique in spatial GNNs and the signal processing technique in spectral GNNs together to make itself tailored to the inductive node-level tasks on large-scale graphs. Extensive experimental results on 16 datasets demonstrate the superiority of SLOG in inductive homophilic and heterophilic node classification task.
UR - http://www.scopus.com/inward/record.url?scp=85200223508&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85200223508&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85200223508
SN - 2640-3498
VL - 235
SP - 55348
EP - 55370
JO - Proceedings of Machine Learning Research
JF - Proceedings of Machine Learning Research
Y2 - 21 July 2024 through 27 July 2024
ER -