Mitigating Overfitting in Graph Neural Networks via Feature and Hyperplane Perturbation

초록

Message-passing neural networks are widely employed in various graph mining applications. However, these methods are susceptible to the scarcity of labeled data, which often leads to overfitting. Our observations suggest that sparse initial vectors further exacerbate this issue by failing to fully represent the range of learnable parameters. This sparsity can hinder the optimization of specific dimensions in the initial projection matrix, as the training samples may not adequately span these parameters. To overcome this challenge, we propose a novel perturbation technique that introduces variability to the initial features and the projection hyperplane. Notably, even without employing grid search, we demonstrate that shifting with a small estimated value mitigates this problem more effectively than other perturbation methods. Experimental results on real-world datasets reveal that our technique significantly enhances node classification accuracy in semi-supervised scenarios.