We present a theoretical analysis framework for relational ensemble models. We show that ensembles of collective classifiers can improve predictions for graph data by reducing errors due to variance in both learning and inference. In addition, we propose a relational en- semble framework that combines a relational ensemble learning approach with a relational ensemble inference approach for collective classification. The proposed ensemble techniques are applicable for both single and multiple graph settings. Experiments on both synthetic and real-world data demonstrate the effectiveness of the proposed framework. Finally, our experimental results support the theoretical analysis and confirm that ensemble algorithms that explicitly focus on both learning and inference processes and aim at reducing errors associated with both, are the best performers.
- Date of publication:
- Journal of Machine Learning Research
- Page number(s):
- Issue Number:
- Publication note:
Hoda Eldardiry, Jennifer Neville, Ryan A. Rossi: Ensemble Learning for Relational Data. J. Mach. Learn. Res. 21: 49:1-49:37 (2020)