Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning

Bin Li, Yunlong Fan, Yikemaiti Sataer, Chuanqi Shi, Miao Gao, Zhiqiang Gao


Abstract
Graph neural networks (GNNs) have achieved promising performance on semantic dependency parsing (SDP), owing to their powerful graph representation learning ability. However, training a high-performing GNN-based model requires a large amount of labeled data and it is prone to over-fitting in the absence of sufficient labeled data. To address this drawback, we propose a syntax-guided graph contrastive learning framework to pre-train GNNs with plenty of unlabeled data and fine-tune pre-trained GNNs with few-shot labeled SDP data. Through extensive experiments conducted on the SemEval-2015 Task 18 English dataset in three formalisms (DM, PAS, and PSD), we demonstrate that our framework achieves promising results when few-shot training samples are available. Furthermore, benefiting from the pre-training process, our framework exhibits notable advantages in the out-of-domain test sets.
Anthology ID:
2024.lrec-main.636
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
7248–7258
Language:
URL:
https://aclanthology.org/2024.lrec-main.636
DOI:
Bibkey:
Cite (ACL):
Bin Li, Yunlong Fan, Yikemaiti Sataer, Chuanqi Shi, Miao Gao, and Zhiqiang Gao. 2024. Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7248–7258, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Few-Shot Semantic Dependency Parsing via Graph Contrastive Learning (Li et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.636.pdf