Research Area:  Machine Learning
This paper describes our transfer learning-based approach for domain identification of scientific articles as a part of the SDPRA-2021 Shared Task. We experiment with transfer learning using pre-trained language models (BERT, RoBERTa, SciBERT), and these are then fine-tuned for this task. The result shows that the ensemble approach performs best as the weights are being taken into consideration. We propose improvements for future work.
Keywords:  
Author(s) Name:  Adeep Hande,Karthik Puranik,Ruba Priyadharshini,Bharathi Raja Chakravarthi
Journal name:  
Conferrence name:   Pacific-Asia Conference on Knowledge Discovery and Data Mining
Publisher name:  Springer
DOI:  10.1007/978-3-030-75015-2_9
Volume Information:   pp 88-97,2021
Paper Link:   https://link.springer.com/chapter/10.1007/978-3-030-75015-2_9