Research breakthrough possible @S-Logix pro@slogix.in

Office Address

  • 2nd Floor, #7a, High School Road, Secretariat Colony Ambattur, Chennai-600053 (Landmark: SRM School) Tamil Nadu, India
  • pro@slogix.in
  • +91- 81240 01111

Social List

Transfer Learning in Biomedical Natural Language Processing:An Evaluation of BERT and ELMo on Ten Benchmarking Datasets - 2019

Transfer Learning In Biomedical Natural Language Processing:An Evaluation Of Bert And Elmo On Ten Benchmarking Datasets

Research Area:  Machine Learning

Abstract:

Inspired by the success of the General Language Understanding Evaluation benchmark, we introduce the Biomedical Language Understanding Evaluation (BLUE) benchmark to facilitate research in the development of pre-training language representations in the biomedicine domain. The benchmark consists of five tasks with ten datasets that cover both biomedical and clinical texts with different dataset sizes and difficulties. We also evaluate several baselines based on BERT and ELMo and find that the BERT model pre-trained on PubMed abstracts and MIMIC-III clinical notes achieves the best results.

Keywords:  

Author(s) Name:  Yifan Peng, Shankai Yan, Zhiyong Lu

Journal name:  Computer Science

Conferrence name:  

Publisher name:  arXiv:1906.05474

DOI:  10.48550/arXiv.1906.05474

Volume Information: