Large-Scale Transfer Learning for Natural Language

Large-Scale Transfer Learning for Natural Language Generation - 2019

Research Area: Machine Learning

Abstract:

Large-scale pretrained language models define state of the art in natural language processing, achieving outstanding performance on a variety of tasks. We study how these architectures can be applied and adapted for natural language generation, comparing a number of architectural and training schemes. We focus in particular on open-domain dialog as a typical high entropy generation task, presenting and comparing different architectures for adapting pretrained models with state of the art results.

Keywords:

Author(s) Name: Sergey Golovanov, Rauf Kurbanov, Sergey Nikolenko, Kyryl Truskovskyi, Alexander Tselousov, Thomas Wolf

Journal name: Association for Computational Linguistics

Conferrence name:

Publisher name: ACL

DOI: 10.18653/v1/P19-1608

Volume Information:

Paper Link: https://aclanthology.org/P19-1608/

PhD Guidance and Support Enquiry
Masters and PhD Project Enquiry
Machine Learning - Home
PhD Research Guidance in Machine Learning
PhD Research Proposal in Machine Learning
Latest Research Papers in Machine Learning
Literature Survey in Machine Learning
PhD Thesis in Machine Learning
PhD Projects in Machine Learning
Python Project Titles in Machine Learning
Python Sample Source Code
Leading Journals in Machine Learning
Leading Research Books in Machine Learning
Research Topics in Recommender Systems based on Deep Learning
Research Proposal Topics in Natural Language Processing (NLP)
Research Topics in Federated Learning
Research Topics in Medical Machine Learning
Research Topics in Federated Learning for Smart City Application
Research Proposal on Graph Neural Network for Graph Analytics
Research Proposal on Deep Reinforcement Learning Methods for Active Decision Making

Office Address

Social List