Research breakthrough possible @S-Logix

Office Address

  • 2nd Floor, #7a, High School Road, Secretariat Colony Ambattur, Chennai-600053 (Landmark: SRM School) Tamil Nadu, India
  • +91- 81240 01111

Social List

Transfer Learning for Style-Specific Text Generation - 2018

Transfer Learning For Style-Specific Text Generation

Research Paper on Transfer Learning For Style-Specific Text Generation

Research Area:  Machine Learning


Neural networks have shown promising results for generating text for creative uses. However, current methods require large data sets to generate coherent sentences, which severely limits their creative potential given that the majority of stylistic literary data sets are relatively small. We build on recent advances in transfer learning for natural language processing and demonstrate that generic pre-trained language models can be effectively fine-tuned on small stylistic corpora to generate coherent and creatively expressive text. We empirically show the effectiveness of this method across three distinct literary styles where only a small (e.g. less than 6k) number of tokens are available. We suggest further work for understanding and improving this process, and release our code online1.

Transfer Learning
Text Generation
Machine Learning
Deep Learning

Author(s) Name:  Katy Ilonka, Giannis Karamanolakis, Lydia B. Chilton

Journal name:  

Conferrence name:  32nd Conference on Neural Information Processing Systems

Publisher name:  Neural Information Processing Systems

DOI:  201760711

Volume Information: