Empowering NLG: Offline Reinforcement Learning for Informal Summarization in Online Domains (2306.17174v1)
Abstract: Our research introduces an innovative Natural Language Generation (NLG) approach that aims to optimize user experience and alleviate the workload of human customer support agents. Our primary objective is to generate informal summaries for online articles and posts using an offline reinforcement learning technique. In our study, we compare our proposed method with existing approaches to text generation and provide a comprehensive overview of our architectural design, which incorporates crawling, reinforcement learning, and text generation modules. By presenting this original approach, our paper makes a valuable contribution to the field of NLG by offering a fresh perspective on generating natural language summaries for online content. Through the implementation of Empowering NLG, we are able to generate higher-quality replies in the online domain. The experimental results demonstrate a significant improvement in the average "like" score, increasing from 0.09954378 to 0.5000152. This advancement has the potential to enhance the efficiency and effectiveness of customer support services and elevate the overall user experience when consuming online content.
- Think: A novel conversation model for generating grammatically correct and coherent responses. Knowledge-Based Systems, 242:108376, 2022.
- The algorithmic inflection of russian and generation of grammatically correct text, 2017.
- Roesslein and Joshua. Tweepy: Twitter for python!, 2020.
- JustAnotherArchivist. snscrape: A social networking service scraper in python, 2020.
- Po-Chuan Chen. Famous keyword twitter replies, 2023.
- Language models are unsupervised multitask learners. 2019.
- Proximal policy optimization algorithms, 2017.
- A survey of natural language generation. ACM Computing Surveys, 55(8):1–38, 12 2022.
- Sequence to sequence learning with neural networks, 2014.
- Attention is all you need, 2017.
- Exploring transformers in natural language generation: Gpt, bert, and xlnet, 2021.
- Attention-based models for speech recognition, 2015.
- Adversarial generation of natural language, 2017.
- Diffusion-lm improves controllable text generation, 2022.
- Retrieval-augmented generation for knowledge-intensive nlp tasks, 2021.
- Training language models to follow instructions with human feedback, 2022.
- OpenAI. Gpt-4 technical report, 2023.
- Q-learning algorithms: A comprehensive classification and applications. IEEE Access, 7:133653–133667, 2019.
- Evolved policy gradients, 2018.
- Implementing the deep q-network, 2017.
- Addressing function approximation error in actor-critic methods, 2018.
- Soft actor-critic algorithms and applications, 2019.
- Off-policy deep reinforcement learning without exploration, 2019.
- Stabilizing off-policy q-learning via bootstrapping error reduction, 2019.
- An optimistic perspective on offline reinforcement learning, 2020.
- Rl4f: Generating natural language feedback with reinforcement learning for repairing model outputs, 2023.
- Adaptive natural language generation for task-oriented dialogue via reinforcement learning, 2022.
- Learning natural language generation from scratch, 2021.
- Inverse reinforcement learning for text summarization, 2022.
- A study of reinforcement learning for neural machine translation, 2018.
- Exploring the limits of transfer learning with a unified text-to-text transformer, 2020.
- Mass: Masked sequence to sequence pre-training for language generation, 2019.
- Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension, 2019.
- Improving language understanding by generative pre-training. 2018.
- Language models are few-shot learners, 2020.
- Bert: Pre-training of deep bidirectional transformers for language understanding, 2019.
- Roberta: A robustly optimized bert pretraining approach, 2019. cite arxiv:1907.11692.
- Unified language model pre-training for natural language understanding and generation, 2019.
- Unilmv2: Pseudo-masked language models for unified language model pre-training, 2020.