Timeline of Prompt Learning

• Revisiting Self-Training for Few-Shot Learning of Language Model 04 October, 2021

  Prompt-fix LM Tuning

• Towards Zero-Label Language Learning 19 September, 2021

  Tuning-free Prompting

• SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment Analysis 17 September, 2021

  Fixed-prompt LM Tuning

• Reframing Instructional Prompts to GPTk's Language 16 September, 2021

  Tuning-free Prompting

• Language Models are Few-shot Multilingual Learners 16 September, 2021

  Tuning-free Prompting

• Can Language Models be Biomedical Knowledge Bases? 15 September, 2021

  Tuning-free Prompting; Fixed-LM Prompt Tuning

• Dialogue State Tracking with a Language Model using Schema-Driven Prompting 15 September, 2021

  Fixed-prompt LM Tuning

• Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation 14 September, 2021

  Fixed-Prompt LM Tuning; Fixed-LM Prompt Tuning

• Eliciting Knowledge from Language Models for Event Extraction 11 September, 2021

  Fixed-Prompt LM Tuning

• An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA 10 September, 2021

  Tuning-free Prompting

• CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems 10 September, 2021

  Fixed-Prompt LM Tuning

• PPT: Pre-trained Prompt Tuning for Few-shot Learning 9 September, 2021

  Fixed-LM Prompt Tuning

• Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning 9 September, 2021

  Fixed-Prompt LM Tuning

• Continuous Entailment Patterns for Lexical Inference in Context 8 September, 2021

  Fixed-LM Prompt Tuning

• A Recipe For Arbitrary Text Style Transfer with Large Language Models 8 September, 2021

  Tuning-free Prompting

• Open Aspect Target Sentiment Classification with Natural Language Prompts 8 September, 2021

  Fixed-Prompt LM Tuning

• Discrete and Soft Prompting for Multilingual Models 8 September, 2021

  Tuning-free Prompting; Fixed-LM Prompt Tuning

• NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction 8 September, 2021

  Tuning-free Prompting

• General-Purpose Question-Answering with Macaw 6 September, 2021

  Fixed-prompt LM Tuning

• An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models 6 September, 2021

  Tuning-free Prompting

• Finetuned Language Models Are Zero-Shot Learners 3 September, 2021

  Fixed-prompt LM Tuning

• Do Prompt-Based Models Really Understand the Meaning of their Prompts? 2 September, 2021

  Fixed-prompt LM Tuning

• ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation 2 September, 2021

  Tuning-free Prompting

• Learning to Prompt for Vision-Language Models 2 September, 2021

  Tuning-free Prompting; Fixed-LM Prompt Tuning

• LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NER 31 August, 2021

  Fixed-LM Prompt Tuning

• Want To Reduce Labeling Cost? GPT-3 Can Help 30 August, 2021

  Tuning-free Prompting

• Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners 30 August, 2021

  Fixed-LM Prompt Tuning

• Prompt-Learning for Fine-Grained Entity Typing 24 August, 2021

  Fixed-prompt LM Tuning

• Noisy Channel Language Model Prompting for Few-Shot Text Classification 9 August, 2021

  Fixed-LM Prompt Tuning

• Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification 4 August, 2021

  Fixed-prompt LM Tuning

• FLEX: Unifying Evaluation for Few-Shot NLP 15 July, 2021

  Fixed-prompt LM Tuning

• HTLM: Hyper-Text Pre-Training and Prompting of Language Models 14 July, 2021

  Fixed-prompt LM Tuning

• Evaluating Large Language Models Trained on Code 7 July, 2021

  Tuning-free Prompting; Fixed-prompt LM Tuning

• ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation 5 July, 2021

  Tuning-free Prompting

• Multimodal Few-Shot Learning with Frozen Language Models 25 June, 2021

  Fixed-LM Prompt Tuning

• Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models 24 June, 2021

  LM+Prompt Tuning

• BARTScore: Evaluating Generated Text as Text Generation 21 June, 2021

  Tuning-free Prompting

• CPM-2: Large-scale Cost-effective Pre-trained Language Models 20 June, 2021

  Fixed-LM Prompt Tuning; LM+Prompt Tuning

• Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning 16 June, 2021

  Fixed-LM Prompt Tuning

• Text Generation with Efficient (Soft) Q-Learning 14 June, 2021

  Fixed-LM Prompt Tuning

• Reordering Examples Helps during Priming-based Few-Shot Learning 3 June, 2021

  Tuning-free Prompting

• Template-Based Named Entity Recognition Using BART 3 June, 2021

  Fixed-prompt LM Tuning

• PTR: Prompt Tuning with Rules for Text Classification 24 May, 2021

  LM+Prompt Tuning

• True Few-Shot Learning with Language Models 24 May, 2021

  Tuning-free Prompting; Fixed-prompt LM Tuning

• PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation 26 April, 2021

  Tuning-free Prompting

• GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation 18 April, 2021

  Tuning-free Prompting

• Constrained Language Models Yield Few-Shot Semantic Parsers 18 April, 2021

  Tuning-free Prompting

• Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity 18 April, 2021

  Tuning-free Prompting

• Natural Instructions: Benchmarking Generalization to New Tasks from Natural Language Instructions 18 April, 2021

  Tuning-free Prompting; Fixed-prompt LM Tuning

• The Power of Scale for Parameter-Efficient Prompt Tuning 18 April, 2021

  Fixed-LM Prompt Tuning

• Surface Form Competition: Why the Highest Probability Answer Isn't Always Right 16 April, 2021

  Tuning-free Prompting

• AdaPrompt: Adaptive Prompt-based Finetuning for Relation Extraction 15 April, 2021

  Fixed-prompt LM Tuning

• Generating Datasets with Pretrained Language Models 15 April, 2021

  Tuning-free Prompting

• Learning How to Ask: Querying LMs with Mixtures of Soft Prompts 14 April, 2021

  Fixed-LM Prompt Tuning

• Factual Probing Is [MASK]: Learning vs. Learning to Recall 12 April, 2021

  Fixed-LM Prompt Tuning

• Meta-tuning Language Models to Answer Prompts Better 10 April, 2021

  Fixed-prompt LM Tuning

• Improving and Simplifying Pattern Exploiting Training 22 March, 2021

  Fixed-prompt LM Tuning

• All NLP Tasks Are Generation Tasks: A General Pretraining Framework 18 March, 2021

  Fixed-prompt LM Tuning

• GPT Understands, Too 18 March, 2021

  Tuning-free Prompting; LM+Prompt Tuning

• How Many Data Points is a Prompt Worth? 15 March, 2021

  Fixed-prompt LM Tuning

• BERTese: Learning to Speak to BERT 9 March, 2021

  Tuning-free Prompting

• Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP 27 February, 2021

  Tuning-free Prompting

• PADA: A Prompt-based Autoregressive Approach for Adaptation to Unseen Domains 24 February, 2021

  LM+Prompt Tuning

• Calibrate Before Use: Improving Few-Shot Performance of Language Models 19 February, 2021

  Tuning-free Prompting

• Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm 15 February, 2021

  Tuning-free Prompting

• Unifying Vision-and-Language Tasks via Text Generation 4 February, 2021

  Fixed-prompt LM Tuning

• What Makes Good In-Context Examples for GPT-3? 17 January, 2021

  Tuning-free Prompting

• Prefix-Tuning: Optimizing Continuous Prompts for Generation 1 January, 2021

  Fixed-LM Prompt Tuning

• WARP: Word-level Adversarial ReProgramming 1 January, 2021

  Fixed-LM Prompt Tuning

• Making Pre-trained Language Models Better Few-shot Learners 31 December, 2020

  Fixed-prompt LM Tuning

• Few-Shot Text Generation with Pattern-Exploiting Training 22 December, 2020

  Fixed-prompt LM Tuning

• CTRLsum: Towards Generic Controllable Text Summarization 8 December, 2020

  Fixed-prompt LM Tuning

• AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts 29 October, 2020

  Tuning-free Prompting

• Automatically Identifying Words That Can Serve as Labels for Few-Shot Text Classification 26 October, 2020

  Fixed-prompt LM Tuning

• The Turking Test: Can Language Models Understand Instructions? 22 October, 2020

  Tuning-free Prompting

• X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models 13 October, 2020

  Tuning-free Prompting

• A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks 7 October, 2020

  Fixed-LM Prompt Tuning

• RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models 24 September, 2020

  Tuning-free Prompting

• It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners 15 September, 2020

  Fixed-prompt LM Tuning

• Designing Templates for Eliciting Commonsense Knowledge from Pretrained Sequence-to-Sequence Models 8 September, 2020

  Fixed-prompt LM Tuning

• Language Models are Few-Shot Learners 28 May, 2020

  Tuning-free Prompting

• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks 22 May, 2020

  LM+Prompt Tuning

• UNIFIEDQA: Crossing Format Boundaries with a Single QA System 2 May, 2020

  Fixed-prompt LM Tuning

• How Context Affects Language Models' Factual Predictions 10 March, 2020

  Tuning-free Prompting

• Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference 21 January, 2020

  Fixed-prompt LM Tuning

• Zero-shot Text Classification With Generative Language Models 10 December, 2019

  Fixed-prompt LM Tuning

• How Can We Know What Language Models Know? 28 November, 2019

  Tuning-free Prompting

• Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly 8 November, 2019

  Tuning-free Prompting

• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer 23 October, 2019

  Fixed-prompt LM Tuning

• Argumentative Relation Classification as Plausibility Ranking 19 October, 2019

  Fixed-prompt LM Tuning

• CTRL: A Conditional Transformer Language Model for Controllable Generation 11 September, 2019

  Fixed-prompt LM Tuning

• Language Models as Knowledge Bases? 3 September, 2019

  Tuning-free Prompting

• Commonsense Knowledge Mining from Pretrained Models 2 September, 2019

  Tuning-free Prompting

• Universal Adversarial Triggers for Attacking and Analyzing NLP 20 August, 2019

  Tuning-free Prompting

• What BERT is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models 31 July, 2019

  Tuning-free Prompting

• Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking 14 April, 2019

  Tuning-free Prompting

• Language Models are Unsupervised Multitask Learners 14 February, 2019

  Tuning-free Prompting

• A Simple Method for Commonsense Reasoning 7 June, 2018

  Tuning-free Prompting