arxiv Preprint - Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution

In this episode we discuss Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution by Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, Tim Rocktäschel. The paper presents PROMPTBREEDER, a method for evolving and adapting prompts for Large Language Models (LLMs) in order to enhance their reasoning abilities. It uses an LLM to mutate a population of task-prompts and evaluates their fitness on a training set. The mutation of task-prompts is guided by self-improved mutation-prompts generated by the LLM, leading to improved performance in tasks such as arithmetic, commonsense reasoning, and hate speech classification.

There are no comments yet.

Please log in to write the first comment.