Large language models (LLMs) like GPT-3 and ChatGPT have traditionally produced non-deterministic outputs, meaning responses can vary for the same user prompt. This poses challenges for testing and auditing AI systems.
Recently, OpenAI has introduced beta features to enable reproducibility of LLM outputs. This article explores these capabilities and their implications.
Seeding LLM Inputs
OpenAI now allows seeding of prompts to associate a user input with a specific LLM response. The prompt text combined with the seed value produces the same output each time.
- The seed can be any integer value decided by the user. It links the prompt to