Prompts(139)

Prompt Picker

Prompt Picker helps you choose the best system prompts for your LLM applications.

Source rating 5.0 (97) 0 views 0 saves Unknown
More categories (8)

Verdict

A quick read before you dig into the full page.

Best if
Prompt Picker helps you choose the best system prompts for your LLM applications
Pick this when
Prompt Picker helps you choose the best system prompts for your LLM applications

Overview

Prompt Picker helps you choose better system prompts (aka custom instructions) for your LLM-powered applications by running experiments over simulated user inputs. In other words, it helps answer "...but which *exact* system prompt should I be using?"

Prompt Picker screenshot

Access & connections

Where you can use Prompt Picker.

Platforms

Web

Capabilities

What this tool accepts, produces, and is strongest at.

Highlights

  • Experiment with multiple prompts in parallel
  • Assess prompts using example user interactions
  • Rank prompts based on user preferences
  • Double-blind experimental setup

FAQ 5

What is Prompt Picker?
Prompt Picker helps you choose better system prompts (aka custom instructions) for your LLM-powered applications by running experiments over simulated user inputs. In other words, it helps answer "...but which *exact* system prompt should I be using?"
How to use Prompt Picker?
1. Configure your experiment: Define system prompts, user inputs, and language model parameters.
2. Assess your generations: Use a double-blind setup to choose the best generations.
3. Get your results: Prompt Picker ranks the prompts, ensuring you use the best configuration.
What language models can I use?
Currently, only GPT-3.5-turbo is supported, but GPT-4 will be coming soon!
How much does it cost?
Prompt Picker is currently free to use, but we will be introducing a paid tier with more features soon.
How do you rank the candidate system prompts?
Based on pairwise comparisons provided by the user, Prompt Picker uses the ELO rating system to rank the candidate system prompts or custom instructions.
Prompt Picker