Setup for Playground
Create datasets for in-playground testing.
To create datasets for the playground, you need to set up columns that match your prompt’s variables correctly. There are two methods for preparing datasets for the playground.
Manual Setup
Start with an empty dataset and create columns manually:
Create an empty dataset
Click the ‘add’ button (+) on the project you want to create a dataset in. Once created, this dataset is available to all resources in the project.
Create and rename columns
- Click “Add column” to create a new column. Double-click the column name to rename it. Your dataset must have at least the columns exactly matching the variable names in your prompt to run evaluations.
- Column names must match your prompt variables precisely. If your prompt uses
{{customer_name}}
, create a column named “customer_name”.
Create rows
Create rows for each of the test cases you want to run evaluations on.
Linked dataset to playground
Navigate to the Variable Editor and click on ‘Link dataset’ and choose your newly created dataset. If you don’t see the dataset, double-check that the column names match exactly as variables in your prompt.
Edit anywhere
Once linked, you can edit the dataset from either the Variable Editor or the Dataset page.
Automated Setup
Create a pre-configured dataset from the playground:
Create and link a new dataset
Click “Create and link new dataset” in the variable editor.
Create and rename columns
A new dataset is created with matching column names as per the variables in your playground.
Create rows
Create rows for each of the test cases you want to run evaluations on.
Edit anywhere
You can edit the dataset from either the variable editor or the dataset page.