# Probes

This folder contains a template for running experiments on probing / steering tasks.
It is based on [this repo](https://github.com/jorispos/ConceptorSteering).
We expect baseline score to be around 10%.

## Structure of the template

- `antonyms.json`. A list of antonym pairs.
- `experiment.py`. The python file containing the code for the probing task.
- `plot.py`. Empty file, to be filled automatically by the AI Scientist pipeline.
- `prompt.json`. The prompts for the template.
- `requirements.txt`. The dependencies for the template.
- `seed_ideas.json`. A list of seed ideas for the AI Scientist pipeline.
