Search Wisent's steering methods for a benchmark and report the best-performing one, driving the sweep with a hyperparameter optimizer (Hyperopt or Optuna).
python -m wisent find-best-method --model MODEL --task TASK --output-dir DIR --trials-multiplier N --backend {hyperopt,optuna}python -m wisent find-best-method --model meta-llama/Llama-3.1-8B-Instruct --task truthfulqa_mc1 --output-dir ./best_method --trials-multiplier 10 --backend optuna
| Argument | Description |
|---|---|
| --model | HuggingFace model ID |
| --task | Benchmark task name |
| --output-dir | Directory for results |
| --trials-multiplier | Trials per dimension of the search space |
| --backend | Optimizer backend: hyperopt or optuna |
Stay in the loop. Never miss out.
Subscribe to our newsletter and unlock Wisent insights.