SWE-ReX Modal
SWE-ReX Modal Environment class
- Read on GitHub
- Requires Modal account and authentication
This environment executes commands in Modal sandboxes using SWE-ReX.
Setup
-
Install the full dependencies:
pip install "peen[full]" -
Set up Modal authentication:
modal setup
Usage
Evaluate models on SWE-bench using Modal:
peen-swebench \
--config src/peen/config/extra/swebench_modal.yaml \
--subset verified \
--split test \
--workers 100 \
-o ./results/modal-eval