Skip to content

SWE-ReX Modal

SWE-ReX Modal Environment class

This environment executes commands in Modal sandboxes using SWE-ReX.

Setup

  1. Install the full dependencies:

    pip install "peen[full]"
    

  2. Set up Modal authentication:

    modal setup
    

Usage

Evaluate models on SWE-bench using Modal:

peen-swebench \
    --config src/peen/config/extra/swebench_modal.yaml \
    --subset verified \
    --split test \
    --workers 100 \
    -o ./results/modal-eval