File Glossary
Docker-only execution
All commands run inside Docker containers. Use the provided scripts.
Core
w8_rl/rollout/env_actor.py- EnvActor state machine and external APIw8_rl/rollout/env_master.py- task assignmentw8_rl/rollout/inference_router.py- batching + backend callsw8_rl/rollout/policy_backend.py- Gemini / local policy backends
SkyRL
w8_rl/skyrl/env/ray_backed_env.py- BaseTextEnv adapterw8_rl/skyrl/stub_runner.py- SkyRL evaluation runner
OpenEnv
w8_rl/openenv/serve_app.py- Ray Serve FastAPI deploymentw8_rl/openenv/session_manager.py- session -> EnvActor routingw8_rl/openenv/models.py- OpenEnv models
Tinker
w8_rl/tinker/env_adapter.py- EnvActor adapterw8_rl/tinker/renderer.py- ObsRef to tokensscripts/train_design2code_tinker.py- GRPO training loop
Tasks
tasks/- per-task Dockerfiles and metadata
Scripts
scripts/run_all_tasks.sh- SWE-bench runnerscripts/run_design2code_skyrl.sh- SkyRL evaluationscripts/run_design2code_openenv.sh- OpenEnv evaluationscripts/run_design2code_tinker.sh- Tinker rolloutscripts/train_design2code_tinker.sh- Tinker training
Next Steps
- Read the Architecture overview: Architecture Overview
- Run a Design2Code task: Design2Code Runs
- Review troubleshooting: Troubleshooting