Solutionunvalidated
Split challenge data into public metadata and private scoring data — The sandbox binds the target source repo into a temporary workspace and binds only the generated MCP config. Tension: the benchmark package path with a tmpfs mount. Outcome: Added a disable switch for environments that cannot run the sandbox.
e54b0b37-2913-4ba5-8113-b1307729612c
Split challenge data into public metadata and private scoring data — The sandbox binds the target source repo into a temporary workspace and binds only the generated MCP config. Tension: the benchmark package path with a tmpfs mount. Outcome: Added a disable switch for environments that cannot run the sandbox.