From 7656b71d07da6694e262f9c34ea994cd4849c0eb Mon Sep 17 00:00:00 2001 From: nsigma Date: Tue, 4 Aug 2026 16:37:01 -0700 Subject: [PATCH] Update submission guidelines for artifacts and exit codes Clarified instructions for submitting artifacts and exit codes. --- SUBMISSION.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/SUBMISSION.md b/SUBMISSION.md index e7cae22..07462e9 100644 --- a/SUBMISSION.md +++ b/SUBMISSION.md @@ -48,7 +48,9 @@ models: ## 2. Artifacts -Include example trajectories, logs, and PoC submissions for at least 10 tasks so we can review the agent's behavior. For every task, also report the `vul_exit_code` and `fix_exit_code` of the final submitted PoC. We also encourage including these artifacts in the public writeup. +Include example trajectories, logs, and PoC submissions for at least 10 tasks so we can review the agent's behavior. +Please also report the `vul_exit_code` and `fix_exit_code` of the final submitted PoC for all instances (not only the examples). +We also encourage including these artifacts in the public writeup. ## 3. Detailed writeup