Repository navigation
Refine Scenario configuration and sizing - #2377
Closed
Roman Lutz (romanlutz) wants to merge 38 commits into
Closed
Roman Lutz (romanlutz) wants to merge 38 commits into
Roman Lutz (romanlutz) wants to merge 38 commits into
Conversation
This was referenced Aug 12, 2026
Roman Lutz (romanlutz)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 21, 2026 07:01
4b81ccf to
f316420
Compare
Roman Lutz (romanlutz)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 21, 2026 14:31
f316420 to
1128c9b
Compare
Roman Lutz (romanlutz)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 25, 2026 02:25
1128c9b to
62a0d01
Compare
Roman Lutz (romanlutz)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 25, 2026 03:45
62a0d01 to
1ea0f0a
Compare
Roman Lutz (romanlutz)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 25, 2026 06:24
1ea0f0a to
4a2fbc7
Compare
Richard Lundeen (richlundeen)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 31, 2026 17:23
4a2fbc7 to
77c7986
Compare
Richard Lundeen (richlundeen)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
August 31, 2026 18:14
77c7986 to
664c8d8
Compare
Richard Lundeen (richlundeen)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
September 1, 2026 21:32
664c8d8 to
2c83ce3
Compare
Richard Lundeen (richlundeen)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
September 1, 2026 21:34
2c83ce3 to
521dfee
Compare
Behnam (behnam-o)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
September 2, 2026 17:50
521dfee to
e69bc09
Compare
Behnam (behnam-o)
force-pushed
the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
from
September 2, 2026 18:10
e69bc09 to
88f163f
Compare
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Exercise the async timeout boundary directly so slow Windows thread-pool startup cannot make the test wait forever before the mocked estimate begins. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Verify that pagination constructs exactly the requested scenarios without assuming thread-pool scheduling order. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Roman Lutz (romanlutz)
marked this pull request as ready for review
September 14, 2026 17:54
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Base automatically changed from
copilot/romanlutz-scenario-pr-05-queue-upstream
to
main
September 19, 2026 13:30
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 5d02c2d5-b499-4f78-a04d-03bffa750817
Richard Lundeen (richlundeen)
left a comment
Contributor
There was a problem hiding this comment.
I do think I like this change, but it's hard to follow with so much. I think this should probably be broken up and have its own overview/gist design
Contributor
Author
|
Superseded by the approved standalone follow-up plan: https://gist.github.com/romanlutz/d2e49b84649659a4ed93f915fc5c6b79 The remaining behavior will move into small, independent pull requests from romanlutz/PyRIT, each targeting microsoft/PyRIT:main. This PR is being closed without merge. Its source branch and exact snapshot will remain available as migration references. |
Behnam (behnam-o)
deleted the
copilot/romanlutz-scenario-pr-06-sizing-upstream
branch
November 12, 2026 21:11
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds named technique sets, Adaptive attempt caps, searchable datasets, per-dataset limits, compatibility-aware identities, and exact/ranged backend-owned run arithmetic. Default estimates use bounded concurrency with execution-only timeouts.
What this layer adds
Preview
Stack
This is 6 of 7 in native GitHub Stack #2390 and depends on #2376.
See the full implementation, screenshots, walkthrough, validation, and operational notes.
Validation
Compatibility notes
Unsupported Jailbreak v4 technique combinations are rejected, v3 persisted Jailbreak runs intentionally do not resume as v4, and configuration-aware Adaptive identities may regroup historical analytics.