AC Assignments: Add assignment limit to area chairs#3014
AC Assignments: Add assignment limit to area chairs#3014haroldrubio wants to merge 13 commits intomasterfrom
Conversation
There was a problem hiding this comment.
Pull request overview
Adds a per-submission quota for Area Chair (AC) assignments/invitations in ARR to prevent multiple simultaneous AC assignments (and therefore multiple meta-reviews), by reusing the existing quota enforcement mechanism used for reviewer assignments.
Changes:
- Introduces
submission_assignment_max_area_chairsas a configurable field (defaulting to 1 for ARR). - Publishes
area_chairs_invite_assignment_idinto the venue domain group content so invite/assignment quota logic can apply to ACs. - Extends ARR v2 tests to assert the new domain settings and verify quota enforcement for AC Assignment and Invite_Assignment edges.
Reviewed changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
| tests/test_arr_venue_v2.py | Adds assertions for the new AC quota field and verifies quota enforcement via raised exceptions. |
| openreview/venue_request/venue_request.py | Exposes submission_assignment_max_area_chairs in revision and request-form schemas (hidden in request form). |
| openreview/venue/venue.py | Adds submission_assignment_max_area_chairs attribute to the Venue model. |
| openreview/venue/group.py | Adds area_chairs_invite_assignment_id to domain content and persists submission_assignment_max_area_chairs when set. |
| openreview/conference/helpers.py | Parses submission_assignment_max_area_chairs from request notes into the Venue/ARR object. |
| openreview/arr/arr.py | Sets ARR default submission_assignment_max_area_chairs = 1 and copies it into the underlying Venue. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
|
The changes seem fine. However, the ACs are assigned by the PCs right, so I thought that ARR had assigned two ACs to some papers on purpose? Will this cause any issues for them? |
|
The changes look good to me but if we want to have a single meta review per submissions we can change the signatures of the meta review to be the SubmissionX/Area_Chairs instead of the anonid, this way any member of this group can sign the note and maxReplies will be limited to 1. |
But then this also means that if there are multiple ACs , they can all edit the same metareview. I am not sure if this is the behavior we want. |
True, then the invitee must be the anon AC group. |
|
I'll follow up with ARR to see if they would support something like (multiple ACs, single meta-review) |
|
Update on the requirements from ARR:
|
This PR prevents the ARR issue of multiple meta-reviews by re-using the logic to limit the number of invited and assigned reviewers. By limiting the number of AC assignments, we avoid the issue of multiple meta-reviews by only having 1 AC assigned at a time