Skip to content

AC Assignments: Add assignment limit to area chairs#3014

Open
haroldrubio wants to merge 13 commits intomasterfrom
fix/arr-multiple-metareview
Open

AC Assignments: Add assignment limit to area chairs#3014
haroldrubio wants to merge 13 commits intomasterfrom
fix/arr-multiple-metareview

Conversation

@haroldrubio
Copy link
Copy Markdown
Member

This PR prevents the ARR issue of multiple meta-reviews by re-using the logic to limit the number of invited and assigned reviewers. By limiting the number of AC assignments, we avoid the issue of multiple meta-reviews by only having 1 AC assigned at a time

@haroldrubio haroldrubio self-assigned this Apr 14, 2026
@haroldrubio haroldrubio marked this pull request as ready for review April 15, 2026 13:28
Copilot AI review requested due to automatic review settings April 15, 2026 13:28
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a per-submission quota for Area Chair (AC) assignments/invitations in ARR to prevent multiple simultaneous AC assignments (and therefore multiple meta-reviews), by reusing the existing quota enforcement mechanism used for reviewer assignments.

Changes:

  • Introduces submission_assignment_max_area_chairs as a configurable field (defaulting to 1 for ARR).
  • Publishes area_chairs_invite_assignment_id into the venue domain group content so invite/assignment quota logic can apply to ACs.
  • Extends ARR v2 tests to assert the new domain settings and verify quota enforcement for AC Assignment and Invite_Assignment edges.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
tests/test_arr_venue_v2.py Adds assertions for the new AC quota field and verifies quota enforcement via raised exceptions.
openreview/venue_request/venue_request.py Exposes submission_assignment_max_area_chairs in revision and request-form schemas (hidden in request form).
openreview/venue/venue.py Adds submission_assignment_max_area_chairs attribute to the Venue model.
openreview/venue/group.py Adds area_chairs_invite_assignment_id to domain content and persists submission_assignment_max_area_chairs when set.
openreview/conference/helpers.py Parses submission_assignment_max_area_chairs from request notes into the Venue/ARR object.
openreview/arr/arr.py Sets ARR default submission_assignment_max_area_chairs = 1 and copies it into the underlying Venue.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread openreview/venue/group.py
@celestemartinez
Copy link
Copy Markdown
Member

The changes seem fine. However, the ACs are assigned by the PCs right, so I thought that ARR had assigned two ACs to some papers on purpose? Will this cause any issues for them?

@melisabok
Copy link
Copy Markdown
Member

The changes look good to me but if we want to have a single meta review per submissions we can change the signatures of the meta review to be the SubmissionX/Area_Chairs instead of the anonid, this way any member of this group can sign the note and maxReplies will be limited to 1.

@celestemartinez
Copy link
Copy Markdown
Member

The changes look good to me but if we want to have a single meta review per submissions we can change the signatures of the meta review to be the SubmissionX/Area_Chairs instead of the anonid, this way any member of this group can sign the note and maxReplies will be limited to 1.

But then this also means that if there are multiple ACs , they can all edit the same metareview. I am not sure if this is the behavior we want.

@melisabok
Copy link
Copy Markdown
Member

But then this also means that if there are multiple ACs , they can all edit the same metareview. I am not sure if this is the behavior we want.

True, then the invitee must be the anon AC group.

@haroldrubio
Copy link
Copy Markdown
Member Author

I'll follow up with ARR to see if they would support something like (multiple ACs, single meta-review)

@haroldrubio
Copy link
Copy Markdown
Member Author

Update on the requirements from ARR:

  • SACs need to keep track of the non-responsive AC, so one way (as they have already been doing) is to keep multiple ACs in the AC group
  • There should still only be 1 meta-review, but the meta-review should only be modified by the submitting AC

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ARR: Prevent multiple meta-reviews from being posted

4 participants