1.5.3

Reviews & Decisions

One table per program with every paper's review progress, reviewers, scores, AI report and decision. Read the reviews, record and release decisions, and track conditional accept revisions from the Reviews & Decisions section of the Review tab in the Program Chair Console.

Last updated: 2026-11-15

Purpose

Reviews & Decisions is the last section of the Review tab. It puts everything you need to decide a paper in one row: how many reviews are in, who reviewed it and what they recommended, the average scores, the AI report, the Area Chair's recommendation and the decision itself. You read the reviews and decide in the same place, then release the decisions to authors.

It is a single table with no sub-tabs. Revisions from conditionally accepted papers show in the same rows, under the paper's status.

When you use it

  • During review, to see which papers still need reviews.
  • To read a paper's full review report and its AI report.
  • At the end of review, to record accept, reject or other outcomes for every paper, set conditional accept requirements, and release decisions to authors.
  • After release, to watch for and open revised PDFs from conditionally accepted papers.
  • To email the authors of the papers your filters pick, and to follow every email chain with them: who opened it and who answered.

Walkthrough

Read the table

  1. 1

    Open the Program Chair Console, select your program, click the Review tab, then Reviews & Decisions.

  2. 2

    Each row is one submission. Submission shows the paper number (hover it for the full title and the authors) with the start of the title below it in small text; hover the title for the full text. Submitted gives the day the paper was submitted, in the program's time zone, with Late under it when that was after the due date that applied to the paper (its category, round, and a later non archival date when there is one); hover it for the time and the due date, and click the header to sort by it. Older papers without a recorded submit time show when they were created. Type (Paper, Abstract or Proposal) and Category (such as Full Paper or Short Paper) follow it; click either header to sort by it. When the program asks authors choices (set in Submission Settings), each choice has its own column after Category, the same as in All Submissions: the header is the start of the question (for example Preferred Proceedings) and each cell is the author's answer. Hover either to read it in full, and click the header to sort by it.

  3. 3

    Progress shows the submitted reviews out of the reviewers per paper your program asks for, set in the reviewer assignment rules (3 when unset). Hover it to see how many reviewers are assigned and each reviewer's overall recommendation.

  4. 4

    When AI reports are allowed, the AI column shows the AI score; click it to open the AI report. No paper gets one on its own: click Generate to ask for one. It reads Generating while the analysis runs (usually a minute or two) and Retry if it failed.

  5. 5

    Read the Weighted score (shaded, see the tip below). Hover the column header for what it means, and a score for its scale. The average overall recommendation, dimension and confidence are in the review report and the CSV export. Scales come from the paper's review form, so they differ between forms (for example, ARR dimensions run 1 to 5).

  6. 6

    Actions has these icons: open the paper's Submission page in a new tab (the eye), with its files, details and email chain, where Prev and Next step through the papers listed in the table; open the review report (once a review is submitted), open the AI report (once it is ready), email this paper's authors, and open the paper's Review Page in a new tab (the magnifier on a page), where you see its reviews, discussion and author responses as a chair.

  7. 7

    Email shows the email chain with the paper's authors: a grey envelope when the newest email is sent, blue with 1/2 when authors opened it (one of two here), and an amber reply arrow when an author wrote last and is waiting for an answer. Hover it for the newest email and who opened it; click it for the whole chain. Papers never emailed show a faint envelope. An automatic email sent to each author separately (such as Submission Received) counts as one email, opened when any author opened their copy.

  8. 8

    The shaded Decision column, at the right end, shows the state (Pending, Approved, not released or Released), the Area Chair's recommendation as AC N when there is a meta review, the decision type dropdown with its Apply, Release or Decide & Notify button, and any revision.

  9. 9

    Click a column header to sort; click again to flip the direction. The columns follow the window: the Submission column takes the spare width, long titles and categories are shortened (hover to read them), long paper IDs wrap onto a second line, and the Decision column is as wide as its dropdown and decision names need. Only when the window is narrower than that does the table scroll sideways, with a scroll bar above it as well as below.

Filter, search and export

  1. 1

    Pick a Type (Paper, Abstract, Proposal) to list only that type; the Category dropdown then offers that type's categories.

  2. 2

    Use the Reviews chips (All, Needs reviews, Complete) to find papers with fewer reviews than required, and the Decision chips (All, Pending, Accepted, Rejected, Released) to focus on a stage. Each chip shows its count. Decisions that are recorded but not yet released are counted on the Release N Approved button. Papers their authors withdrew are not counted in these chips. When the program has any, a Withdrawn chip lists them with the date of withdrawal (and any decision recorded before it); they take no decision, and the footer shows how many there are.

  3. 3

    Use Submitted beside Type and Category to filter by submission date: Before the due date, After the due date (late papers), or Between dates with a first and last day (counted in the program's time zone). Each paper is checked against its own due date, so papers in categories or rounds with different deadlines are each judged fairly.

  4. 4

    Use Email to list papers by their email chain: Answered, waiting for us (an author wrote last; the count is in the option), Emailed, not opened, or Never emailed.

  5. 5

    Type in the search box to find a paper by number or title.

  6. 6

    The table shows 25 papers a page. Change Rows below the table to 50 or 100, and use the arrows to move between pages. Changing a filter, the search or the sort goes back to page 1.

  7. 7

    Click Export CSV to download the papers shown, with when each was submitted and whether that was after the due date, their reviews, scores, AI score, AC recommendation and decision. Reviewers appear as Reviewer 2 (R042), never by name: the number authors see on that paper, then the reviewer id in this program.

Read a review report

  1. 1

    Click the review report icon in Actions. The report window opens with summary chips for the four scores (Avg overall, Avg dimension, Avg confidence, Weighted). Beside the paper number in its title bar, View Submission opens the paper's Submission Details, and AI Report (when AI reports are allowed and one is ready) opens the paper's AI report. Each opens in a separate browser window, so you can move the report, the paper and the AI report to different monitors. Clicking again brings the same window forward.

  2. 2

    The Area Chair's meta review, when there is one, comes first.

  3. 3

    The score matrix lists Overall recommendation, Confidence and each dimension of the review form, with one column per reviewer and an Average column. Each column is headed by the reviewer number (for example Reviewer 3 (R016)), with the reviewer's name in small type underneath. Only the chairs see the names.

  4. 4

    Below it, each reviewer's comments are labelled as in the review form. Comments meant for the chairs only are marked Confidential (AC and PC only). Click a reviewer's title bar to collapse that section; click it again to expand it.

  5. 5

    Each reviewer's title bar has two scores. A reviewer may write a careful review of one paper and a weak one of another, so you can rate both. This review is the chairs' score of this one review of this paper; click Rate this review (or the score) to give 1 to 5 stars and an optional note. Overall is the reviewer's score for all their work in the program, with the average and the number of chairs who rated them; click it (or Evaluate Reviewer with the award button, when no chair has rated them yet) to open the Evaluate Reviewer window, the same one as in View by Reviewer under Reviewer Assignment, so both places always show the same Overall. The scores are private to the chairs; reviewers never see them.

Record and release a decision (Full tier)

  1. 1

    In a paper's Decision column, pick an outcome from the dropdown: Accept, Conditional accept or Reject, under the names your program uses. When the program allows it in Settings → Review Configuration → Decisions, the dropdown also offers Accept as <category> (a lower category of the same program), and for papers whose authors named workshops, Reject, no transfer (a plain reject moves the paper to the author's workshop choice). Papers also offer Desk Reject, for format or quality problems a person must judge; it is released like any decision, with the Desk Rejection Notice. Desk rejected papers, including those from Desk Screening, stay in this table and count as rejected.

  2. 2

    If you choose Conditional Accept, fill the requirements window: set the Revision Deadline (it cannot be in the past) and the Required Changes text. The email preview updates as you type. Save with Set Conditional Accept.

  3. 3

    Apply the decision with the row's Apply button, or apply everything at once with Apply N Decisions at the top right. Applied decisions move to Approved but are not yet visible to authors.

  4. 4

    When you are ready to notify the author, click Release on a row. The Release the decision window opens on Preview email: the email the author gets, with From, Reply-To, To and Subject, exactly as it will be sent. Replies go to the program's contact email, else the conference's. With neither set, they go to a no-reply address and the email tells the author to reply in their AirBalloon Webmail instead; set a contact email in Settings if authors should be able to reply by email.

  5. 5

    Pick another Template if you want one: the templates of the decision's outcome (the acceptance templates for an accept, the rejection notice for a reject, the desk rejection notice for a desk reject) and the Built in decision email. The note next to it says whether the text is this program's template, the conference's, or the default. Under Edit message you edit the template, not the finished email: names in double braces, such as {{authorName}} or {{paperTitle}}, are filled in for each author when the email is sent. Edit message shows the email as the author sees it, design and all, and you edit it in place: click into the email and type. Select words to change their font, size or colour, make them bold, italic or underlined, turn lines into a list, or click the link button to make them a link (type the web address and click Apply). The design stays as it is. The Undo and Redo arrows (or Ctrl+Z and Ctrl+Y; Cmd+Z and Shift+Cmd+Z on a Mac) step back and forward through your changes, also after a look at Preview email. Click a name under Insert to add it at the cursor. Your changes apply to this paper; switch back to Preview email to see the email with the real names and values. The Built in decision email has no template, so there you edit this one email directly.

  6. 6

    To keep your edit for later papers, use Save as a new template under the message (or click Save as a new template next to Preview email, which takes you there). Type a name and click Save on that line. The subject and the email, formatting included, are kept. It is saved for this program only, and the existing templates (in Settings, Email Templates) are not changed. Your template then appears in the Template list, marked (saved), whenever you release a decision of the same outcome, for every chair of the program. Release still starts on the usual template; pick yours from the list. To change a saved template, pick it, edit the email in Edit message and click Save on the Save current template line: the template keeps the new subject and message for later papers too. To remove a saved template, pick it and click Delete this saved template.

  7. 7

    Click Release and send. Releasing changes the paper's status, emails every author of the paper and locks the decision. The submitting author and each co-author get the email on their own (no one sees another's address), co-authors without an AirBalloon account included; To in the preview lists them all, and the greeting names them all. Authors with an account also get one copy in their Webmail, which is kept in the paper's Email Correspondence. Cancel leaves the decision approved and unreleased.

  8. 8

    To release every approved decision at once, click Release N Approved at the top. The Release N Decisions window has one tab per kind of decision, for example Accept, Long Paper (5) and Reject (8), and lists the planned notification dates. Each tab works like the single Release window: pick a Template, change it under Edit message, save it as a template, and check it under Preview email, which shows one of the papers in that group. Names in double braces are filled in for each paper. The Built in decision email can be edited too, for example into one general email. Left unchanged, each paper gets its own; once edited, every paper in the group gets your text as it is, so replace the shown paper's name, title and number with names from Insert. Click Release N and send to release them all, each with its tab's email.

  9. 9

    A released decision is locked. To change the category an accepted paper is accepted as (for example a full paper that should be a short paper), click the small two arrow icon next to the lock (hover it to see Change category). It is kept small on purpose: a released decision should rarely change. Choose the New category (the paper's own category or one of the program's Accept as categories) and give a Reason, which is kept for the chairs and not sent. The window shows the author's email for the new category, with Edit message, Preview email and Save as a new template as in Release. Click Change and send: the paper follows the new category (its dates after acceptance and the camera ready date move with it), the author gets the email, a copy in Webmail and a notification, and the decision stays released. There is no second Release. Accepting a rejected paper, or rejecting an accepted one, is not possible after release.

  10. 10

    Abstracts and proposals (an Abstract or Proposal category) have no peer review: their review columns read Chairs decide. Pick Accept or Reject and click Decide & Notify. The decision is recorded and the Release the decision window opens with the author's email, on every tier; the author is notified when you click Release and send.

Record a decision on the Light or Standard tier

  1. 1

    Open the Review tab; on these tiers it holds only Reviews & Decisions. The table runs in basic mode: there are no review columns, and the decision dropdown offers Accept and Reject.

  2. 2

    Pick an outcome, then click Decide & Notify on the row and confirm in the Send Decision to Author window. This records the decision and opens the Release the decision window: preview the author's email, edit it if you like, and click Release and send. If you cancel there, the row reads Approved, not released and has a Release button for later.

Panel applications

A panel program (its Abstract or Proposal submission asks applicants to pick Panelist, Moderator or both) takes applications from people who want to be a panelist or a moderator. There are no reviewers: the Review tab holds only Reviews & Decisions, and the program has no Camera-Ready tab.

  1. 1

    The table lists one row per application: Applicant (by name, since panelists are public participants), Role asked (Panelist, Moderator or either), Panel and preference, Perspective (its first line; hover for the full text), Profile and Decision. There are no score columns.

  2. 2

    Click the application number under the applicant's name to open the application in a window you can drag by its title bar. The Submission tab shows everything the applicant submitted; the Applicant Profile tab shows their User Profile. Prev and Next in the title bar step through the applications in the table's order.

  3. 3

    Panel and preference shows the panels the applicant ranked, first choice first. In a panel sub-program (one panel per program) it shows this panel and where the applicant placed it among their applications, such as 2nd choice.

  4. 4

    Profile reads Profile incomplete when the applicant's profile no longer has what the call asks for (for example they emptied their bio after applying). Hover it for the missing items.

  5. 5

    The Decision dropdown offers only Accept and Reject. Accept opens Accept on panels: tick each panel to accept the applicant on, and pick their role on it (prefilled with the role they asked for; Panelist when they picked both). At least one panel must be ticked. In a panel sub-program the window asks only for the role. Edit panels under the decision opens it again until the decision is released.

  6. 6

    Click Decide & Notify, then check the email in the Release the decision window and send it. An accept uses the Panel Selection Notification, listing each panel with the role on it; a reject uses the Panel Application Notification.

  7. 7

    On release, an accepted applicant becomes a Panelist of the program and gets a task to confirm their panel bio. Complimentary registration is not granted automatically. Panelists are not listed under Authors, get no camera ready step, are left out of the proceedings and get no talk in the schedule: the panel is a session of its own.

In a panel multi-program (every active sub-program is one panel), the Multi-Program Chair Console → Decisions tab also lists every panel's applications in one table, with a Panel column and Group by applicant, so you see all of one person's applications together. Each application is its own decision there, with the same Accept window asking only for the role.

Transfers to workshops

When Settings → Review Config → Decisions allows transfer to workshops, authors of this track may name up to two workshops when they submit. Only papers whose authors named a workshop can move: for them the Decision dropdown adds Reject, no transfer. Papers without a choice show the usual options, and a note above the table counts the papers that have one.

  1. 1

    The Decision cell lists a paper's workshop choices. Pick Reject and it reads Reject, goes to the first workshop: when you release, the paper moves there instead of ending, and the author is told where it went. Pick Reject, no transfer to end the paper here (for example a policy breach found after review).

  2. 2

    After release the paper stays in this table with Moved to the workshop. It counts in your submitted total, never as accepted, and once in the conference wide totals.

  3. 3

    In the workshop, the paper arrives as a new submission marked Transferred from the track, and the workshop chairs get a task. The history icon in Actions opens the reviews it had before (signatures only, nothing confidential). Decide from them, or assign your own reviewers first. A reject there moves it on to the author's second choice, unless you pick Reject, no transfer.

Email authors and follow the chains

  1. 1

    Filter the table to the papers you want (for example Released and Rejected, or Submitted after the due date), then tick them in the first column. The header box ticks every paper on the page; when it does, Select all N matching the filters ticks every paper the filters show, on every page.

  2. 2

    Click Email selected (N), or the envelope in a row's Actions for one paper. The compose window opens with the author templates.

  3. 3

    Choose Recipients per paper: All authors with an account (the default) or Submitting author only. The window says how many authors that is, and warns about papers where no author has an account (those are not sent). When some co-authors have no AirBalloon account, you can tick Also email the co-authors without an AirBalloon account; they get the email only, and their replies do not come back to Webmail.

  4. 4

    Write the message. {{paperNumber}}, {{paperTitle}}, {{decision}} (the released decision, empty before release) and {{authorName}} (the paper's authors) are filled in for each paper. Click Preview to see the email exactly as one paper's authors get it, with those filled in and who it goes to; with several papers selected, pick another under Paper. To use the message again, save it with Save as a new template under the message; it then appears in Template under Saved for this program. The decision emails you saved when releasing are in the same list, under Saved in Release the Decision; change or delete those in the Release window. Their placeholders, such as {{submissionNumber}}, {{acceptedCategory}}, {{comments}}, {{reviews}} or {{conferenceDate}}, are filled in for each paper as in a released decision email (the decision values once it is released). Click Send.

  5. 5

    Each paper gets its own email, to its own authors only: authors never see other papers or each other's addresses. The message is filed in each author's Webmail and in the paper's Email Correspondence, and each author gets it by email too. Up to 5 papers are sent at once; more are sent in the background, and you can close the window.

  6. 6

    Click Sent emails to see every email sent to authors from here, by month, with how many went out. Released decision emails are listed too, one line per day. Click a send for its papers: Sent or Not sent, Opened (how many of the authors), and Answered (when an author wrote after it). The chips Not sent, Not opened and Answered narrow the list; Open chain opens that paper's correspondence.

  7. 7

    In the chain window, every message about the paper is grouped by conversation. Use Reply to answer the authors; the paper's Email column then turns back from amber.

Track conditional accept revisions

  1. 1

    When an author submits a revision, every chair who makes decisions in the program, the paper's Area Chair and Senior Area Chair, and its assigned reviewers get an email. In the table, the paper's Decision cell shows Revision vN with its state (awaiting review, under review, approved, needs changes). A revision awaiting your review is shown in bold blue.

  2. 2

    Click the Revisions chip among the Decision filters to list only papers with a revision; the chip says how many are waiting for review.

  3. 3

    Click Revision vN to open the paper at its review page (hover it for the revision deadline), or the download icon next to it for the revised PDF.

  4. 4

    On the review page a chair, the paper's Area Chair or Senior Area Chair picks Approve Revision, Request Changes (a comment is required), or Reject (a comment is required, and a second click confirms). The author gets an email and an inbox message. After Request Changes the author revises and submits again, as many rounds as needed. After an approval, set the final decision here and release it; the author then gets the camera-ready step.

Tips

How the scores are computed

All scores use the paper's submitted reviews; meta reviews are left out. Avg Dimension maps each dimension rating onto its own range, averages them per review, then over the reviews, and shows the result on the scale of the form's first dimension. Weighted is built in two steps. First, each review's score is 80% of its overall recommendation and 20% of its dimension ratings (both mapped onto 0 to 1; just the overall when a review has no dimension ratings). Then the reviews are averaged with a confidence weight that runs from 1.0 for the lowest confidence to 1.5 for the highest, so a confident reviewer counts more without dominating (a review without a confidence weighs 1.0). The result is shown on the overall scale. Example on the Standard form: reviews of overall 5, confidence 4, dimensions 3 and overall 3, confidence 2, dimensions 2 give Avg Overall 4.0, Avg Dimension 2.5, Avg Confidence 3.0 and Weighted 4.0.

Approve while you work, release when you are sure

On the Full tier, applying a decision only marks it Approved; authors see nothing yet. Work through every paper, check the set, then release them together with Release N Approved. The author's paper status only changes, and emails only go out, at release.

Releasing notifies authors and is final

Releasing a decision changes the submission status, sends the notification email and locks the row: the dropdown and edit controls are disabled. Make sure conditional accept requirements and deadlines are correct before you release. Check the email in the Release the decision window before you send it; there is no way to call it back.

What opened and answered mean

Opened means the author opened the message in AirBalloon Webmail; there is no tracking in the email itself, so reading only the email does not count. Answered means an author replied in AirBalloon (in Webmail or in the paper's correspondence). Answers sent from an ordinary mailbox to the committee's address do not join the chain. The table does not update by itself: click the refresh button (the circular arrow) next to Sent emails to reload the rows and the email status without reloading the page.

Who sees AI reports

Program chairs, co-chairs, conference leadership, Senior Area Chairs, Area Chairs and admins can generate and read AI reports. Reviewers, PC Members and authors never see them. Program chairs can generate AI reports in the program's review settings is on by default; turning it off hides the AI column for everyone. Treat the AI score as a second opinion, not the verdict.

Reviewer numbers on a paper

A reviewer gets their number on a paper (Reviewer 1, Reviewer 2) when they are assigned to it, and keeps it. Taking a reviewer off a paper never renumbers the others, and the number is never given to anyone else on that paper, so the labels authors read in the reviews and in their emails stay the same. Authors never see the reviewer id (R042), which would show that one person reviewed several of their papers.

Confidential comments stay with the chairs

Comments marked Confidential (AC and PC only) are for chairs and Area Chairs. Authors never see them, so they are where reviewers leave candid notes.

Papers you wrote

If you are an author of a paper, another chair of the program decides it, releases its decision, and reviews its revision or appeal; the app refuses these for you and says so. Release N Approved releases the rest and lists your papers as not released, for another chair to release. When nobody else holds that right in the program or conference (an event run by one person), you can act on your own paper.

Older links still work

Links that point at the former Reviews or Decisions sections open Reviews & Decisions. Each decision records the chair who applied it and the chair who released it, taken from your sign in.

Withdrawing a panel acceptance

If a released acceptance is changed to a reject (for example after an appeal), releasing the reject sets the person's Panelist role in that program to inactive. A complimentary registration already granted is not taken back.

Open the Program Chair Console