Try it: check session proposal review scores before the committee meets

This is the working version of the session review-score tutorial. It reads three CSV files you open or paste and sets aside scores from reviewers who share an organization, an email domain or a copresenter listing with a proposal, flags proposals with too few eligible reviews or reviewers far apart, marks reviewers who score high, low or the same every time, and ranks proposals with ties sharing a rank. It accepts and rejects nothing and does not judge any reviewer or proposer.

Your files

Each file needs a first row with these column names. Other columns are ignored, and their values are never shown. Proposals: proposal_id, submitter_org, submitter_email, copresenters. Reviewers: reviewer_id, org, email. Scores: proposal_id, reviewer_id, score. Separate several copresenter ids with semicolons.

Open the proposals file (optional) Proposals CSV text Open the reviewers file (optional) Reviewers CSV text Open the scores file (optional) Scores CSV text

Limits you choose

Lowest score on the scale

Highest score on the scale

Fewest eligible reviews

Score range that marks a split

Distance from the pool mean that marks a reviewer

Identical scores that mark a flat reviewer

Upper band starts at

Lower band ends at

Free-mail domains that never count as a match (separated by commas)

Every starting number is an example, not a standard. The upper and lower band edges echo one association's guidance to its own chairs on its own five-point scale, and that association says it has no cut-off score. The minimum of three reviews echoes the same association's design. The split range, the distance from the pool mean, the flat-reviewer rule and the free-mail list are house choices with no cited source. Replace each one with what your committee adopts.

Counts

Count	Value

Scores set aside

Proposal	Reviewer	Score	Why

Reviewers

Reviewer	Eligible scores	Mean	From pool	Range	Note

Proposals for the committee

Rank	Proposal	Eligible reviews	Mean	Band	For the committee

How this lab works

Everything on the page runs in your browser. The kit's script runs the same checks from a command line and can check several folders of files in one run, which the page cannot.
It sets aside and does not delete. A set-aside score stays in your file and is listed on the page so a person can compare it with the reviewer's disclosure. A match on organization, email domain or copresenter is a floor, because it cannot see a conflict that none of those fields show.
The download copies ids, not name columns. The committee list has the rank, proposal id, eligible review count, mean, band, flags and the reviewer ids of any set-aside scores, plus empty decision and reason columns. It copies no name, title or email column, so use ids that are not email addresses.
It does not hide names from reviewers. The checks work on ids. Leaving proposer names out of what reviewers see is a separate step that this page does not perform.
A reviewer note is a prompt. A reviewer may score high or low because the proposals assigned to them were strong or weak, and a flat run of scores may be a fair reading.
The sample is synthetic. It is 30 invented proposals, 10 invented reviewers and 91 score rows with problems planted by us, so a clean match shows only that the code does what it says.
Local only. The script is served from this site and the page makes no other request for your files.

Starter kit

The starter kit holds this page to run on your own computer, the same checks as a script, the sample files, a settings worksheet, a pre-meeting checklist and a log for decisions. Free with your email through the form below; the download link appears after you subscribe.