Choosing the programme for an international congress.
The method of selecting abstracts for an international congress at which only 15% of submitted papers could be accepted entailed a panel of 12 assessors using their specialised knowledge, but presentation of the abstract was also important is selection. There was only a limited agreement between assessors in arranging abstracts in order of merit, so that a single assessor would be unacceptable. Use of the full panel to grade all abstracts was very expensive, but it could be replaced, without unacceptable injustice, by dividing the work randomly among groups of three selectors.
D003226:Congresses as Topic / Q000191:economics / Q000458:organization & administration*; D003365:Costs and Cost Analysis; D003657:Decision Making; D013223:Statistics as Topic