1.0 Title: Test Scoring Services for In-Basket Assessment Tools
Providing professional test scoring services to the E-testing and Test Administration (ETTA) Unit of the Consultation and Test Services (CTS) Division of the Personnel Psychology Centre (PPC) at the Public Service Commission (PSC).
2. Objective
The PSC requires the services of qualified contractors to satisfy the requirements of the PSC for Test Scoring Services for In-Basket Assessment Tools used at the PPC, on an as required basis, in accordance with the general terms of the Standing Offer.
For further information concerning In-Basket Exercise (810), please visit:
http://www.psc-cfp.gc.ca/ppc-cpp/psc-tests-cfp/in-bas…
For further information concerning In-Basket Exercise (820), please visit:
http://www.psc-cfp.gc.ca/ppc-cpp/psc-tests-cfp/in-bas…
3. Background
The PPC is an internationally-recognized leader in the personnel assessment field and offers a range of assessment tools and services to federal government departments and agencies. Clients use these tools to facilitate the selection process and to choose the right candidates to fill a position. The PPC’s test scoring operations are based in the National Capital Region (NCR). PPC psychologists and administrative staff are responsible for training, quality control of scoring activities and test distribution. The workload may vary during the year and scoring work may be distributed as required, depending on the demand for test scoring by PPC clients. The proposed resource acknowledges that the status of certified scorer is no guarantee that he/she will receive tests for scoring on a regular basis, but only that he/she will be included in the group of PPC-certified test scorers.
4. Test Scoring
The proposed resource(s) will score the tests that are received from the Project Authority on his premises or in some other PSC-approved workplace. The proposed resource(s) shall:
a) Collect tests and rating sheets for scoring from the Project Authority, who will consult with the proposed resource to decide on a return date for the scored tests;
b) Read the texts that are written and assess the consistency between these texts and the scoring standard, and detailed rating scales that are provided in the scoring manual;
c) Assess the quality of the texts that are provided;
d) Indicate the ratings for the texts provided on a rating form that is supplied by the PPC;
e) Add up the ratings from each page of the rating form and transcribe the totals into the appropriate boxes on the rating form;
f) Check whether the calculations were done correctly and in accordance with the criteria that are provided in the scoring manual;
g) Return the scored test and the completed rating form to the Project Authority on or before the test return date set along with properly completed invoice; and
h) By phone, email or in person, report any unusual situation (missing pages, text too short, illegible writing, etc) to the Project Authority and attach a sheet clearly summarizing the problem to the copy of the test (see Appendix I (C) - Scorer’s Form: Reporting Specific PPC Test Issues).
5. Return of Tests and Scoring Forms
When the PPC gives a scorer a test for scoring, re-reading or revision following the evaluation performed by one of the quality-control psychologists, the scorer must send via courier services or hand in, in person, the test and signed and dated feedback form to the Project Authority within a maximum of 5 working days. In exceptional circumstances only, the PPC reserves the right to approve an alternate method for handing in tests, provided the measure is temporary and does not compromise the security of protected materials. The PPC can also decide to allow a scorer additional time if they have previously been given a large number of tests to score. If necessary, the scorer will be notified of the deadline and will have to agree to abide by it. Lastly, each time the scorer returns scored or re-read tests, the scorer will submit invoices to the Project Authority.
6. Rescores
As a certified scorer, the proposed resource will occasionally be called upon to rescore tests that have been scored by other scorers, whenever this activity is requested by the Project Authority. The work to be performed is similar to that related to initial test scoring activities, except that the scorer must also complete a feedback form that will indicate:
a) any elements that were missed (unnoticed errors or answers not related to the behavioural measures on the standardized scoring sheet) by the initial scorer; and
b) the first scorer’s degree of adherence to the standard scoring criteria that are provided in the manual (Appendix I Quality control (B) - Rescore Report).
7. Other Related Tasks
The Project authority may ask the proposed resource(s) to offer other services related to PPC activities in order to respond to needs that cannot be completely fulfilled by PPC employees. These services include, without limiting it to, the following functions:
- Research and statistical activities;
- Taking part to developmental modifications and up-to date activities related to measurement tools, related documentation, competency resource guides, etc;
- Taking part in project management; and
- Delivery of evaluation services related to accommodations measures, consultations, seminars, etc.
