Education and training services

Tender description

NHS South of England Procurement Services (SoEPS), acting on behalf of Health Education England (HEE — the Commissioner) are commencing a tender for the provision of Foundation Programme (FP) Assessment. HEE are seeking to procure a provider organisation(s) [Provider or Providers], to provide a robust and relevant assessment method for applicants to the UK Foundation Programme (UKFP). This is with the aim of incorporating technological advancements and competitive selection methodology to provide a valid and reliable tool, which will allow for the ranking of applicants for the purposes of allocation. The method must also provide a means of withdrawing applicants who do not meet the national person specification. The tool must be flexible to allow applicants to access the tool in the UK and if possible, outside of the UK. Lot 1 FP Assessment content must be a test for suitability to be employed as a doctor in accordance with the national person specification. This should include professional attributes. It is important to emphasise that this is not a knowledge test or test of cognitive ability. Evidence base Key criteria include providing an evidence base for reliability and validity of the assessment. The assessment must be psychometrically sound. It is likely to be an SJT/scenario-based test. The use of video and images should be explored. The use of different question types should also be explored. Item development and assessment papers There needs to be an equivalence of multiple test forms used in all test windows and randomisation of items order within each test is preferable to reduce the risk of memorisation of candidate responses. Additional item development and piloting for each application process (annual cycle) would be preferred. Practice papers must be made available to applicants prior to scheduled sittings of the test, with a mechanism for scoring. Ranking Scores must be generated to three decimal places to reduce the effect of tied scores. Analysis Test equating will be required as well as post-psychometric analysis, which should include information about application behaviour in completing the test in the form of Item Response Theory (IRT) and Differential Item Functioning (DIF) reports. The analysis information should provide supporting information to assist with the exceptionally low scoring review and/or selection process if necessary, to provide a cut-off score and for the in the event of oversubscription. There needs to be a mechanism for excluding applicants who do not meet the person specification. Security Secure storage of FP Assessment items and the management of candidate identity are essential requirements. The maximum value of the contract over 4 years (inclusive of the 10 % within the first year) is: Lot 1 — 900 000 GBP (inclusive of VAT). Lot 2: Delivery The Authority would be willing to consider a variety of approaches, including online, offline and paper-based options. Evidence Base It is likely to be an SJT/scenario-based test. The option for delivery of video and images should be available. Logistics and invigilation Multiple sittings of the assessment should be made available within a timescale of December – January each year, for example, this could be 6 windows over the course of 3 days. Consideration of how and where applicants will be able to sit the assessment is an important component, e.g. test centres, own location, invigilated centres, etc. This needs to allow for flexibility to enable applicants to sit the assessment from overseas/out of the UK and to mitigate the need for travel. A secure process of invigilated delivery is required to ensure to applicant is the person undertaking the assessment. Enforced time limits must be applied for completion of the assessment. Registration There must be a facility the manage the process of applicant registration through an online system. Applicants should also be able to amend online bookings for the assessment in the event of extenuating circumstances in advance of the test. The process must adopt a “fit to sit” criteria, i.e. once an applicant starts the assessment, there should be no option for applicants to reschedule at this point. Practice papers must be made available to applicants prior to scheduled sittings of the test, with a mechanism for scoring. Reasonable adjustments Management of requests for reasonable adjustments in accordance with the UKFPO’s criteria is essential, for example, maximum time allowed for reasonable adjustments is 25 %, including rest breaks, etc. Management of incidents Resolution of incidents during the time of the assessment(s) should be included in any proposal for delivery. Reports of any incidents should be completed immediately after the scheduled assessment. The maximum value of the contract over 4 years (inclusive of the 10 % within the first year) is: Lot 2 — 1 500 000 GBP (inclusive of VAT).