We are delighted to share more good news from Galway in 2019. Qpercom has been awarded a national tender in Norway to deliver Qpercom Observe to higher education institutions. The tender represents the four major universities in Norway; University of Oslo, Norwegian University of Science and Technology, University of Tromsø (The Arctic University of Norway) and the University of Bergen. It may also include UNIT, the Norwegian Directorate for ICT and Joint Services in Higher Education and Research. The successful outcome of the Norwegian tender comes just after winning the prestigious e-Assessment Award for Best Use of Summative Assessment for Observe.
Themes:
- Using assessment as opportunity to provide meaningful feedback to learners
- Taking the emphasis away from high stakes final exams where learners learn to ‘pass the test’ and instead placing emphasis on continuous assessment/programmatic assessment to allow learners to pursue excellence in all areas of their field
- Bridge the gap between learning and entering the workforce to ensure safe practitioners can contribute in the workforce immediately
- Choose your software partner wisely and one that supports your teaching and learning process
- Improving rest stations and gather information from students
- National online remote OSCE’s nationwide, high technology level, well organised, no room for QPC local self developed solution apparently
- Workshop participation is VSA Very Short Answer questions
- alternative for SBA (Single Best Answer)
- Student free to answer (in short words)
- Examined and Marked online by multiple examiners
- Tried to develop with FRy Practique (failed, not fast enough)
- Not too difficult in ‘multiple examiners’ option in integrated Choice solution’
- Multiple examiners OSCE with ‘Choice station’
- Various publications available
Learnings:
- Video based MMIs/OSCEs have been carried out successfully in Australia for International students and have proven just as valid while reducing costs dramatically
- Poor engagement with stakeholders saw a roll out of Fry Practique in Canada fail completely at the first attempt and staff were engaged fully the following year before a successful rollout so addressing culture change barriers and bringing staff on board as part of change is vital to a successful change of process.
- National Licencing examinations take place in a lot of countries so Qpercom needs to focus on this area along with Volume Recruitment going forward as quicker markets with larger contracts and quicker sales cycles.
- Will trigger changes in the national curriculae
- To be expected in UK approach
- Already lining up VSA’s Very Short Answer questions
- Ottawa Conference is not worth attending in future years with poor traffic to the booth again this time around even worse than Perth.
- Many different options where shared in Workshop around ‘alternative OSCEs’
- EPA, Formative training, Student managed OSCEs, and many more
- Technical Roadmap Qpercom needs to enhance National Licencing Exams worldwide
- Outcome based education, defining graduats outcome by referring to national standard
- Significant changes in skills training educational comparison of QA
- All assessment should be meaningful to the learning (CPvander Vleuten)
- Adding an extra layer to Miller’s Pyramid = TRUST
- QA Australian OSCE group, worthwhile to reply to their email group as many are still on paper……
Summary of Video-based MMI Workshop:
- Use tools like UCAT, MCAT, GAMSAT, GPA, personality test, EQ test, plus work experience/personal statement/portfolio/ references to screen candidates into MMI groups:
- There is a concrete suggestion from NUIG’s Dr Maureen Kelly regarding this ‘video based MMI’ in COVID-19 times….for May…
- SJT is a good means of screening out by delivering online and using alongside MMI results.
- Online MMI via videocall
- Selection is a very expensive process with travel, interviewer training, interview venues, interview days, staff etc…
- Data from those that fall short of selection should be monitored for future career success
- How to test for resilience??
- Patterson 2016 systematic review on MMIs
- Assessor training via podcasts/videos/role plays are very important
- Anchored reading scales are effective for increasing the use of full reading scales
- Interviewer and actor scheduling facility to sign up for sessions they are available for
- Costings:
- Selecting In tools to reduce costs and more targeted MMIs/interviews
- Selecting Out tools to rank candidates to find the best people for the positions
- To request a demo of Observe visit this page.
