Finding the evidence for the Capability Rating Scales
The Capability Evidence Table
Please read this bit first - click on the tabs in order
The Capability Rating section is perhaps THE MOST IMPORTANT area of your Educational Supervision Report. Remember, you Ed Supervisor and the ARCP are ASSESSING and making a judgement about you from this Capability Rating Scale. It is incredibly important – as important as your AKT and RCA/CSA exam – so fill it out carefully with due thought and consideration. If you follow the guidelines here, you will be fine. So read all the guidance in this section first.
Remember – the purpose of this rating scale: for you to provide evidence of performance in the 13 Professional Capabilities – nothing more and nothing less. Now, if we focus on the term evidence, there are two types of evidence that you can provide – quantitative and qualitative. Both are different ways of providing a measure on the same thing – one is NOT better than the other. It’s like looking at different windows into a particular room to get a good feeling of what it is really like. It’s great if the view from each window tallys up with one another (a process called triangulation). And one window might provide little bits of “extra information” that the other room failed to provide. By looking at BOTH windows (the quantitative and the qualitative) – you get a picture that is far more comprehensive, inclusive complete and reliable that just looking at one window in isolation. It is richer, deeper and more meaningful. That’s all that ARCPs want – a true, deep and meaningful picture of how you are progressing in terms of your training.
The Capability Evidence Table
Please click on a capability – cut and paste the contents (except the definition reminder) into the Capability Rating boxes in the ePortfolio.
Then… just fill in the blanks. Train the trainee to do this. By the way, items in blue provide greater evidence that those in black.
Try and pack as much evidence as possible so that one can step back and make an overall opinion as to whether the trainee is meeting expectations or not.
Reminder: Fitness to Practise = the doctor’s awareness of when his/her own performance, conduct or health, or that of others, might put patients at risk and the action taken to protect patients. The Fitness To Practice competency is rarely witnessed, but can be probed through CbD.
- CBD – item (10) Fitness to practise:
- CSR – under ‘Professionalism’ – with respect to the trainee’s conduct, performance and health, the CS says…
- MSF – Themes around trainee’s conduct, performance and health are…
- Log entries – select ones that show STRONG evidence.
Reminder: Practising Ethically = with integrity and a respect for diversity.
- CBD – item (9) Maintaining an ethical approach:
- CSR – under ‘Professionalism’ – ethical themes are…
- MSF – under ‘professional behaviour’, ethical themes are…
- Log entries – select ones that show STRONG evidence. In particular: Clinical Case Reviews, LEAs/SEAs, Reflection on feedback (esp complaints), QIA, Leadership/Management/Professionalism
Reminder: Communication & Consultation Skills = communication with patients, and the use of recognised consultation techniques.
- COT – last item ‘Overall Assessment of Performance’:
- AudioCOT – last item ‘Overall Assessment of Performance’:
- CEX – item 3 Communication skills:
- RCA/CSA – this trainee has passed which is a good indicator that a trainee’s communication skills were, on the whole, good enough. The score for IPS was x out of y
- PSQ – communication skills themes are…
- CSR –under ‘Communication’ – communication themes are…
- MSF – following communication skills themes emerge…
- Log entries – select ones that show STRONG evidence. In particular, look at Clinical Case Reviews.
Note about COT: Most items in the COT are about Communication Skills – especially items (1) patient contribution, (2) cues, (3) psycho-social context, (4) ICE, (8) explanations, (10) patient involved & (11) shared understanding. So look at these individual items – from the mapping sheet – and see how the trainee is doing. But, rather than writing about each item, write in terms of the “Overall Assessment of Performance”. If overall assessment has been marked as good in a COT, then surely the consultation skills must of been good enough. Write something like “In terms of Overall Assessment of Performance: 7/9 COTs marked as at or above expected level and 2/9 below expected level”)
Note on AudioCOT: Again, as most items in the audio-COT are about Communication Skills, especially items (1), (2), (3), (4), (5), (6), (9), (10), (11), (12). So, rather than writing about each item, write in terms of the “Overall Assessment of Performance”.
Reminder: Data Gathering = the gathering and use of data for clinical judgement, the choice of physical examination and investigations, and their interpretation. Clinical data rather than social data.
- CEX : item (1) history: item (2) examination:
- COT – item (5) Includes/excludes significant condition: ; item (6) Examination:
- Audio-COT: – item (3) Identifies the reason for the call: ; item (7) History Taking:
- CBD – item (2) data gathering & interpretation:
- RCA/CSA – this trainee has passed which is a good indicator that a trainee’s Data Gathering skills were, on the whole, good enough. The score for DG was x out of y
- CSR – under ‘Clinical Assessment’ the CS says…. The ‘Level of Supervision’ requires is reported as…
- MSF – under Clinical Performance, comments around data gathering are:
- Log entries – select ones that show STRONG evidence. In particular, look at: Clinical Case Reviews, LEAS/SEAs & CEPs.
Reminder: CEPS = sny reference to the doctor’s ability to perform clinical examination and clinical procedures/investigations.
- CEPs –
- COT – item (6) appropriate physical or mental examination:
- Mini-CEX – item (2) physical examination skills:
- CSR – under ‘Clinical Assessment’ – the CS says the following about examination skills…
- MSF – the following comments are made about examination skills…
- Log entries – select ones that show STRONG evidence. In particular, look at Clinical Case Reviews & CEPS.
Reminder: Making Decisions = a conscious, structured approach to decision making. taken to protect patients. The trainee must show not only his or her decision, but the thinking behind that decision. Including diagnosis.
- CBD – item (3) Making diagnosis/decisions:
- COT – items (6) Appropriate examination: item (7) Appropriate working diagnosis:
- AudioCOT – item (8) appropriate working diagnosis: item (9) creates an appropriate, effective treatment plan: item (11) safety netting/FU:
- CEX – item (4) clinical judgement:
- CSR – under ‘Clinical Assessment’, ‘Management of Patients’, ‘Context of Care’ the CSR says the following about Decision & Diagnosis skills… The ‘Level of Supervision’ required is reported as…
- MSF – under Clinical Performance, themes around Diagnoises/Decisions are…
- Log entries – select ones that show STRONG evidence. In particular, look at: Clin Case Reviews, LEAs/SEAs, Leadership/Management/Professionalism & Prescribing.
Reminder: Clinical Management = the recognition and management of common medical conditions in primary care.
- CEX – item (7) overall clinical care:
- COT – item (10) Appropriate management plan & FU:
- AudioCOT – item (9) creates an appropriate, effective mutually acceptable treatment plan:
- CBD – item (4) Clinical management
- RCA/CSA – this trainee has passed which is a good indicator that a trainee’s clinical management skills are, on the whole, good enough. The score for CM was x out of y
- AKT – this trainee has passed which is a good indicator that a trainee’s clinical management skills are, on the whole, good enough. The score for clinical questions was: x out of y
- CSR – Under ‘Clinical Assessment’, ‘Management of Patients’, ‘Context of Care’ the following Clinical Management themes emerge… The ‘Level of Supervision’ is reported as…
- MSF – Under Clinical Performance, the following ‘clinical management’ themes emerge…
- Log entries – select ones that show STRONG evidence. Nearly all types of Learning Logs will often be about the management of a condition in primary care.
Reminder: Managing Medical Complexity = aspects of care beyond managing straightforward problems, including the management of co-morbidity, uncertainty, risk and the approach to health rather than just illness.
- CBD – item (5) Managing medical complexity:
- Log entries – select the ones that show STRONG evidence. In particular, look at : Clinical Case Reviews, LEAs/SEAs, Leadership/Management/Professionalism & QIA.
- CSR – Under ‘Management of Patients’ & ‘Context of Care’ the CS says…
Reminder: Working with Colleagues = working effectively with other professionals to ensure patient care, including the sharing of information with colleagues. The ‘performance’ of working with colleagues is best reported by colleagues themselves i.e. through MSF.
- CBD – item (7) Working with colleagues in teams:
- MSF – Under Professional Behaviour , ‘working with colleagues’ themes are…
- CSR – under ‘Working with colleagues and in teams’, the CS says…
- Log entries – select ones that show STRONG evidence. In particular, look at: Clinical Case Reviews, Reflection on Feedback, Leadership/Mx and Professionalism & QIA.
Reminder: Performance, Learning & Teaching = maintaining the performance and effective continuing professional development of oneself and others.
- Learning Logs: Academic Activity– Audit, Projects, PDSAs etc.
- Other Log entries – select ones that show STRONG evidence. In particular, look at: Supporting Documentation/CPD, LEAs/SEAs, Reflection on Feedback, Leadership/Management/Professionalism, QIA & Prescribing.
- CSR – under ‘Professionalism’ the CS says the following things about this trainee as a learner…
- MSF – under ‘professional behaviour’ and/or ‘clinical performance’, the following themes emerge about this trainee as a learner…
Reminder: Organisation, Management & Leadership = taking responsibility for organising oneself, developing systems to manage one’s workload, taking leadership in managing others or particular areas, bettering systems of care, engaging with IT systems beyond what is routinely expected.
- CBD – item (6) Organisation, Management, Leadership:
- Log entries – select ones that show STRONG evidence. In particular, look at: Clinical Case Reviews, LEAs/SEAs, Leadership/Management/Professionalism & QIA.
Reminder: Practising Holistically = the ability of the doctor to operate in physical, psychological, socioeconomic and cultural dimensions, taking into account feelings as well as thoughts. Don’t forget, this item now includes promoting health at opportunistic moments. It also includes a wider need to always survey and protect patients – safeguarding.
- COT – item (3) psychosocial context: ;item (5) Pt’s health understanding:
- AudioCOT – item (5) Places complaint in psycho-social contexts: ;item (6): Explores ICE:
- CBD – item (1) Practising holistically:
- PSQ – item (4) Interested in you as a whole person: ;item (5) Fully understanding your concerns:
- RCA/CSA – this trainee has passed which is a good indicator that a trainee’s ‘practising holistically’ skills are, on the whole, good enough. The score for IPS was x out of y
- CSR – under ‘Context of Care’ the CS says the following about this trainee’s “practising holistically” skills…
- Learning Logs – select ones that show STRONG evidence. In particular, look at: Clinical Case Reviews & LEAs/SEAs. Safeguarding entries/courses.
Reminder: Community orientation = the management of the health and social care of the practice population and local community. Community orientation only comes to life when we look at the impact of disease/provision of health care in the wider patient context. This is where the NOE of audit work or engaging in a project that looks at the patient population becomes invaluable. Incidentally, these are often the best ways of learning about this element of the curriculum.
- CBD – item (8) Community orientation:
- Learning Logs – Academic Activity: like audits, projects, PDSA cycles, gap analysis etc
- Other Learning Logs -select ones that show STRONG evidence. In particular, look at: Clinical Case Reviews, LEAS/SEAs, Leaderhip/Management/Professionalism & QIA
- CSR – under ‘Context of Care’ the following themes around Community Orientation emerge…
|Communication and consultation skills||•||•||•||•||•|
|Data gathering and interpretation||•||•||•||•||•|
|Making a diagnosis/decisions||•||•||•||•||•|
|Managing medical complexity||
|Primary care admin and IMT||
|Working with colleagues and in teams||•||•||•|
|Maintaining performance, learning and teaching||•||•||•|
|Maintaining an ethical approach||•||•||•|
|Fitness to practise||•||•||•|
What evidence do I use for the various capabilties?
Before an ES review, both the trainee and the Ed Supervisor are required to rate the trainee against the 13 Professional Capabilities – and then one has to justify the rating with evidence. This helps others, like ARCP panels, be reassured that the rating is grounded in evidence rather than ‘loose opinion’. If it is written up poorly, then ARCP panels have to go searching for that evidence, and may not find it – because it buried deep within the ePortfolio somewhere – and as a result, the trainee gets an unsatisfactory grade. So, the rating scales is an OPPORTUNITY to show case yourself – you know your ePortfolio like the back of your hand – so use that familiarity to prove that you are good enough and enable ARCP panels to sign you off effortlessly.
The rating scale section is perhaps the most important area of Educational Supervision (and ARCPs pay particular attention to it). It is also one of the hardest bits of Educational Supervision and a lot of people have difficulty with the write up. This page will show both trainees and Educational Supervisors to write it up in the most optimal way – to make life easier for everyone! If the ES and ARCP panel are impressed with your write up – how will that make you feel?
Here are two Professional Capability write ups from one of our trainee’s ePortfolio which I was incredibly impressed with. Have a read and compare it with what you currently do. Is there anything you can learn from it to make yours even better? Remember, when you are providing evidence for the Capability Rating Scales, you are meant to be “showing yourself off” to panel members who do not know you! A bit like in a job interview – where you are selling and proving your worth. This is the same – so why would you want to do it quickly and undersell yourself? Spend time and write it up with care, thought and consideration. Impress the many people who will be reading it (some of whom you will not know – but will be making a decision about you as to whether you move up an ST grade or not in your GP training).
COMMUNICATION & CONSULTATION SKILLS
- COTs – 8 out of 9 COTs have been marked as “Competent for Licensing”.
- My PSQ was very good in all areas. Patients thought I allowed them to speak, tried to really understand their problem and left satisfied. Mean score generally 5 for most items and Median score generally 6.
- CSR – under “Communication” says I regularly explore a patient’s ideas, concerns and expectations. Also comments “excellent at recognising the impact of problem on a patient’s life”. And “generally makes good management plans in partnership with the patient”.
- MSF themes – ‘good communicator’, ‘explains things well’, ‘good at communicating treatment plan’.
- 06/05/2019 Learning log: Taught medical students consultation models
- 30/01/2019 Learning log: Antibiotics wrongly prescribed by another GP
- 10/05/2019 Learning log: Gentleman with unexplained back pain and lots of worries
Suggested Action Before Next Review
- Maybe now try and look at difficult consultations and advanced consultation techniques. Start by finding a course on handling difficult consultations – and then put that into practise?
MAKING A DIAGNOSIS/DECISIONS
- CBDs: for item Making Diagnosis/Decisions = 9/11 C, 2/11 NFD, 1/11 IE
- COTs: (9 done in total)
item 6 appropriate examination = 6/9 C, 2 E, 1 NFD.
item 7 Appropriate working diagnosis: 9/9 C
- Previous CSR suggested to try and work more independently and to balance when to seek reassurance from others. Current CSR comments are that I meet expectations for diagnostics items, appropriate differential diagnosis and refers appropriately with specific comments stating “clinically very good”, and “does not over or under investigate” and “more self-confident and less reliant on others”.
- MSF themes around having good clinical knowledge, explores differential diagnosis very well, good at knowing when to ask for help, thinks laterally when needed
- 30/04/2019 Learning log: The girl who was taking the pill incorrectly
- 20/03/2019 Learning log: Home visit man with haematuria – what next?
- 25/04/2019 Learning log: Training in telephone triage
Suggested Action Before Next Review
- I feel I have made incredible progress in terms of coping with uncertainty over the last 12 months. I would like to build on this further – perhaps read Tim Crossley’s book on ‘I Don’t Know What It Is But I Don’t Think It’s Serious’ (confidence and decisiveness in primary care).
Can you see that…
- These write-ups are concise and specific. As a result, they are not particularly long. Long write-ups usually indicate vagueness or waffle!
- There is both quantitative and qualitative evidence within this write-up.
- At the end, the trainee is quite specific about how they plan to build on each competency in the near future.
Can you do something similar? I’m sure you can. Speak to your Educational Supervisor or GP Trainer if there is anything here that confuses you or if there is something you want more help with.
Action Points for each Capability
All trainees need to write up reasonable action points for each capability. They must not be woolly or vague like ‘continue to build on this skill’. This is another area which both trainees and supervisors struggle with – why? – because the points generated are simply too woolly and vague. And even if you are an ST3 who is completing to CCT, YOU STILL HAVE TO write action points for each of the Professional Competencies – because some of these will form the basis of your PDP for your very first GP appraisal. In the case of ST3s who are completing, the ‘suggested action before next review’ box should be interpreted as ‘suggested action before first appraisal’.
- In summary, you need to write objectives which are SMART. The easiest way to do this is to simply think what next practical step the trainee needs to take which will help progress him or her in this competency.
- Feeling stuck? Click on the button below to some top ideas from our “Formulating Action Points for each Capability” page.