- Research article
- Open Access
Development of learning objectives for neurology in a veterinary curriculum: Part II: Postgraduates
BMC Veterinary Research volume 11, Article number: 10 (2015)
Specialization in veterinary medicine in Europe is organized through the Colleges of the European Board of Veterinary Specialization. To inform updating of the curriculum for residents of the European College of Veterinary Neurology (ECVN) job analysis was used. Defining job competencies of diploma holders in veterinary neurology can be used as references for curriculum design of resident training. With the support of the diplomates of the ECVN and the members of the European Society of Veterinary Neurology (ESVN) a mixed-method research, including a qualitative search of objectives and quantitative ranking with 149 Likert scale questions and 48 free text questions in 9 categories in a survey was conducted. In addition, opinions of different groups were subjected to statistical analysis and the result compared.
A return rate of 62% (n = 213/341) was achieved. Of the competencies identified by the Delphi process, 75% objectives were expected to attain expert level; 24% attain advanced level; 1% entry level. In addition, the exercise described the 11 highly ranked competencies, the 3 most frequently seen diseases of the central and peripheral nervous systems and the most frequently used immunosuppressive, antiepileptic and chemotherapeutic drugs.
The outcomes of this “Delphi job analysis” provide a powerful tool to align the curriculum for ECVN resident training and can be adapted to the required job competencies, based on expectations. The expectation is that for majority of these competencies diplomates should attain an expert level. Besides knowledge and clinical skills, residents and diplomates are expected to demonstrate high standards in teaching and communication. The results of this study will help to create a European curriculum for postgraduate education in veterinary neurology.
For the curricula of training programs for veterinary specialists to remain relevant the educational process must reflect the societies expectations of the professional attributes of veterinary specialists. The specialization in veterinary medicine was developed in the late 1980s; 26 veterinarians met at the World Small Animal Veterinary Association (WSAVA) congress in Harrogate, England in 1989 and discussed the specialization of veterinarians. Veterinary specialization is managed under the umbrella of the European Board of Veterinary Specialisation (EBVS), which was officially registered in 1996 [1,2]. The EBVS should recognize new specialty colleges and monitor their quality, register European veterinary specialists and promote specialist service in the public. In 1991, five European Colleges existed and the number increased to 23 in 2012 . Individual colleges are responsible for their own training programs, with oversight from peer colleges within EBVS. In 2011 the Executive Committee of the European College of Veterinary Neurology (ECVN) instigated a process to inform curricular design through understanding the competencies expected of a diplomate.
The definition of competency has been developed to embrace societies expectations of professionals. Clavien, Nahrwold, Soper, & Bass , summarized the implications of competency as “The business and industrial community recognizes that high-quality products and services are essential to compete in our global economy; Accordingly, the public has expectations that providers of services, including mechanics, hairdressers, lawyers and physicians, will be competent”. The same principle can be adapted for the postgraduate education in veterinary neurology; one of the primary functions of the ECVN is to conduct examinations for veterinarians to get the ECVN Diploma and herewith certifying quality and competent services to the public and their animals . Competency based process have been used for the design of human medical training programs from the 1990s [6,7] and in 2005, a European core curriculum for human neurology was presented  and a questionnaire-based survey on human neurology curricula was conducted from 2006 to 2009 to improve patient care in human neurology in Europe .
In contrast to human medicine no general core competencies in veterinary specialization training were developed. Instead, every college individually set up general learning objectives. Under the hypothesis of high standards of knowledge and skills reached by diplomates in veterinary neurology, the aim of this study was to create a catalogue of learning objectives for postgraduate training of veterinary neurology in Europe. By knowing the expectation of the job requirement of diplomate holders, the learning objectives for the resident training might be revealed.
A modified Delphi method (mixed-method-research) was conducted in the current study; two evaluation phases were applied for the collection of objective opinions regarding the competency domains expected of ECVN diplomats. The Delphi method has three important features: (1) anonymous response, (2) iteration with controlled feedback, (3) statistical group response (objective scores). These characteristics lower personal biases, group pressure  and minimize the “halo error” or “halo effect”  that makes the analysis of free expression of objective opinions, critics or judgments possible. Based on these characteristics, the opinions from experts could be collected and objective decisions could be justified.
The current manuscript obtains part II of the result of the whole survey. In the whole survey, the Participants were not only required to judge each learning objectives for job competencies of diplomates, but also for undergraduates training in pre-clinical and clinical year. The study of learning objectives veterinary neurology for undergraduates has been submitted in part I.
The opinions of experts in the field of veterinary neurology were collected using a modified Delphi method, which consisted of qualitative and quantitative evaluation phases with subsequent statistical evaluation. The ECVN curriculum-working group initialized a draft list of competencies, which were revised and evaluated by members of the European Society of Veterinary Neurology (ESVN) and the ECVN.
PHASE 1: Qualitative evaluation of competencies
The initial draft list of competencies was created by the ECVN curriculum working group consisting of seven selected veterinary neurologists* representing universities and private practices in Europe. The initial draft of competencies was based on the questionnaire created by the American College of Veterinary Internal Medicine (ACVIM) to assess competencies for their residents in neurology.
A draft list of competencies was formatted into 149 four-point Likert scale questions and 48 free text questions (Additional file 1) grouped into 9 categories:
Anatomy and Physiology
Pharmacology and Toxicology
Genetics and Molecular Biology
Neuroanaesthesia and Neurosurgery
Competencies in Academia
Moreover, for assessing the feedback 7 true-false questions and 1 free text question were developed to evaluate any potential differences between ECVN diplomates and advanced practitioners (Additional file 2). Eleven single and multiple-choice demographic questions were included to analyse the respondents.
PHASE 2: Quantitative evaluations of competencies by ESVN and ECVN members
In the quantitative second phase the revised competencies were put into an online survey – (Surveymonkey®) with the login details distributed to 341 ESVN and ECVN members (142 ESVN members, 72 residents and 127 ECVN Diplomates). Residents are ESVN members. Since no statistical difference was found between residents and the other ESVN members, both groups were later combined in the statistical calculations.
Every participant received a unique link by e-mail, which was active for a 3 months period. During this period the users could pause and continue the questionnaire at any time. The curriculum development group estimated 1.5 hours were needed to finish the complete questionnaire. The intended learning objectives and the 4-point Likert scale in our study were based on the cognitive and psychomotor domain of Bloom’s taxonomy classification [12-14]. The participants were asked to evaluate the competencies by using the following 4-point Likert scale:
1 = Not Necessary
2 = Beginner - Theoretical knowledge: knowing terms/Practical Skills: knowledge of theory by practice
3 = Advanced - Theoretical knowledge: Being able to interpret/Practical Skills: perform under instruction by practice
4 = Expert - Theoretical knowledge: Being able to discuss intellectually/Practical Skills: perform independently
Additionally, an option “No Idea” was available, and responses of this option were excluded from further statistical analysis. The same Likert scale was used for all questions of the competencies, which made the scale a defensible approximation to an interval scale.
All data generated by this study were analyzed anonymously satisfying the EU Data Protection Directive 95/46/EC. The data protection officer of the first author’s university approved the study. The study was performed under the ethical regulations of that university.
PHASE 3: Statistical evaluation
After 3 months the online survey was closed for contributions. The non-parametric Fisher’s Exact Test was applied after consulting by the statistical support service of the Institute of Biometrics of the University of Veterinary Medicine Hannover and the analysis was conducted with the statistic software SAS® (Version 9.2) under the assumption of unequal variances, two-tailed distributions and a significance level of 0.05. The results of free text questions were summarized and the three most mentioned objectives would be presented.
*Members of ECVN curriculum working group included H.A. Volk, J. Penderis, T.J. Anderson, S. Añor, A. Lujan-Feliu-Pascual, V.M. Stein and A. Tipold.
A return rate of 62% (n = 213/341) and the 77% overall complete response rate was achieved comprising 83 ESVN (including 46 residents) and 81 ECVN Diplomates. The respondents worked primarily in the United Kingdom (27%, n = 44), Germany (18%, n = 30), Italy (14%, n = 23) and Spain (9%, n = 15); 45% worked in academia, 44% in private specialty practice, 8% in both areas and 3% in industry or other organizations. 97% of respondents described themselves as primarily involved in small animal practice.
None of the suggested competencies were considered as “not necessary”, 75% (n = 112/149) of competencies were expected to attain expert level, 24% (n = 35/149) advanced level and 1% (n = 2/149) beginner level (Figure 1) (Additional file 1).
The 11 most important job competencies graded at expert level were confirmed (Table 1). Because of an equivalent rating for the last two competencies (mean rating 3.97), 11, instead of 10, competencies were listed comprising approximately the top 5% of all competencies. Items in the categories “Clinical examination” and “Disease Mechanisms” were overrepresented.
An advanced level of attainment was expected for competencies listed in the categories “Genetics and molecular biology” (100% (n = 7/7)), “Electrodiagnostic tests” (46% (n = 11/24)) and “Neuroradiology” (71% (n = 5/7)) (Additional file 1).
Experts highlighted 2 (1%) competencies for which they expected attainment at beginner level: “perform urinary tract electrodiagnostic testing in the dog and cat” and “apply radiation therapy technique” (Additional file 1).
Information summarizing the experience of respondents reflecting their experience of disease frequency and the most commonly used drugs was extracted from the free text questions. The three most important/most frequently seen diseases of the central nervous system (CNS) included epilepsy, intervertebral disc disease (IVDD), granulomatous meningoencephalitis (GME) (following hydrocephalus, fibrocartilaginous embolus (FCE) and steroid-responsive meningitis-arteritis (SRMA)); the three most important diseases of the peripheral nervous system (PNS) included polyradiculoneuritis, polyneuropathy, myasthenia gravis (following myositis, botulism and brachial plexus avulsion).
The three most frequently used immunosuppressive or anti-inflammatory drugs in veterinary neurology were glucocorticosteroids, azathioprine and cyclosporine; the three most frequently used antiepileptic drugs were benzodiazepine, phenobarbital, potassium bromide (following levetiracetam, gabapentin and zonisamide); the three most frequently used chemotherapeutic drugs groups included nitrosoureas, cytosine arabinoside and nitrogen mustards.
Comparisons of opinions were investigated between selected groups of respondents to test if there were biases in the answers:
ECVN Diplomates versus ESVN (Residents included) members.
Diplomates in academia versus Diplomates in private specialty practice.
Experts offering neurosurgery versus not offering neurosurgery.
Experience in neurology of 0–5, 6–10 and >10 years.
Comparison between ECVN Diplomates and ESVN respondents
Though 59% (n = 87/149) of the competencies reached expert level in both groups, a slight difference was found between the ECVN and ESVN group; ESVN members ranked 8% (n = 13) more competencies to reach expert level than ECVN Diplomates (Figure 2). In 22 competencies a significant different (p < 0,05) expectation was found between ECVN and ESVN. 12 (55%) of these competencies were in the area of electrodiagnostic tests and 8 (36%) in neuroradiology (Table 2).
Comparison between diplomates in academia and in specialty practice
In 56% (n = 84/149) of the competencies both groups agreed on reaching expert level (Figure 3). A slight difference (p < 0,05) in the opinion of these two groups was detected. 6% more job competencies were expected from diplomates in specialty practice to reach expert level. In contrast, seven competencies were considered only to require the attainment of a beginner’s level of competencies by the group working in academia. In four competencies significant differences between the two groups were found (Table 3).
Comparison between experts offering neurosurgery and not-offering neurosurgery
The comparisons between these two groups were limited to the 17 job competencies included in the categories “Neuroanaesthesia and Neurosurgery”. Experts offering neurosurgery expected residents to attain an expert level in all job competencies in the category “Neuroanaesthesia and Neurosurgery”. In contrast, experts not offering neurosurgery considered only 65% (n = 11/17) of these competencies to were required to attain expert level (Figure 4). Ten competencies showed significant differences between both groups, 9 of these received higher mean ratings from experts who were performing neurosurgery (Table 4).
Comparison of respondents responses according to the experience in the practice of neurology of 0–5, 6–10 and >10 years
For all three groups a similar pattern in the distribution of the expected levels of attainment was observed. However, the respondents with greater than ten years of experience in neurology expected more competencies to reach expert level than the other two groups (Figure 5). Significant differences were found in 11 competencies between groups with 0–5 and 6–10 years experience, 9 competencies between groups with 6–10 and >10 years experience, and 16 between groups with 0–5 and >10 years experience (Table 5).
Difference between diplomates and advanced practitioners
All responders expected that diplomates have a detailed understanding of veterinary neurology in a clinical setting, an advanced level in research as well as competencies in teaching, while advanced practitioners were not expected to have competencies in teaching and research.
Although the whole questionnaire included 149 4-point Likert scale questions and 49 questions in free text form and about 90 minutes were needed to complete it, the response rate was still satisfactory with a 62% return rate and a 48% overall response rate. Experts in veterinary neurology seem to have a genuine interest in teaching matters.
In contrast to Part I (LIN, Y.-W., VOLK, H., PENDERIS, J., TIPOLD, A., & EHLERS, J. P.: Development of learning objectives for neurology in a veterinary curriculum: Part I: undergraduates: BMC Vet Res 2015, 11:2.), where undergraduates were expected to reach beginner level in 71% of learning objectives and 26% of learning objectives were considered as “not necessary”, diploma holders of the ECVN were expected to reach experts level in 75% of competencies and none of them was regarded as “not necessary”. Neurology education for undergraduates requires a minimum body of clinical neurology knowledge and skills, without considering their eventual career path . For postgraduate training of specialists, requirements of knowledge and skills are expected to be on a much higher level as also shown in the current study. Answers from residents were included in the “ESVN group” in this study, because they have a heterogeneous level of knowledge (1–3 years residents) and the trainer status of both ESVN members and residents might be similar.
Surprisingly, in the current study a difference in opinion was seen between diplomates working in academia and diplomates working in private specialty practice. Experts working in private specialty practice expected for all competencies, which differed significantly, higher mean rating than experts in academia. Similar observations occurred also by comparison between ESVN and ECVN members. Experts of the ESVN expected in 21 of 22 significant learning objectives also higher mean rating than ECVN diplomates.
This phenomenon might be explained by the different focus of these groups. Diplomates in academia have a multitude of tasks and have to find a balance between working on clinical cases, undergraduate and postgraduate student education, administration and research. In most clinics of universities several specialists treat single animals trans-disciplinarily. In contrast, diplomates in private specialty practice focus more on expanding their competencies to manage a bigger variety of patients independently. This difference in the job description may explain the slightly higher expectation in clinical knowledge and skills.
Surprisingly, the learning objectives in the field of “electrodiagnostic tests” received controversial results. In total only 35 competencies were expected to reach an advanced level and 11 (31%) of these competencies were in the electrodiagnostic tests category (Additional file 1). Moreover, 12 of 22 (55%) learning objectives, which showed significant differences between ESVN and ECVN experts, were also in the electrodiagnostic tests category. According to this result the college has to discuss the depth of education and outcome evaluation in this specific field of neurology.
Besides the requirement of reaching the highest standard in the field of clinical neurology and research, ECVN diplomates are expected to possess teaching competencies. These competencies may distinguish the job specification of diplomates and advanced practitioners. Veterinary Continuous Education in Europe (VetCEE) assigned a role for diplomates as trainers in postgraduate education of veterinarians in whole Europe . The competencies of teaching should therefore also be part of a residency training for future diplomates, as the neurologist William A. Pulsinelli expressed: “Residents are encouraged to teach the teacher and thereby enrich everyone’s education” .
In the current study the six most important disease processes of the CNS and PNS were defined. Also the three most frequently used immunosuppressive, antiepileptic and chemotherapeutic drugs were extracted from free text questions. Knowledge about such diseases and drugs may be considered as part of the examination content .
Using the Delphi-method made it possible to collect objectively the opinion of learners (residents; “learner-centered”) and trainers (diplomates; “teacher-centered”), which can be used for curriculum adaption. The learner-centered focus includes frequently the need, skills and interests of the learner, which is often accompanied by a problem-based approach providing active learning and high motivation . The opinions of residents from the questionnaire should be therefore considered in the design of resident training.
A limitation of the current study is the limited consideration of affective elements, one of the three domains of educational objectives in Bloom’s taxonomy . In the field of medicine, communication skills, dealing with ethical matters and inter-professional relations are important . Such professional attitudes have received increasing attention in recent years, while traditionally only little attention in medical education was perceived . For a better and safe practice, “The Good Medical Practice” (GMP) from the General Medical Council of United Kingdom has set certain standards expected of all doctors [22,23]. Also the glossary of terms from Accreditation Council for Graduate Medical Education (ACGME) defines that “competencies” are not only confined to specific knowledge and skills, but should also include behavior and attitudes in graduate medical education . In the future, the affective elements in veterinary postgraduate education should be also investigated and assessed, but could be part of a general training provided by all specialty colleges.
The results of our study confirmed the hypothesis that the majority of competencies are expected to reach expert level for ECVN diplomates to meet their job requirements. According to these job requirements of ECVN diplomates, residents as future diplomats are expected in addition to advancing scientifically knowledge and clinical skills 1) to have completed a well-structured training program of adequate length under direct supervision, 2) to be active in education and 3) to be able to interact and communicate in a professional manner with a variety of stakeholders, including other experts and the public. The taxonomic catalog of learning objectives in the current study could be used by the ECVN to adapt their postgraduate curriculum. Moreover, regarding the continually developing of veterinary specialism, a periodic reevaluation of competencies should be conducted to guarantee the up to date status of the curriculum.
Accreditation Council for Graduate Medical Education
American College of Veterinary Internal Medicine
Central nervous system
Board of Veterinary Specialisation
European College of Veterinary Neurology
European Society of Veterinary Neurology
Good medical practice
Intervertebral disc disease
Peripheral nervous system
Veterinary Continuous Education in Europe
World Small Animal Veterinary Association
Lumeij JT, Herrtage ME. Veterinary specialization in Europe. J Vet Med Educ. 2006;33(2):176–9.
Romagnoli S. The European system of veterinary specialization. J Vet Med Educ. 2010;37(4):334–9.
European Board of Veterinary Specialisation: Colleges of EBVS, 2013. http://www.ebvs.org/index.php/colleges2. Assecced January 5, 2013.
Clavien P-A, Nahrwold DL, Soper NJ, Bass BL. Physician competency? Teaching old dogs new tricks. J Gastrointest Surg. 2005;9(5):625–32.
European College of Veterinary Neurology: Constitution of ECVN, 2012. http://www.ecvn.org/ecvn/constitution.pdf. Accessed December 12, 2012.
Bready LL. The graduate medical educaton community’s responsibility for producting a fully trained physician. In: Philibert I, Amis S, editors. The ACGME 2011 Duty Hour Standard - Enhancing Quality of Care, Supervision and Resident Professional Development. Chicago: Accreditation Council for Graduate Medical Education; 2011. p. 81–5.
Swing SR. The ACGME outcome project: retrospective and prospective. Med Teach. 2007;29(7):648–54.
Pontes C. Recommended core curriculum for a specialist training program in neurology. Eur J Neurol. 2005;12(10):743–6.
Struhal, W, Sellner, J, Lisnic, V, Vécsei, L, Müller, E, & Grisold, W. European journal of neurology: the official journal of the European Federation of Neurological Societies, 2011; 18(4). ppe36 – e40.
Dalkey NC, Brown BB, Cochran S. The Delphi method. Rand Corporation Memorandum. In: RM-5888-PR, RM-5957-PR, RM-6115-PR, RM-6118-PR (p. v.). Santa Monica, California: Rand Corp; 1969.
Nisbett RE, Wilson TD. The halo effect: Evidence for unconscious alteration of judgments. J Pers Soc Psychol. 1977;35(4):250–6.
Bloom BS. Taxonomy of educational objectives: The classification of educational goals. Handbook 1: Cognitive domain. 2nd ed. Boston: Addison Wesley; 1984.
Churches, A. Bloom’s Digital Taxonomy, 2009. http://edorigami.wikispaces.com/Bloom’s+Digital+Taxonomy. Accessed Februrary 10, 2013. pp75.
Conklin J. A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives. Educ Horiz. 2005;83(3):154–9.
Gelb DJ, Gunderson CH, Henry KA, Kirshner HS, Józefowicz RF. The neurology clerkship core curriculum. Neurology. 2002;58(6):849–52.
Blaha, T. What about the VetCEE. The EBVS newsletter, 2012. http://www.ebvs.org/news. Accessed Febuary 2, 2013. pp.9-10.
Health Science Center University of Tennessee: Education and Training Programs. Health Science Center, The University of Tennessee, 2013. http://www.uthsc.edu/neurology/education_training.php. Accessed November 5, 2012.
European College of Veterinary Neurology: Guidelines for admission to the certification examination of the European college of veterinary neurology, 2009. http://www.ecvn.org/ecvn/education/residency/training/TrainingGuidelines.pdf. Accessed January 20, 2013. pp6-9.
Norman, D a, & Spohrer, J C. Learner-centered education. Communications of the ACM, 1996; 39(4). pp24–27.
Accreditation Council for Graduate Medical Education: ACGME Program Requirements for Graduate Medical Education in Neurology. Chicago, 2009. http://residents.lsuhsc.edu/no/neurology/docs/180_neurology_07012010.pdf. Accessed August 6,2012.
ten Cate TJ, DE Haes JCJM. Summative assessment of medical students in the affective domain. Med Teach. 2000;22(1):40–3.
General Medical Council. Good medical practice. London: General Medical Council, Great Britain; 2009. p. 18.
Palmer KT, Harling CC, Harrison J, Macdonald EB, Snashall DC. Good medical practice: guidance for occupational physicians. Occup Med. 2002;52(6):341–52.
Accreditation Council for Graduate Medical Education: Accreditation council for graduate medical education – Glossary of Terms, 2011. http://acgme.org/acgmeweb/Portals/0/PFAssets/ProgramRequirements/ab_ACGMEglossary.pdf. Accessed December 20,2012. pp11.
Part of this research was presented as a poster at the 25th Annual Symposium of the European Society and European College of Veterinary Neurolgoy, Ghent, Belgium, 09.13-09.15.2012.
The authors declare that they have no competing interests.
YWL designed and performed the survey as well as the statistic procedures and the following draft of manuscript. This project is made under the sincere guidance of AT and JPE. The first author sincerely acknowledges all the co-authors for all their contributions, supports and criticism. HAV, JP, TJA, SA, ALFP and VMS have provided very valuable references and suggestions during the preparation of the manuscript. The above mentioned authors are also members of ECVN curriculum working group (except JPE). All authors read and approved the final manuscript.
About this article
Cite this article
Lin, Y., Volk, H.A., Penderis, J. et al. Development of learning objectives for neurology in a veterinary curriculum: Part II: Postgraduates. BMC Vet Res 11, 10 (2015). https://doi.org/10.1186/s12917-014-0314-4
- Veterinary education
- Learning objectives