- Research Article
- Open Access
Veterinary homeopathy: Systematic review of medical conditions studied by randomised trials controlled by other than placebo
BMC Veterinary Researchvolume 11, Article number: 236 (2015)
No systematic review has previously been carried out on randomised controlled trials (RCTs) of veterinary homeopathy in which the control group was an intervention other than placebo (OTP). For eligible peer-reviewed RCTs, the objectives of this study were to assess the risk of bias (RoB) and to quantify the effect size of homeopathic intervention compared with an active comparator or with no treatment.
Our systematic review approach complied fully with the PRISMA 2009 Checklist. Cochrane methods were applied to assess RoB and to derive effect size using standard meta-analysis methods. Based on a thorough and systematic literature search, the following key attributes of the published research were distinguished: individualised homeopathy (n = 1 RCT)/non-individualised homeopathy (n = 19); treatment (n = 14)/prophylaxis (n = 6); active controls (n = 18)/untreated controls (n = 2). The trials were highly diverse, representing 12 different medical conditions in 6 different species.
No trial had sufficiently low RoB to be judged as reliable evidence: 16 of the 20 RCTs had high RoB; the remaining four had uncertain RoB in several domains of assessment. For three trials with uncertain RoB and without overt vested interest, it was inconclusive whether homeopathy combined with conventional intervention was more or was less effective than conventional intervention alone for modulation of immune response in calves, or in the prophylaxis of cattle tick or of diarrhoea in piglets.
Due to the poor reliability of their data, OTP-controlled trials do not currently provide useful insight into the effectiveness of homeopathy in animals.
Our group’s systematic analysis of the published literature of randomised controlled trials (RCTs) in veterinary homeopathy identified 38 peer-reviewed papers that we regarded as potentially eligible for detailed review . As emphasised in that article, no systematic review of this research evidence had ever previously been carried out.
We have recently reported our review findings for 18 placebo-controlled trials of veterinary homeopathy [2, 3], in which there was indecisive evidence whether the use of homeopathy in animals is distinguishable from placebos. The present paper reports our results from a similarly detailed appraisal and analysis of the remaining papers, each of which reported an RCT where the control group was an intervention other than placebo (OTP).
Our approach here reflects our original literature analysis  and so we continue to distinguish peer-reviewed from non-peer-reviewed articles, individualised from non-individualised homeopathy, and treatment from prophylaxis. We thus report our findings from the appraisal of peer-reviewed, OTP-controlled trials of veterinary homeopathy (individualised or non-individualised, treatment or prophylaxis).
Our objective firstly was to assess the study quality (risk of bias) of each eligible RCT , together with the direction and statistical significance of treatment or prophylactic effect. For suitable groupings of RCTs (per species-specific medical condition; per type of control group), we aimed then to determine pooled summary statistics by meta-analysis methods and to examine their sensitivity to study quality. In both objectives, our emphasis was focused on trials that satisfied our criteria for reliable evidence [2, 3].
Methods comply with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2009 Checklist (see Additional file 1) . They are compatible with our previously published papers in this series of veterinary reviews [1–3], and with our protocol-based systematic reviews and meta-analyses of homeopathy RCTs in human medicine [6, 7].
Matters connected with study eligibility, research design categories and the literature search strategy were described in detail in our earlier paper . Only brief descriptions are therefore given here, with additional information that is specific to the methods used for the present paper.
Identifying papers for full data extraction
Each of the following electronic databases was searched up to and including March 2011 , with a follow-up search of the same databases up to the end of 2013: AMED, CINAHL, CENTRAL, Embase, HomVetCR, LILACS, PubMed, Science Citation Index, Scopus. There were no language restrictions. During the peer-review process for the current paper, we became aware that relevant additional literature might be contained in CAB Abstracts , which we therefore searched up to and including May 2015, and with the intention to update our review and analysis if significant numbers of eligible RCTs were revealed.
In our original literature search , 20 records of trials were identified as satisfying the key acceptance criteria for the present systematic review: substantive report of clinical treatment or prophylaxis trial for any medical condition or species in veterinary homeopathic medicine, randomised, controlled by OTP, and published in a peer-reviewed journal. One of us screened and categorised each of these potentially relevant papers (plus those identified in our follow-up search – see Results) to assess their eligibility for full data extraction. The other independently appraised these decisions; any differences of opinion were resolved by consensus discussion.
Exclusion criteria prior to full data extraction
Research using radionically prepared ‘homeopathic’ medicines.
The tested intervention is homeopathy combined with other (complementary or conventional) medicine or therapy.
Data extraction and management
The authors of eligible RCT papers were not approached for clarification on unclear or missing facets of their methods or results , though original authors’ cross-reference to their previously published study methods were taken into account as appropriate . For each of two assessors working independently, relevant data were extracted and then recorded using a standardised data collection format (Microsoft Excel).
No paper reported more than one RCT. For a paper reporting an RCT that involved >2 groups of subjects, we typically pursued data extraction on only one pair of groups: trials that included an OTP as well as a placebo control group had been scrutinised previously [2, 3] and were not reappraised for the current study. For studies that comprised >1 homeopathy group, the total sample size reflects the total numbers of subjects in the homeopathy groups combined . This was the approach in all relevant cases, i.e.: where the same homeopathic medicine was used, and with the same timing of administration but in different potency; where the same homeopathic medicine and potency was used, but with different timing of administration; where a different homeopathic medicine was used.
Assessment of risk of bias
Using the standard criteria defined by Cochrane , extraction of information from each paper enabled us to answer the question, ‘Is the study free from risk of bias?’: ‘Yes’; ‘Unclear’; ‘No’. The two assessors’ independent judgments were mutually scrutinised and compared, with discrepancies between them resolved by consensus discussion. This approach applied to each of seven assessment domains: I, the method used to generate the random sequence; II, the method of allocation concealment used to implement the random sequence; IIIA, the blinding of trial personnel, including animal owner as appropriate; IIIB, the blinding of outcome assessors; IV, whether all the randomised patients are accounted for in the analysis; V, whether there is evidence of selective outcome reporting; VI, whether there is evidence of other bias, such as extreme data imbalance at baseline.
For domain IV, a trial was automatically regarded as no better than ‘unclear’ if there was greater than 20 % participant attrition rate, irrespective of whether intention-to-treat analysis had been carried out on the data. For domain V, we based our judgment of reported outcomes on a comparison with the details given in the same paper’s Methods section (original trial protocols have not been published in veterinary homeopathy). For the purposes of the current paper, we assessed domain V as ‘No’ (high risk of bias) if the main outcome data were not extractable for meta-analysis. The source of any research funding/sponsorship, or other vested interest such as personnel employment or contract, was not taken into account for risk-of-bias assessment (domain VI), but was reflected in the overarching assessment of risk of bias for each RCT.
Assessment per trial for risk of bias
Using the Cochrane approach , each trial was designated overall as follows: low risk of bias for all domains; uncertain risk of bias for one or more domains, and no evident risk of bias in any domain; high risk of bias for one or more domains. A trial with overall low risk of bias comprised reliable evidence. For a trial that did not display high risk of bias in any domain, we regarded its evidence as reliable if the study was assessed as free of bias for each of domains I, IIIA, IIIB and IV [2, 3].
Outcome assessment and reporting
Identification of ‘main outcome measure’ per trial
For the purposes of risk-of-bias assessment and for assessment of treatment effect, we identified for each trial a single ‘main outcome measure’ using a refinement of the approaches adopted by Linde et al.  and by Shang et al. . The main outcome measure of each trial was based on a hierarchical ranking order (consistent with the World Health Organization’s  classification system for levels of functioning linked to health condition), and as previously described . This approach ensured that the most clinically important outcome was selected per trial, and also avoided the problem of outcome multiplicity .
Unless otherwise indicated, the single end-point (as determined from the start of the intervention) associated with the designated ‘main outcome measure’ was taken as the last follow-up at which data were reported for that outcome .
Analysis of outcomes
Summary effect measures for ‘main outcome’
For each eligible trial, the effect size was taken as the difference between the homeopathy group and the control group at the designated end-point of the trial, as follows :
For a dichotomous measure: odds ratio (OR), with 95 % confidence interval (CI);
For a continuous measure: standardised mean difference (SMD), with 95 % CI.
If the original paper did not provide adequate information on the designated main outcome measure to enable data extraction, that trial’s outcome was classified as ‘not estimable’ and a further potentially estimable outcome was not sought.
Under the separate group headings of individualised homeopathy and non-individualised homeopathy, and for the categories below in which there was >1 RCT of a given study design that had extractable data, we aimed to determine pooled summary statistics for:
Disease-specific treatment effects per species;
Disease-specific prophylactic effects per species.
All calculations and analyses were performed using Review Manager 5.2 (Cochrane). Given our anticipation of heterogeneous data for intervention effects, the random-effects (rather than fixed-effects) model was planned for all meta-analyses .
Reflecting study quality overall
Our main analyses used only the data extracted from trials without evident high risk of bias. It was intended that our primary conclusions would be based solely on trials with reliable evidence and without overt vested interest (not funded, directly or indirectly, by a homeopathic pharmacy).
Direction of effect of treatment/prophylaxis per trial
Care was taken faithfully to represent the correct direction of change per trial: e.g. an effect favouring homeopathic intervention was higher rate of recovery but lower faecal egg count. The arithmetic content of the OR, or the sign of the SMD, was adjusted appropriately if so indicated.
We regarded each RCT as a superiority trial  unless the original paper stated explicitly in its Methods section that the study was designed as an equivalence or non-inferiority trial [16, 17], with corresponding power calculation. For each of three study designs (and regarding each design as a superiority trial), we adopted the following rationale for interpretation of the three possible statistical findings:
Statistical finding (i): P ≤ 0.05: Direction of effect toward homeopathy
Study design: active control. Homeopathy is more effective than a conventional intervention;
Study design: [homeopathy plus active control] versus active control (‘[A + B] versus B’). Homeopathy combined with conventional intervention is more effective than conventional intervention alone;
Study design: no-treatment control. Homeopathy is more effective than no intervention.
Statistical finding (ii): P ≤ 0.05: Direction of effect toward control
Study design: active control. Homeopathy is less effective than a conventional intervention;
Study design: [homeopathy plus active control] versus active control (‘[A + B] versus B’). Homeopathy combined with conventional intervention is less effective than conventional intervention alone;
Study design: no-treatment control. Homeopathy is ineffective.
Statistical finding (iii): P > 0.05: Direction of effect toward either homeopathy or control
Study design: [homeopathy plus active control] versus active control (‘[A + B] versus B’). Inconclusive whether homeopathy combined with conventional intervention is more or is less effective than conventional intervention alone;
Study design: no-treatment control. Inconclusive whether homeopathy is more or less effective than no treatment.
Additional file 2 illustrates the PRISMA flowchart, which follows on from, and suitably updates , that in our earlier paper ; our current focus is on OTP-controlled trials only. Two OTP-controlled trials were rejected from the current review due to their focus on homeopathy combined with another intervention: A29, Dreissman 2010; A30, Lepple 1984. A further two were excluded due to their focus on neither treatment nor prophylaxis: A33, Sharma 1987; A37, Trehan 1994. Four additional eligible records were identified in our follow-up search, and included in analysis. Our subsequent search of CAB Abstracts, conducted during peer review of the current paper, revealed just one potentially eligible trial , which we did not consider further.
Table 1 details each of the 20 studies eligible for full systematic review: (i) individualised homeopathy/treatment (n = 1); (ii) non-individualised homeopathy/treatment (n = 13); (iii) non-individualised homeopathy/prophylaxis (n = 6). Data per trial include: nature of the homeopathic intervention; study setting; the RCT’s source of funding. Our definitions of ‘treatment’ and ‘prophylaxis’ were as previously described . All RCTs were identified as superiority trials, despite the fact that in some cases the original authors applied the terms ‘equivalence trial’ or ‘non-inferiority trial’ post-hoc in Results or in Discussion (A15, Faulstich 2006; A39, Braun, 2011).
Extreme diversity characterised the studies as regards species, medical condition, homeopathic medicine, and funding source. In the 20 eligible studies, 6 different species are represented: birds (n = 1); cattle (n = 11); dogs (n = 1); horses (n = 1); pigs (n = 4); sheep (n = 2). Twelve different conditions are represented. None of the trials had a clearly unbiased funding source; we identified overt vested interest in 10 of the 20 trials.
Table 2 includes: sample sizes; designated ‘main outcome measure’; type of data (whether dichotomous or continuous); study endpoint. Diversity was again apparent, with large variation in sample sizes, main outcome, and timing of the study endpoint.
Risk of bias
Table 3 shows our risk-of-bias judgments for each eligible trial.
Many of the papers were written to such a poor standard that risk-of-bias assessments were sometimes challenging. No trial had low risk of bias in all of the Cochrane judgmental domains. Sixteen trials had high risk of bias in one or more domains. Four trials had merely uncertain risk of bias, and the uncertainty was evident in five domains per study (A31, Reis 2006; A32, Reis 2008; A34, Signoretti 2008; A36, Soto 2008). There was therefore no trial that could be designated as reliable evidence.
Only five of the 20 trials had adequate randomisation (domain I), and none of the trials had adequate allocation concealment (domain II) or personnel blinding (domain IIIA). See also Fig. 1 (Risk-of-bias summary graph).
Analysis of outcomes
Fifteen of the 20 trials had extractable data. Due to the diversity of medical conditions, species, types of homeopathic intervention, study designs and outcome measures, as well as the very unclear quality of the evidence, it was not appropriate to carry out meta-analysis on disease-specific intervention.
The direction of effect favoured homeopathy in 11 trials (statistically significantly so in four cases) and favoured control in four trials (statistically significantly so in zero cases) – see Table 4, in which the inference from the statistical findings is given by reference to the numbered study designs in Methods: Direction of effect of treatment/prophylaxis per trial.
Trials with uncertain risk of bias
In the absence of any trials with reliable evidence, our main attention has been forced on to the data extracted from three trials with uncertain risk of bias and without overt vested interest (Table 4a): A32, Reis 2008 (modulation of immune response to rabies vaccination in calves); A34, Signoretti 2008 (cattle tick); A36, Soto 2008 (diarrhoea in piglets). All three trials were in the category ‘non-individualised/prophylaxis/‘[A + B] versus B’ design. None of the three showed evidence of a difference between adjunctive homeopathy and active control alone, and so in each case it was statistically inconclusive whether homeopathy combined with conventional intervention was more or was less effective than conventional intervention alone – see Table 4a.
Trials at high risk of bias
Data could not be extracted from the single paper on individualised treatment. Data were extractable from 10 of the 13 relevant RCTs of non-individualised treatment; the direction of effect statistically significantly favoured homeopathy in four of the ten cases – see Table 4b. Two of these four yielded what appear to be spuriously high mean OR values (A13, Bekeriklisoy 2008: OR = 95.86; A14, Coelho 2009: OR = 58.09). Of the two RCTs of non-individualised prophylaxis (both with untreated controls), data were extractable from one (A35, Sommer 1972).
This comprehensive systematic review of the peer-reviewed literature has revealed no OTP-controlled RCT of veterinary homeopathy that comprised reliable evidence. Our main conclusions from this study are therefore restricted to the findings of three RCTs, whose quality was unclear and whose methodological diversity contraindicated meta-analysis. Each of these three trials is in the category of non-individualised homeopathic prophylaxis (A32, Reis 2008; A34, Signoretti 2008; A36, Soto 2008), a prescribing approach that some homeopathic practitioners might view as controversial . Each of the three trials is also in the adjunctive category, and manifested statistically inconclusive findings: this result undermines the suggestion that the ‘[A + B] versus B’ study design can ‘generate only positive results’ .
For each of the above three trials, the uncertainty regarding risk of bias was so marked that their findings must be viewed with extreme caution. Given the lack of clarity in so many domains of assessment, this degree of concern would still apply even if we had reflected more leniently the fact that non-blinding of study personnel is a typical feature of an OTP-controlled trial. The admissible evidence in veterinary homeopathy for this study design is therefore unable to provide any compelling information about modulation of immune response in calves (A32, Reis 2008) or adjunctive prophylaxis of cattle tick (A34, Signoretti 2008) or of diarrhoea in piglets (A36, Soto 2008).
In assessing all the studies, we had reason on occasions to question the veracity of the control group as an ‘active’ or effective intervention (e.g. mineral or protein supplements, or naloxone in pseudopregnancy), and so raised doubts about the ‘other than placebo’ nature of some of the included trials. We were careful not to attribute ‘equivalence’ to superiority trials that found no statistically significant difference between homeopathy and active control [16, 19].
For OTP-controlled RCTs of non-individualised homeopathic treatment, there is nothing that we can reasonably conclude, given that each one of the trials was judged to be at high risk of bias. Thus, the positive inference we attributed to four trials in this category cannot be regarded as admissible evidence; the spuriously large treatment effect evidenced in two of the trials reinforces those serious concerns. It remains unknown whether non-individualised homeopathy is effective in the prophylaxis of fertility disorders in cattle. Likewise, no conclusions can be made regarding individualised homeopathic treatment, since the single trial in this category was of very low quality and yielded no extractable data for analysis.
Our most recent literature search, conducted during the process of the current paper’s peer-review, revealed only one further OTP-controlled trial that would potentially have been eligible for inclusion . Notwithstanding normal concerns over the possibility that publication bias may have limited the number of ‘negative’ studies available, the present systematic review seems barely compromised by selection bias due to absence of relevant data.
Thus, the sum of the reliable peer-reviewed RCT evidence in veterinary homeopathy (out of 18 placebo-controlled and 20 OTP-controlled RCTs in total) comprises the two placebo-controlled trials that we previously identified [2, 3]. Evidence concerning the effective use of homeopathy in animals remains indecisive.
Due to their extremely poor quality, OTP-controlled trials are incapable of providing useful additional insight into the effectiveness of homeopathic treatment or prophylaxis in animals. To clarify the matter, new and substantially improved OTP-controlled research in both individualised and non-individualised veterinary homeopathy is strongly indicated.
Commonwealth Agricultural Bureaux
Other than placebo
Preferred reporting items for systematic reviews and meta-analyses
Randomised controlled trial
Standardised mean difference
Mathie RT, Hacke D, Clausen J. Randomised controlled trials of veterinary homeopathy: Characterising the peer-reviewed research literature for systematic review. Homeopathy. 2012;101:196–203.
Mathie RT, Clausen J. Veterinary homeopathy: systematic review of medical conditions studied by randomised placebo-controlled trials. Vet Rec. 2014;175:373–81.
Mathie RT, Clausen J. Veterinary homeopathy: meta-analysis of randomised placebo-controlled trials. Homeopathy. 2015;104:3–8.
Higgins JPT, Altman DG (Eds): Assessing risk of bias in included studies. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. Edited by Higgins JPT, Green S (Eds). The Cochrane Collaboration; 2011: Chapter 8.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. J Clin Epidemiol. 2009;62:e1–e34.
Mathie RT, Legg LA, Clausen J, Davidson JRT, Lloyd SM, Ford I: Systematic review and meta-analysis of randomised, placebo-controlled, trials of individualised homeopathic treatment: study protocol. 2013, Version 1.0; 25 January 2013. www.britishhomeopathic.org/wp-content/uploads/2013/05/Study_protocol_for_systematic_review.pdf (Accessed 19 April, 2013).
Mathie RT, Lloyd SM, Legg LA, Clausen J, Moss S, Davidson JRT, et al. Randomised placebo-controlled trials of individualised homeopathic treatment: systematic review and meta-analysis. Syst Rev. 2014;3:142.
Grindlay DJC, Brennan ML, Dean RS. Searching the veterinary literature: A comparison of the coverage of veterinary journals by nine bibliographic databases. J Vet Med Educ. 2012;39:404–12.
Higgins JPT, Deeks JJ, Altman DG (Eds): Special topics in statistics. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. Edited by Higgins JPT, Green S (Eds). The Cochrane Collaboration; 2011: Chapter 16.
Linde K, Clausius N, Ramirez G, Melchart D, Eitel F, Hedges LV, et al. Are the clinical effects of homeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet. 1997;350:834–43.
Shang A, Huwiler-Müntener K, Nartey L, Jüni P, Dörig S, Sterne JAC, et al. Are the clinical effects of homoeopathy placebo effects? Comparative study of placebo-controlled trials of homoeopathy and allopathy. Lancet. 2005;366:726–32.
World Health Organization: Towards a Common Language for Functioning, Disability and Health: ICF – The International Classification of Functioning, Disability and Health. World Health Organization, 2002. www.who.int/classifications/icf/training/icfbeginnersguide.pdf (Accessed 19 April, 2013).
Dmitrienko A, D'Agostino Sr RB, Huque MF. Key multiplicity issues in clinical drug development. Stat Med. 2013;32:1079–111.
Deeks JJ, Higgins JPT, Altman DG (Eds): Analysing data and undertaking meta-analyses. In: Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. Edited by Higgins JPT, Green S (Eds). The Cochrane Collaboration; 2011: Chapter 9.
Sedgwick P. What is a superiority trial? BMJ. 2013;347:f5420.
Sedgwick P. Equivalence trials. BMJ. 2013;346:f184.
Sedgwick P. What is a non-inferiority trial? BMJ. 2013;347:f6853.
Dent L, Raftery J. Treatment success in pragmatic randomised controlled trials: a review of results funded by the UK Health Technology Assessment programme. Trials. 2011;12:109.
Wellek S, Blettner M. Establishing equivalence or non-inferiority in clinical trials. Dtsch Arztebl Int. 2012;109:674–9.
Stovold E, Beecher D, Foxlee R, Noel-Storr A. Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram. Syst Rev. 2014;3:54.
Kiefer C, Rizzardi R, de Oliveira BF, Silva CM, Martins LP, Fantini CC. Complexo homeopático na prevenção e tratamento de diarréias em leitões lactentes [Homeopathic complex in the prevention and treatment of diarrhoea in suckling piglets]. Rev Bras Saúde Prod Anim. 2012;13:74–82.
Hoover TA: Epidemic diseases and homeopathic prophylaxis: fact or fiction. http://toddhoovermd.com/articles/epidemic-diseases-and-homeopathic-prophylaxis.html (Accessed, 26 June 2014).
Ernst E, Lee MS. A trial design that generates only ‘positive’ results. J Postgrad Med. 2008;54:214–6.
Sources of funding
RTM and JC are each employed by a homeopathy charity to clarify and extend an evidence base in homeopathy; they have no other relationships or activities that could appear to have influenced the submitted work. The authors declare that they have no competing interests.
RTM devised and led the study, and undertook the primary write-up of the paper. Both authors developed the study protocol and contributed to all facets of the work; both take responsibility for the integrity of the data. Each author contributed to editing the manuscript and agreed the final version. RTM is guarantor.
As a research physiologist (RTM) and a biologist (JC), we have applied the normal high standards of scientific method in the conduct of the work and of complete and transparent reporting in the write-up of the paper.
PRISMA 2009 Checklist. (DOC 64 kb)
PRISMA flowchart, illustrating records of RCTs that are eligible and ineligible for inclusion in the systematic review. * Records are numbered as per a previous paper published by the authors (Mathie et al., 2012) . Papers presented in italics are those identified in the follow-up literature search. Excluded papers are shown in red. # RCT with continuous measure as main outcome (each unmarked trial has a dichotomous measure as the main outcome). (DOC 66 kb)