- Research article
- Open Access
Clinical validity of outcome pain measures in naturally occurring canine osteoarthritis
BMC Veterinary Research volume 8, Article number: 162 (2012)
The conceptual validity of kinetic gait analysis and disability outcome assessment methods has guided their use in the assessment of pain caused by osteoarthritis (OA). No consensus on the best clinical methods for pain evaluation in canine OA exists, particularly, when evaluating treatments where a smaller treatment effect is anticipated than with pharmacological pain killers. This study thus aimed at determining the technical validity of some clinical endpoints on OA pain in dogs using the green-lipped mussel (GLM)-enriched diet.
Twenty-three adult dogs with clinical OA completed the prospective controlled study. All the dogs were fed a balanced diet over a 30-day control period followed by a GLM-enriched diet over a 60-day period. The kinetic gait analysis parameter (PVFBW, peak vertical force adjusted for body weight change), electrodermal activity (EDA), and a standardized multifactorial pain questionnaire (MFQ) were performed on day (D) 0 (inclusion), D30 (start) and D90 (end). The owners completed a client-specific outcome measures (CSOM) instrument twice a week. Motor activity (MA) was continuously recorded in seven dogs using telemetered accelerometric counts. We hypothesized that these methods would produce convergent results related to diet changes. A Type I error of 0.05 was adjusted to correct for the multiplicity of the primary clinical endpoints.
Neither the EDA nor the MFQ were found reliable or could be validated. Changes in the PVFBW (Padj = 0.0004), the CSOM (Padj = 0.006) and the MA intensity (Padj = 0.02) from D0 to D90 suggested an effect of diet(s). Only the PVFBW clearly increased after the GLM-diet (Padj = 0.003). The CSOM exhibited a negative relationship with the PVFBW (P = 0.02) and MA duration (P = 0.02).
The PVFBW exhibited the best technical validity for the characterization of the beneficial effect of a GLM-enriched diet. The CSOM and MA appeared less responsive following a GLM-diet, but these measures appeared complementary to gait analysis. Apparently, the CSOM provides the capacity to rely on pain OA assessment influenced by both lameness quantification (PVFBW) and physical functioning (MA).
The prevalence of osteoarthritis (OA) in the canine population (20% of adult and 80% of the geriatric (> 8 years old) dogs in North America ) makes the disease a major cause of concern. The distortion between clinical and radiographic finding in dog OA is well recognized . The symptomatic signs of OA are highly variable, related to pain and physical functioning, and translated into limb impairment, activities limitations and restricted participation [3–5]. This situation led to the use of multiple methods to assess the efficacy of OA treatment . However, interpretations are not always clear, the results are often inconsistent and clinical validation of these methods is often missing.
The conceptual validitya of the canine pain scales designed for OA and chronic pain has evolved over time [7–11]. These scales have demonstrated their sensitivity to detect response to OA treatment where pain was reduced following nonsteroidal anti-inflammatory drug (NSAID) [11–13], nutraceutical  or other nontraditional [13, 15] treatment for OA. However, divergent interpretations were addressed when comparing subjective pain scores to an objective evaluation of lameness [13, 14], emphasizing the limited information on the relationship between pain scales and OA severity. The majority of standardized multifactorial pain questionnaires (MFQ) are guided by the traditional notion of an inevitably progressive and degenerative disease process; greater behavioral changes indicate higher OA severity and pain in dogs. However, OA is a heterogeneous group of painful conditions [16, 17]. The variety of OA signs suggests the need for the implementation of a clinical assessment that includes a broader variable profile than the current standardized OA profile. For this purpose, the client-specific outcome measures (CSOM) require the owner to report pain behavioral changes and/or impaired activities in their OA-afflicted dogs [18, 19]. However, the promising CSOM have not met the technical validityb criteria . These data suggest that psychometricc support for the CSOM instrument is required.
The enhancement of a measurement’s interpretability requires the referencing of its value to another measurement with established conceptual validity and interpretability. A surrogate to pain evaluation, vertical ground reaction forces, such as PVF and vertical impulse, measured through objective kinetic analysis have prevailed over pain measurements to quantify limb impairment [20, 21]. Interestingly, the PVF variable showed sensitivityd and responsivenesse for the efficacy of the anti-inflammatory, analgesic and structural effects of NSAID [22–25] and nontraditional  treatments, which supports a regulatory claim for these treatments for osteoarthritic dogs.
Physical activity represents a distinct dimension of physical functioning , and as such, telemetered motor activity (MA) is an objective behavioral method for the clinical assessment of physical function and overall well-being for canine OA [27, 28]. However, more data are required to confirm its validity for pain evaluation in OA clinical trials.
Clinicians must be able to interpret the literature to implement the best evidence-based practices. Therefore, here we performed a preliminary analysis to determine the reliabilityf, responsiveness and criterion validitiesg for canine pain assessment in a one-way crossover clinical trial in naturally occurring OA in dogs that were fed with two successive diets (control and therapeutic) during a 90-day period. We further hypothesized, first, that changes in measurements of the clinical endpoints (dependent variables) would arise from the diets (independent variable) with every other possible factor controlled and, second, that validated outcomes would correlate strongly to PVF as the primary outcome and MA as an exploratory outcome. This study determined the clinical utility of selected methods regardless of some technical validities.
A total of 30 dogs were initially recruited. Seven dogs were excluded for the following reasons: three due to a sudden deterioration of their condition (one dog at D21 and two dogs at D45 and D52), three for a lack of owner follow-up, and one for NSAID use (at D40). The sample included 14 males and 9 females, and the most frequent breeds were Labrador (n = 7) and Golden Retrievers (n = 4). The remainder of the dogs were mixed-breeds (n = 3) and various pure-breeds (n = 9). The dogs were 2.5 to 11.5 years old (6 years, median) at the time of inclusion and weighed 25.2 to 68.4 kg [40.4 ± 1.8 kg]. The joint that caused the most lameness in each animal during the orthopedic examination was the hip (34.8%) followed by the stifle (30.4%), shoulder and elbow (13.0%, each), and carpus and tarsus (4.4% each). Joint pathologies included hip dysplasia (39.1%), cranial cruciate ligament rupture (26.1%), elbow dysplasia (13.1%), shoulder osteochondritis dissecans (OCD) (13.0%), tarsus OCD, and carpus OA with no obvious origin (4.4% each).
Kinetic force platform gait analysis (PVFBW)
The mean CV for PVFBW was not different over time (P = 0.82) (Table 1). A significant effect of the anatomical location of the most affected limb on the PVFBW was observed (P < 0.001). Moreover, the PVFBW was significantly higher on D90 than on D0 (Padj = 0.0004) and D30 (Padj = 0.003) (Figure 1A). No differences between D0 and D30 were observed (Padj = 0.06).
Client-specific outcome measures (CSOM)
The mean CV for CSOM was not different over time (P = 0.34) (Table 1). The CSOM Med was higher on D0 than on D30 [odds ratio (OR): 3.8, 95% confidence interval (CI): 1.4 to 9.8, Padj = 0.03] and on D90 [OR: 6.7, CI: 2.0 – 22.6, Padj = 0.006] in the dogs with OA (Figure 1B). No difference between D30 and D90 was noted [OR: 1.8, CI: 0.7 – 5.0, Padj = 1.00]. The ranked activities (Table 2) revealed that the second ranked activity (Act(2)) was significantly different between D0 and D30 [OR: 3.5, CI:1.3 – 9.2, Padj = 0.04] and D90 [OR: 8.7, CI: 2.2 – 34.1, Padj = 0.006]. No differences over time were observed for the other ranked activities, which suggested that the ranking of the activities had no/poor influence.
The selected activities were categorized as follows: 41 activities were Ctg(1) (reduced mobility), 16 activities were Ctg(2) (reduced mobility after exercise), 12 activities were Ctg(3) (reduced ability to change posture), 10 activities were Ctg(4) (reduced ability to change posture after rest or in the morning), 4 activities were Ctg(5) (resistance to manipulations), and one activity was Ctg(6) (mood change). The Ctg(1) was higher on D0 than on D30 [OR: 2.7, CI: 1.4 – 5.3, Padj = 0.02], but no difference was found between the other time points (Table 2). The Ctg(2) was higher on D0 than on D30 [OR: 10.5, CI: 1.5 – 72.0, Padj = 0.05] and on D90 [OR: 32.7, CI: 2.3 – 457.0, Padj = 0.03] (Table 2). The Ctg(4) revealed a significantly higher score on D0 than on D90 (Row Mean Score Difference, RMSD = 13.0, df = 1, Padj = 0.04) (Table 2). No differences over time were observed for Ctg(3) and Ctg(5) (Table 2).
Electrodermal activity (EDA)
The mean CV for EDA was different over time (P < 0.001) (Table 1), which suggested EDA was variable on repeated measurement throughout the study. This poor technical reliability precludes any interest in the use of the measurement for the assessment of treatment responsiveness. The EDA was not different on D0 compared with D30 (Padj = 0.99) and D90 (Padj = 0.90). No difference was observed between D30 and D90 (Padj = 0.07) (Figure 1C).
The pairwise correlation coefficients between the PVFBW and the CSOM Med were low (Spearman's rank correlation coefficient (rhoS) = −0.03, 0.10 and −0.37 on D0, D30 and D90, respectively) (Table 3). Some relationship between the PVFBW and the CSOM Med appeared between D30 and D90 using the descriptive pairwise correlation coefficient (rhoS = −0.71) (Table 3). The regression estimate between the PVFBW and the CSOM Med was significant (estimate (SE) = −0.01 (0.003), P = 0.02). These results indicate that both variables are convergent and that the CSOM Med change is predictive, in some part, of the PVFBW change. The CSOM categories were presented as exploratory endpoints because they were a posteriori measures with interesting information (Table 3). Descriptive correlations revealed that the CSOM categories reflected the CSOM Med .
The pairwise correlation coefficient between the PVFBW and the EDA indicated no linear relationship on D0, D30, and D90 or differences between D0 and D30 and D30 and D90 (Table 3). Regression analyses demonstrated no relationship between the PVFBW and the EDA (estimate (SE) = 0.001 (0.001), P = 0.91), which implies that EDA had no empirical association with PVFBW.
Motor activity (MA)
The mixed model of MA recordings in the seven randomized dogs revealed a significant main effect for time (P = 0.04), age (P < 0.001) and daily period (P < 0.001). A significant effect of age was observed between dogs older than 6 years and younger dogs (minus 6 years) (P < 0.001) (Figure 2). A significant effect of the daily period on MA intensity was noted because the dogs were less active at night than during the morning (P = 0.002) or the afternoon (P < 0.001). The planned comparisons showed that MA intensity was lower at P1 compared to P6 (Padj = 0.02) (Figure 2).
There was no pairwise correlation (Table 3) and no relationship between the MA intensity and the PVFBW (P = 0.36). No relationship between the MA intensity and the CSOM Med (P = 0.79) was noted on the regression analysis. However, there was a significant negative relationship between the MA duration and the CSOM Med (P = 0.02).
Multifactorial pain questionnaire (MFQ)
The internal consistency of the MFQ-S (n ij = 69, Cronbach’s alpha = 0.59) and the MFQ-D (n ij = 69, Cronbach’s alpha = 0.69) were lower than expected, which suggested that the selected items were not related to the same constructj.
Figure 3 illustrates that the MFQ-NRS score was 3.0 times (OR) higher on D30 than on D0 (Padj = 0.04), which indicates deterioration in the dogs’ condition. However, this score was unchanged from D0 to D90 (Padj = 0.60) and from D30 to D90 (Padj = 0.27). Moreover, the MFQ-S was lower on D30 (Padj = 0.003) compared to on D0. No differences on D90 compared with D0 (Padj = 0.21) or D30 (Padj = 0.75) were noted for MFQ-S. Finally, the MFQ-D and the MFQ-RTx did not change over time (P > 0.05) (Figure 3). The divergent scoring of the MFQ subscales did not validate this standardized scale in the study.
The present study represents the continued interest in the conceptual and technical validities of multiple methods for pain assessment in canine OA. The PVF, CSOM, and MA demonstrated convergent results for the detection of diet-induced changes. The PVF exhibited the best technical validity, and the CSOM and MA demonstrated moderate technical validity. However, the CSOM evaluating the dogs’ day-to-day health status was found as related to the PVF and was primarily influenced by MA duration. The differences in the conceptual and technical validities suggested PVF, CSOM, and MA did not provide the same information on OA pain and physical function, but importantly they should be used and interpreted as a whole.
This study demonstrated that the PVF showed responsiveness to a GLM-enriched diet effect on canine OA. The study confirmed that the kinetic force platform gait analysis is a useful outcome because of the relative ease of data acquisition and technical validity [21, 22, 24, 25, 29–31]. Interestingly, age, sex and radiographically estimated OA severity were not affecting PVF, and the value of PVF representing the most affected limb was an accurate outcome measure for OA. But it might only partially represent the consequences of the entire disease on the physical function in these selected dogs, with regards to the absence of relationship between PVF and MA.
Clinical owner-oriented outcomes would be conceptually preferred, in general, because they are expected to reflect a dog’s quality of life. The questioning of the patient/owner about the quality of life has opened a wider panel of OA physical function and pain assessments. The CSOM is a subjective instrument that satisfied some psychometric qualities in this clinical trial. The owner-described behaviors in the CSOM were similar to previously described behaviors in canine studies of OA symptoms and pain [7, 19]. These similarities suggest the face validityk of the CSOM, which indicates that this measurement assesses the appropriate outcome . Reliability testing revealed that the owner’s assessment was not variable over a one-week period. This is suggestive that CSOM scores were stable at the condition the dog’s status did not change between these two successive CSOM assessments (when facing a change, it was expected the owner to alert the investigators). With the conditions of the study, it was not possible to judge on a memory effect (the owner is influenced by the souvenir of the previous scoring) and the potential effect of a random error in CSOM owner assessment. Moreover, regression analyses demonstrated that both CSOM and PVF methods were related, supporting our second hypothesis. But, CSOM measurements were not strictly parallel to PVF (confirming our first hypothesis) as only the PVF detected a strict beneficial effect of the GLM diet. Divergent results between CSOM and PVF for the responsiveness analysis and the criterion validity analysis might be explained by the technical features of the CSOM. Indeed, the quantification scale of the CSOM is limited, likely decreasing its responsiveness. In addition, it was difficult to demonstrate a further decrease in the CSOM beyond D30 suggesting a possible floor effect. The sample size of 23 dogs was based on the power of the trial to detect a specified clinical benefit on the PVF. According to previous work done in similar conditions , a sample size of 20 dogs ensured a difference of 4.2%BW in the PVF consistent with an effect size of 0.9 could be detected assuming 80% power, a SD of 4.5 and a 5% significance threshold. This sample size might be too weak to fully support GLM diet efficacy using CSOM. This result suggests that the CSOM would decrease the likelihood of false clinical benefits. In contrast, PVF was responsive to GLM effect. Whereas PVF demonstrated significant change between D30 and D90, the primary endpoint CSOM has not demonstrated a statistically significant change for the same interval time. This could look as controversial for the validity of the methods. Therefore, we applied a correction for multiplicity of endpoints that adjusted the Type I error when a significant result was required for more than one but not all multiple primary outcomes after correction of multiplicity . With the correction for multiplicity, PVF was significantly different between D30 and D90. This method provided stronger evidence to fully characterize the metrological feature of the methods when a small treatment effect is anticipated. In addition, the study suggests the two methods complementary relationship in pain assessment in which the CSOM assessed pain-induced changes in behavior and locomotion, and the PVF analyzed kinetic gait changes.
Previous studies have not indicated the details of the construction of the CSOM . As previously noted, owners easily report on their dog’s activities, but the number (from 5 to 3 activities) and the nature of the selected activities in the CSOM differed between users [19, 34]. This result suggests that OA has a variable impact on the daily life of dogs or that some owners missed behavioral changes that are caused by chronic pain . In this study, an analysis of the influence of each activity revealed that the ranking of activity was neither valid nor informative. However, the categorization of the activities demonstrated significant behavioral changes. The owners detected higher limitations in activity in their dogs after exercise (Ctg(2)) or after a certain period of inactivity, including stiffness at night/after activity/in the morning (Ctg(4)). These behaviors are events that concur with suggestions of pain signs in previous studies. Hence, the selection of the same number of activities (we suggest 2 to 3 activities) that are worded by the owner but selected from the present categories would allow more precise and sensitive comparisons between dogs in future studies.
Our findings reported a significant difference in MA from P1 to P6 (Figure 2). However, the graph clearly suggests the possibility to detect more frequent differences while taking account individual variability of these data (cf. the actual difference with age on this limited sample) and required sample size to avoid Type II error. In addition, according to the small sample inference of the linear mixed model , our result needs to be verified on larger sample size. Despite limitation about the statistical inference, the present result about MA opens new insight in the field of pain evaluation for osteoarthritic dogs. Interestingly, MA did not significantly rely on PVF but to CSOM. These results emphasized that MA provided an aspect of spontaneous physical activity that was not detected by the conditioned gait evaluation, i.e. PVF. In addition, MA may be influenced by the proper ability of the dog to move freely and reflect its quality of life as defined by CSOM. Therefore, MA and CSOM are attractive outcome measures of pain and physical function in OA dogs because they are interrelated but different; one measurement is objective and the other is subjective.
The observed divergence in the results of the constitutive MFQ subscales (e.g., MFQ-NRS and MFQ-S from D0 to D30), the lack of responsiveness (for MFQ-RTx and MFQ-D) and the weak internal consistency (particularly for MFQ-S) lead to poor technical validity and question the construct validityl of this method. Although the CSOM and the MFQ were designed for clinical use to evaluate similar aspects of OA, the current results suggest that both pain scales partially reflect the same construct or that the MFQ did not satisfy adequate psychometric features. The standardized MFQ scale looked less potent to reflect the variability in limb impairment, activity limitations and other pain syndromes in canine OA.
The EDA measurement did not provide conclusive results in this clinical study. Invalidated outcome measures were observed in experimental conditions in rodents with a higher sympathetic tonus , but our own group has reported positive results with its use in the experimental (Pond-Nuki) canine OA model .
The GLM-enriched diet and the GLM extracts although not a reference treatment for OA were shown to exert a positive therapeutic effect on the clinical signs of dog OA [14, 38]. Although a placebo-controlled trial would have been favored, ethical issues precluded a parallel comparison over 60 days between GLM- and placebo-treated dogs. Therefore, only a longitudinal one-way crossover design was included in the experimental design using the dogs as their own control. The anticipated effect of the GLM-diet was weak [14, 38]. We did not know how much difference should be seen after two months of giving GLM. In addition, we observed slight improvement from D0 to D30 for CSOM, and MA seemed to be better during P2 (D16 to D29) two weeks after changing the home food for the control diet. Previous studies reported better owner-assessed pain in OA dogs with diet change [39, 40]. Altogether, it is possible that the changes were not resulting from the GLM-diet but might be representing a trend over time caused by the diet changes . Some might argue that PVF was not a good indicator of pain (or, at least claim that PVF is less sensitive than vertical impulse for hip dysplasia condition). As other critic in the present study, we could mention the fact that the other methods, i.e. MFQ and EDA, did not detect any treatment effect over the GLM-diet period. However, the sensitivity of MFQ and EDA was not previously investigated in other OA related-pain study in clinical condition, whereas the vertical ground reaction forces, such as PVF, have already proven their ability to detect change with NSAIDs treatment [22–25].
This study investigated outcome measures that assessed signs in naturally occurring OA in dogs. The data from this study demonstrated that the limitation in activities (CSOM) and physical function, including limb impairment (PVF) and physical activity (MA), acted as complementary measures. Further developments on CSOM and MA would optimize their use in clinical trials.
The Institutional Animal Care and Use Committee approved the experimental protocol (Rech-1297) following the Canadian Council on Animal Care guidelines.
Thirty dogs were selected at the University teaching hospital of the Faculty of Veterinary Medicine (Université de Montréal, St-Hyacinthe, QC, Canada). The selection criteria were the following: 1) chronic and stable lameness, as reported by the owner; 2) no pregnancy and obesity; 3) weight greater than 20 kg (44 lb) and age greater than 12 months; 4) freedom from non-OA orthopedic, neurological and other abnormalities; 5) lack of orthopedic surgical treatments in the past year; and 6) no treatment with OA prescription-type diets, fatty acid supplements, continuous oral or injectable anti-inflammatory drugs that were prescribed by a veterinarian (including both steroid and NSAID), or polysulfated glycosaminoglycans therapy. Dogs that were receiving an oral nutraceutical or sporadic NSAID administration underwent a 4-week withdrawal period to establish eligibility.
When expressed as a percentage of their body weight (%BW), a PVF lower than 99.1% BW for forelimb lameness or lower than 62.2% BW for the lameness of one or more hindlimbs was required for inclusion, as previously performed . An experienced veterinary surgeon performed an orthopedic exam and reviewed the digital radiographs of hips, stifles, and elbows for signs of OA. Physical examination, biochemical and hematological analyses (CBC, chemistry panel, and urine analysis) were performed on each dog. These were done to exclude non-healthy animals that presented non-OA orthopedic, neurological or other abnormalities. Dogs were removed from the study if either of the following conditions occurred: 1) the administration of a recognized treatment for OA, 2) medical problems or a sudden deterioration in orthopedic condition, 3) decision by the owner or 4) a change in housing style.
All the dogs were fed a standard balanced diet of adult dry food (Dog Chow®, Nestlé Purina, St.-Louis, MO, USA) from D0 to D30 to standardize the food regimen for use as a placebo-control. This dog chow did not include any proclaimed active ingredients for the treatment or alleviation of OA. Subsequently, all the dogs were fed an experimental therapeutic food that was enriched in green-lipped mussel (GLM) from D31 to D90 (Mobility Support JS®, Medi-Cal/Royal Canin, Guelph, ON, Canada). The latter diet was chosen for its potent pain relief activity [14, 42] without the side effects that are induced by the long-term administration of NSAIDs [43, 44]. The packaging of both diets was identical. The pet owners and the investigators in the field had no knowledge of the food identity and in what order the diets were fed. The food composition and the daily food needs all met the recommendations of the Association of American Feed Control Officials for the maintenance of adult dogs . The pet owners were instructed to transition their dogs to the assigned foods as following: a 14 transition day period at D0-D14 and at D30-D44.
The dogs remained at home throughout the study. The pain CSOM questionnaire and MA were recorded within the dog’s environment. The others methods were performed on D0, D30 and D90 at the University teaching hospital.
Kinetic force platform gait analysis (PVFBW)
Data acquisition for the PVF was obtained for a trot at a constant velocity between 1.9 and 2.2 m/sec on a biomechanical force platform (Model OR6-6®; Advanced Medical Technology Inc., Watertown, MS, USA) coupled to software (Vetforce®; Sharon Software, Dewitt, MI, USA) as described previously . The lowest PVF determined the most severely affected limb, which was selected for evaluation and used throughout the entire study. Five valid trials were recorded for the selected limb and averaged for further analyses. As recently reported by our group, PVF adjusted for individual BW changes (PVFBW) was used for the analyses .
Client-specific outcome measures (CSOM)
The CSOM scale is an owner-specific instrument to assess the influence of OA on the dog’s behavior . A veterinarian assisted the owners at baseline, and the owners determined the five most difficult/OA-affected activities [Act(i) for their dog. The evaluation of fewer than five activities was permitted. The owners ranked the activities by the level of importance from Act(1) to Act(5). Each activity was scored from 0 (no problem) to 4 (greatest difficulty) on a five-point Likert-rating scale. The median value of all the activity scores (CSOM Med = Median [Act(i)) ranged from 0 (no problem/pain) to 4 (greatest difficulty/pain). Each owner completed the CSOM twice per week. The activities were also subjectively clustered into six categories [Ctg(i) to provide a description of the activity limitations induced by OA: Ctg(1) = Reduced mobility; Ctg(2) = Reduced mobility after exercise; Ctg(3) = Reduced ability to change posture; Ctg(4) = Reduced ability to change posture after rest or in the morning; Ctg(5) = Resistance to manipulations; and Ctg(6) = Mood change. If more than one selected activity was included in the same category, a median value of these scored activities was used to score the category.
Electrodermal activity (EDA)
An EDA measurement was performed using the Pain Gauge system® (PHIS Inc., Dublin, OH, USA) to reflect sympathetic responses related to stress and pain. Both electrodes of the device were applied on a dry right hind paw for two seconds. The instrument displays a numeric level of skin conductance that ranged from 0.1 (no pain, no stress) to 9.9 (worst pain and stress). The measurements were performed in triplicate on D0, D30 and D90. The data were averaged at each time point for the statistical analyses.
Motor activity (MA)
Accelerometer microchips (Actical® Mini Mitter, Bio-Lynx Scientific Equipment, Inc., Laval, QC, Canada) continuously recorded MA for 12 weeks on seven randomly selected dogs. These microchips are recent introductions in clinical studies, and we were interested in an a priori assessment of the technical validity of this tool in a limited sample. The sensor was placed on a neck collar. The epoch length of the count acquisition was set at 2 min. The intensity of the MA for each count was recorded and translated to numerical values (no unit). The data recorded at D0, D30 and D90 were externally excluded from analyses because they did not represent the true MA as the dogs were handled at the clinic. To reach the same interval of time for analysis, we excluded too D15, D45, D60 and D75. Therefore, data are represented in six consecutive periods (P(i)) of 14-day average total intensities. Three daily time periods (night from 20:00 to 07:00 h; morning from 07:02 to 13:00 h; and afternoon from 13:02 to 19:58 h) were established to stabilize data variability in further analyses. Moreover, the duration of MA was assessed over each 14-day period as the number of nonzero intensity counts.
Multifactorial pain questionnaire (MFQ)
An MFQ scale supporting OA disease-specific measures was designed, based on the content validity of previous reports [7–10]. Item selection and scale construction produced four subscales. The MFQ-Numerical Rating Scale (MFQ-NRS) is a five-point Likert scale (0–4) with 0 representing no pain and 4 the most excruciating pain perceived in dogs. The MFQ-Static (MFQ-S) scale was expected to measure the retrospective emotional functioning of the owner toward his/her OA-afflicted dog (Table 4). The MFQ-Dynamic (MFQ-D) scale measured prospective physical functioning (Table 5). Finally, the MFQ-Response to Treatment (MFQ-RTx) scale reported the satisfaction of treatment through a simple descriptive scale ranging from really better (−2); lightly better (−1); no change (0); lightly worse (1); to really worse (2).
Variability in data outcome for the repeated measures was determined at each time-point, for each dog by calculating the mean coefficient of variation (CV), as previously performed . The CV was calculated as the ratio of the standard deviation to the mean of the repeated measurements for the PVF (n = 5 at each time-point), the CSOM (n = 2 per week) and the EDA (n = 3 at each time point). For the CSOM, two values of the Act(i) sum in the same week were considered as duplicates, and these values were used for the dispersion analysis. This analysis was compulsory for the CSOM Med value distribution to approximate zero, which might mislead the CV. A mixed model analysis was used to compare changes in mean CV over time to estimate if the dispersion of the repeated measures was not different at each time point. The later was considered as good when time did not exert a significant effect in the model, finally, the internal consistency of the MFQ-S and the MFQ-D was assessed by the calculation of Cronbach's alpha. The threshold for good interrelatedness among items was set at > 0.7 .
Our analyses examined the responsiveness of the PVF and MA methods using a mixed-model method for repeated measures with time as fixed effect and subject as random effect, and provided fixed effect estimates by restricted likelihood modeling. The homogeneity of the variance assumption using the probabilities of Levene’s test was provided for each time. Normality distribution was confirmed using the Shapiro-Wilk test. Log-transformation was performed to fit normality when required. For covariance structure selection, we used goodness-of-fit statistics to compare models with the same fixed effects but different covariance structure. Also, normality and homogeneity of the variance of the models’ residuals were checked to assess the model validity [46, 47]. A multinomial logistic regression for repeated measures analyzed the CSOM Med , Act(i), Ctg(i), and MFQ subscales as discrete dependent variables. The Cochran-Mantel-Haenszel test was applied when the statistical model did not fit the assumptions of the multinomial logistic regression approach. A Poisson regression assessed EDA and the duration of activity (i.e., the number of active MA counts). We addressed missing data using pairwise deletion. When required, factors such as age at inclusion (plus or minus 6 years), sex (male or female), the anatomical location of the most affected limb (cranial or caudal leg), and the severity of the OA lesion based on the number of joints diagnosed by radiography, were tested in the statistical models. Another factor as the daily time periods (night, morning, afternoon) was also tested for MA. Only the significant factors were included in the final statistical models.
The descriptive statistics of the Spearman Rank correlation coefficient and their 95% interval confidence at the CSOM, EDA, MA endpoints were summarized by referencing their values to the PVFBW at D0, D30 and D90 to assess concurrent validityh. The estimated 95% confidence limits represented the 25th and 975th rank-ordered values from the 1000 bootstrap resampling of 23 dogs . For predictive validityi, we first described the magnitude of the systematic differences of the same outcomes between D0 and D30 and D30 and D90. Hence, the inferential statistics using regression analyses were performed to assess the relationship of the PVFBW to the CSOM, the EDA and MA at the three time points. A regression analysis of the CSOM and MA was also performed on the continuous recordings of the seven dogs.
Statistical analyses were performed using the GLIMMIX and MIXED procedures in the SAS software (version 9.1, SAS Institute, Inc., Cary, NC). The α-level of significance was set at 5%. For the correction of the multiplicity of the clinical endpoints (PVF, CSOM, and EDA), the significant level of the statistical models was set at the α/(k) level, where an α of 5% is the original Type I error, and k is the number of primary endpoints to be performed . As a result, the corrected Type I error probability was set at 0.05/3 = 0.017 for the Type 3 tests, which tested for the significance of each of the fixed effects specified in each model. When the statistical model result yielded significant main effect for time, Bonferroni’s adjustment was applied at the 5% α-threshold for post-hoc repeated measures of the same method (adjusted P-value cited as Padj). Descriptive statistics of the measured outcomes at each time are presented as the mean ± SEM and the median (25th to 75th rank-ordered values) for the ordinal data.
aConceptual validity is the a priori acceptation that the attribute (or scientific construct, i.e. canine osteoarthritic pain in our case) to be measured produces variations in the measurement outcomes (i.e. pain scales in the actual context). It refers to an ideal outcome that directly measures an important change in the patients' health status that is the result of the study intervention.
bTechnical validity is the evidence base for technical properties of the methods including intra- and inter-reliability, and (a number of different forms of) validity.
cPsychometrics is the field of study consisting in a single psychological attribute (i.e. animal pain) measurement (metrology) with one or multiple items (i.e. behavioral characteristics as part of pain expression) and establishing the validation of the developed measurement method by referencing to its technical validity (also cited as psychometric features).
dSensitivity is the ability to detect differences between subjects (or subjects between groups).
eResponsiveness is the ability to detect a change when a subject improves or deteriorates.
fReliability concerns the random variability associated with the measurements. Reliability testing consists in determining that results are consistent across repeated measures over time and by different observers. Internal consistency is part of the assessment of the reliability in multi-item scales as it tests the homogeneity of the content of a composite scale.
gCriterion validities assess an instrument against a criterion measure known to be valid (also called “true value” or “gold standard”).
Criterion validity could be hconcurrent validity, which involves a parallel comparison of the new instrument against a well-established method, or ipredictive validity, which usually makes a prediction of future test results.
A jconstruct is an explanatory variable, which is not directly observable and is constructed from a theoretical concept (see a).
kFace validity refers to the degree of symptomatic resemblance between the developed instrument or outcome measurement and the intended topic or clinical condition.
lConstruct validity refers to the degree to which a developed instrument measures the scientific construct that is designed to measure.
ET is actual Chair of the Non-Human Species – Special Interest Group of the International Association for the Study of Pain (http://www.iasp-pain.org/SIGs/NonHuman/), member of the Research and Education Committee of the International Veterinary Academy of Pain Management (http://www.ivapm.org/) as well as founding member and secretary of the 4AVET association (http://www.4avet.org).
Client-specific outcome measures
Non-steroidal anti-inflammatory drug
Body weight change-adjusted peak vertical force
Johnston SA: Osteoarthritis: joint anatomy, physiology, and pathobiology. Vet Clin North Am Small Anim Pract. 1997, 27: 699-723.
Gordon WJ, Conzemius MG, Riedesel E, Besancon MF, Evans R, Wilke V, Ritter MJ: The relationship between limb function and radiographic osteoarthrosis in dogs with stifle osteoarthrosis. Vet Surg. 2003, 32 (5): 451-454. 10.1053/jvet.2003.50051.
Dray A, Read S: Arthritis and pain. Future targets to control osteoarthritis pain. Arthritis Res Ther. 2007, 9 (3): 212-10.1186/ar2178.
Brandt KD, Dieppe P, Radin EL: Etiopathogenesis of Osteoarthritis. Rheum Dis Clin North Am. 2008, 34 (3): 531-559. 10.1016/j.rdc.2008.05.011.
Goldring SR: The Role of Bone in Osteoarthritis Pathogenesis. Rheum Dis Clin North Am. 2008, 34 (3): 561-571. 10.1016/j.rdc.2008.07.001.
Pollard B, Dixon D, Dieppe P, Johnston M: Measuring the ICF components of impairment, activity limitation and participation restriction: an item analysis using classical test theory and item response theory. Health Qual Life Outcomes. 2009, 7 (1): 41-10.1186/1477-7525-7-41.
Hielm-Bjöorkman AK, Kuusela E, Liman A, Markkola A, Saarto E, Huttunen P, Leppaluoto J, Tulamo RM, Raekallio M: Evaluation of methods for assessment of pain associated with chronic osteoarthritis in dogs. J Am Vet Med Assoc. 2003, 222 (11): 1552-1558. 10.2460/javma.2003.222.1552.
Brown DC, Boston RC, Coyne JC, Farrar JT: Development and psychometric testing of an instrument designed to measure chronic pain in dogs with osteoarthritis. Am J Vet Res. 2007, 68 (6): 631-637. 10.2460/ajvr.68.6.631.
Hudson JT, Slater MR, Taylor L, Scott HM, Kerwin SC: Assessing repeatability and validity of a visual analogue scale questionnaire for use in assessing pain and lameness in dogs. Am J Vet Res. 2004, 65 (12): 1634-1643. 10.2460/ajvr.2004.65.1634.
Wiseman-Orr ML, Scott EM, Reid J, Nolan AM: Validation of a structured questionnaire as an instrument to measure chronic pain in dogs on the basis of effects on health-related quality of life. Am J Vet Res. 2006, 67 (11): 1826-1836. 10.2460/ajvr.67.11.1826.
Brown DC, Boston RC, Coyne JC, Farrar JT: Ability of the Canine Brief Pain Inventory to detect response to treatment in dogs with osteoarthritis. J Am Vet Med Assoc. 2008, 233 (8): 1278-1283. 10.2460/javma.233.8.1278.
Hielm-Björkman AK, Rita H, Tulamo R-M: Psychometric testing of the Helsinki chronic pain index by completion of a questionnaire in Finnish by owners of dogs with chronic signs of pain caused by osteoarthritis. Am J Vet Res. 2009, 70 (6): 727-734. 10.2460/ajvr.70.6.727.
Hielm-Björkman AK, Tulamo RM, Salonen H, Raekallio M: Evaluating Complementary Therapies for Canine Osteoarthritis Part II: A Homeopathic Combination Preparation (Zeel(R). Evid Based Complement Alternat Med. 2009, 6 (4): 465-471. 10.1093/ecam/nem143.
Hielm-Björkman AK, Tulamo RM, Salonen H, Raekallio M: Evaluating Complementary Therapies for Canine Osteoarthritis Part I: Green-lipped Mussel (Perna canaliculus). Evid Based Complement Alternat Med. 2009, 6 (3): 365-373. 10.1093/ecam/nem136.
Moreau M, Lussier B, Pelletier JP, Martel-Pelletier J, Bédard C, Gauvin D, Troncy E: Brachystemma calycinum D. Don effectively reduces the locomotor disability in dogs with naturally occurring osteoarthritis: A randomized placebo-controlled trial. Evid Based Complement Alternat Med. 2012, 10.1155/2012/646191.
Smith GK, Mayhew PD, Kapatkin AS, McKelvie PJ, Shofer FS, Gregor TP: Evaluation of risk factors for degenerative joint disease associated with hip dysplasia in German Shepherd Dogs, Golden Retrievers, Labrador Retrievers, and Rottweilers. J Am Vet Med Assoc. 2001, 219 (12): 1719-1724. 10.2460/javma.2001.219.1719.
Clements DN, Carter SD, Innes JF, Ollier WER: Genetic basis of secondary osteoarthritis in dogs with joint dysplasia. Am J Vet Res. 2006, 67 (5): 909-918. 10.2460/ajvr.67.5.909.
Gingerich DA, Strobel JD: Use of client-specific outcome measures to assess treatment effects in geriatric, arthritic dogs: controlled clinical evaluation of a nutraceutical. Vet Ther. 2003, 4 (4): 376-386.
Lascelles BDX, Gaynor JS, Smith ES, Roe SC, Marcellin-Little DJ, Davidson G, Boland E, Carr J: Amantadine in a Multimodal Analgesic Regimen for Alleviation of Refractory Osteoarthritis Pain in Dogs. J Vet Intern Med. 2008, 22 (1): 53-59. 10.1111/j.1939-1676.2007.0014.x.
Rumph PF, Kincaid SA, Visco DM, Baird DK, Kammermann JR, West MS: Redistribution of vertical ground reaction force in dogs with experimentally induced chronic hindlimb lameness. Vet Surg. 1995, 24 (5): 384-389. 10.1111/j.1532-950X.1995.tb01348.x.
Budsberg SC: Long-term temporal evaluation of ground reaction forces during development of experimentally induced osteoarthritis in dogs. Am J Vet Res. 2001, 62 (8): 1207-1211. 10.2460/ajvr.2001.62.1207.
Vasseur PB, Johnson AL, Budsberg SC, Lincoln JD, Toombs JP, Whitehair JG, Lentz EL: Randomized, controlled trial of the efficacy of carprofen, a nonsteroidal anti-inflammatory drug, in the treatment of osteoarthritis in dogs. J Am Vet Med Assoc. 1995, 206 (6): 807-811.
Budsberg SC, Johnston SA, Schwarz PD, DeCamp CE, Claxton R: Efficacy of etodolac for the treatment of osteoarthritis of the hip joints in dogs. J Am Vet Med Assoc. 1999, 214 (2): 206-210.
Moreau M, Dupuis J, Bonneau NH, Desnoyers M: Clinical evaluation of a nutraceutical, carprofen and meloxicam for the treatment of dogs with osteoarthritis. Vet Rec. 2003, 152 (11): 323-329. 10.1136/vr.152.11.323.
Moreau M, Lussier B, Doucet M, Vincent G, Martel-Pelletier J, Pelletier JP: Efficacy of licofelone in dogs with clinical osteoarthritis. Vet Rec. 2007, 160 (17): 584-588. 10.1136/vr.160.17.584.
Wilson AC, Palermo TM: Physical Activity and Function in Adolescents With Chronic Pain: A Controlled Study Using Actigraphy. J Pain. 2012, 13 (2): 121-130. 10.1016/j.jpain.2011.08.008.
Hansen BD, Lascelles BDX, Keene BW, Adams AK, Thomson AE: Evaluation of an accelerometer for at-home monitoring of spontaneous activity in dogs. Am J Vet Res. 2007, 68 (5): 468-475. 10.2460/ajvr.68.5.468.
Brown DC, Boston RC, Farrar JT: Use of an activity monitor to detect response to treatment in dogs with osteoarthritis. J Am Vet Med Assoc. 2010, 237 (1): 66-70. 10.2460/javma.237.1.66.
Conzemius MG, Evans RB, Besancon MF, Gordon WJ, Horstman CL, Hoefle WD, Nieves MA, Wagner SD: Effect of surgical technique on limb function after surgery for rupture of the cranial cruciate ligament in dogs. J Am Vet Med Assoc. 2005, 226 (2): 232-236. 10.2460/javma.2005.226.232.
Trumble TN, Billinghurst RC, Bendele AM, McIlwraith CW: Evaluation of changes in vertical ground reaction forces as indicators of meniscal damage after transection of the cranial cruciate ligament in dogs. Am J Vet Res. 2005, 66 (1): 156-163. 10.2460/ajvr.2005.66.156.
Moreau M, Rialland P, Pelletier JP, Martel-Pelletier J, Lajeunesse D, Boileau C, Caron J, Frank D, Lussier B, Del Castillo JRE, et al: Tiludronate treatment improves structural changes and symptoms of osteoarthritis in the canine anterior cruciate ligament model. Arthritis Res Ther. 2011, 13 (3): R98-10.1186/ar3373.
Streiner DL, Norman GR: Health measurement scales: a practical guide to their development and use. 2003, New York: Oxford University Press, 3
Turk DC, Dworkin RH, McDermott MP, Bellamy N, Burke LB, Chandler JM, Cleeland CS, Cowan P, Dimitrova R, Farrar JT, et al: Analyzing multiple endpoints in clinical trials of pain treatments: IMMPACT recommendations. Pain. 2008, 139 (3): 485-493. 10.1016/j.pain.2008.06.025.
Lascelles BDX, Hansen BD, Simon R, Venita D, Andrea T, Courtney CP, Eric SS, Elizabeth R: Evaluation of Client-Specific Outcome Measures and Activity Monitoring to Measure Pain Relief in Cats with Osteoarthritis. J Vet Intern Med. 2007, 21 (3): 410-416. 10.1111/j.1939-1676.2007.tb02983.x.
Hielm-Björkman AK, Kapatkin AS, Rita HJ: Reliability and validity of a visual analogue scale used by owners to measure chronic pain attributable to osteoarthritis in their dogs. Am J Vet Res. 2011, 72 (5): 601-607. 10.2460/ajvr.72.5.601.
Skene SS, Kenward MG: The analysis of very small samples of repeated measurements II: A modified Box correction. Stat Med. 2010, 29 (27): 2838-2856. 10.1002/sim.4072.
Richardson CA, Niel L, Leach MC, Flecknell PA: Evaluation of the efficacy of a novel electronic pain assessment device, the Pain Gauge, for measuring postoperative pain in rats. Lab Anim. 2007, 41 (1): 46-54. 10.1258/002367707779399455.
Pollard B, Guilford WG, Ankenbauer-Perkins KL, Hedderley D: Clinical efficacy and tolerance of an extract of green-lipped mussel (Perna canaliculus) in dogs presumptively diagnosed with degenerative joint disease. N Z Vet J. 2006, 54 (3): 114-118. 10.1080/00480169.2006.36622.
Roush JK, Cross AR, Renberg WC, Dodd CE, Sixby KA, Fritsch DA, Allen TA, Jewell DE, Richardson DC, Leventhal PS, et al: Evaluation of the effects of dietary supplementation with fish oil omega-3 fatty acids on weight bearing in dogs with osteoarthritis. J Am Vet Med Assoc. 2010, 236 (1): 67-73. 10.2460/javma.236.1.67.
Fritsch DA, Allen TA, Dodd CE, Jewell DE, Sixby KA, Leventhal PS, Brejda J, Hahn KA: A multicenter study of the effect of dietary supplementation with fish oil omega-3 fatty acids on carprofen dosage in dogs with osteoarthritis. J Am Vet Med Assoc. 2010, 236 (5): 535-539. 10.2460/javma.236.5.535.
Moreau M, Troncy E, Bichot S, Lussier B: Influence of Changes in Body Weight on Peak Vertical Force in Osteoarthritic Dogs: A Possible Bias in Study Outcome. Vet Surg. 2010, 39 (1): 43-47. 10.1111/j.1532-950X.2009.00621.x.
Bui LM, Bierer TL: Influence of green lipped mussels (Perna canaliculus) in alleviating signs of arthritis in dogs. Vet Ther. 2003, 4 (4): 397-407.
Lascelles BD, McFarland JM, Swann H: Guidelines for safe and effective use of NSAIDs in dogs. Vet Ther. 2005, 6 (3): 237-251.
Vangsness CT, Spiker W, Erickson J: A Review of Evidence-Based Medicine for Glucosamine and Chondroitin Sulfate Use in Knee Osteoarthritis. Arthroscopy. 2009, 25 (1): 86-94. 10.1016/j.arthro.2008.07.020.
Official Publication (Association of American Feed Control Officials). 2003, Oxford
Littell RC, Pendergast J, Natarajan R: Modelling covariance structure in the analysis of repeated measures data. Stat Med. 2000, 19 (13): 1793-1819. 10.1002/1097-0258(20000715)19:13<1793::AID-SIM482>3.0.CO;2-Q.
Littell RC, Milliken GA, Stroup WW, Wolfinger RD, Schabenberber O: SAS for Mixed Models. 2006, Cary: SAS Publishing, 2
Haukoos JS, Lewis RJ: Advanced Statistics: Bootstrapping Confidence Intervals for Statistics with “Difficult” Distributions. Acad Emerg Med. 2005, 12 (4): 360-365. 10.1111/j.1553-2712.2005.tb01958.x.
The authors are grateful to Mrs. Anne-Andrée Mignault and Katherine Bernier, for clinical assistance and technical expertise, Guy Beauchamp for the statistical analyses. This study was supported by an unrestricted operating grant (BL, ET) from Medi-Cal/Royal Canin Canada, Inc.; an ongoing New Opportunities Fund grant (ET) from the Canada Foundation for Innovation (#9483); and a Discovery grant (ET) from the Natural Sciences and Engineering Research Council of Canada (#327158-2008).
All authors declare no competing interest in this publication.
Conception and design: MM, BL, JPP, JMP, ET. Acquisition and interpretation of the data: SB, PR, MM, BL, JPP, ET. Collection and assembly of data: PR, SB, MM, BL, JPP, ET. Provision of study materials or patients: SB, MM, BL. Statistical expertise: PR, MG, ET. Drafting the article: PR, SB, ET. Critical revision of the article for important intellectual content: All authors. All authors read and approved the final manuscript. Acquisition of funding: ET, BL. Administrative, technical, or logistic support: PR, SB, MM, MG, ET. ET takes the responsibility for the integrity of the work as a whole.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Rialland, P., Bichot, S., Moreau, M. et al. Clinical validity of outcome pain measures in naturally occurring canine osteoarthritis. BMC Vet Res 8, 162 (2012). https://doi.org/10.1186/1746-6148-8-162
- Dog osteoarthritis
- Behavioral scales
- Skin conductance