- Research article
- Open Access
Comparison of risk factors for seropositivity to feline immunodeficiency virus and feline leukemia virus among cats: a case-case study
BMC Veterinary Research volume 11, Article number: 30 (2015)
Feline immunodeficiency virus (FIV) and feline leukemia virus (FeLV) are reported to have similar risk factors and similar recommendations apply to manage infected cats. However, some contrasting evidence exists in the literature with regard to commonly reported risk factors. In this study, we investigated whether the known risk factors for FIV and FeLV infections have a stronger effect for either infection. This retrospective study included samples from 696 cats seropositive for FIV and 593 cats seropositive for FeLV from the United States and Canada. Data were collected during two cross sectional studies, where cats were tested using IDEXX FIV/FeLV ELISA kits. To compare the effect of known risk factors for FIV infection compared to FeLV, using a case-case study design, random intercept logistic regression models were fit including cats’ age, sex, neuter status, outdoor exposure, health status and type of testing facility as independent variables. A random intercept for testing facility was included to account for clustering expected in testing practices at the individual clinics and shelters.
In the multivariable random intercept model, the odds of FIV compared to FeLV positive ELISA results were greater for adults (OR = 2.09, CI: 1.50-2.92), intact males (OR = 3.14, CI: 1.85-3.76), neutered males (OR = 2.68, CI: 1.44- 3.14), cats with outdoor access (OR = 2.58, CI: 1.85-3.76) and lower for cats with clinical illness (OR = 0.60, 95% CI: 0.52-0.90). The variance components obtained from the model indicated clustering at the testing facility level.
Risk factors that have a greater effect on FIV seropositivity include adulthood, being male (neutered or not) and having access to outdoors, while clinical illness was a stronger predictor for FeLV seropositivity. Further studies are warranted to assess the implications of these results for the management and control of these infections.
Infections with feline immunodeficiency virus (FIV) and feline leukemia virus (FeLV) are two of the most common and important infectious diseases of cats [1,2]. The most common mode of transmission of FIV is through bites [3,4]. FeLV infection is also commonly acquired via the oro-nasal route through mutual grooming, nursing or sharing of dishes apart from bites . The known risk factors for acquiring these infections are male sex, adulthood and exposure to outdoors, whereas being neutered and indoor lifestyle are known protective factors . However, the relative importance attributed to age, outdoor exposure and sex among infected cats is variable in the literature. Some studies indicate that FeLV infections are age-dependent  and primarily acquired by “friendly” cats through prolonged close contact between virus shedders and susceptible cats through mutual grooming, sharing of food and water dishes, and use of common litter areas . However, other studies have indicated adulthood [1,7], outdoor lifestyle [1,7], being not neutered , and fighting [8,9], factors commonly associated with FIV, to also be associated with FeLV infection. Thus, further research is necessary to investigate the relative importance of these factors to help in management and prevention of these infections.
Case–control studies are often used in analytical epidemiology to examine the strength, magnitude and direction of associations between exposure variables and an outcome of interest . Case-case studies are a variant of case–control studies when the disease of interest can be sub-classified in two or several groups that may have distinct risk factors . A case–case study differs from a case–control study in that the comparison group (or controls) are also selected among the cases, typically with same disease but a different strain or serotype, from the same surveillance system . The case-case study approach has been used increasingly in epidemiology e.g. to compare risk factors for two subtypes of the same disease with the goal of ascertaining relative importance of risk factors for either subtype . The main advantage of the case-case design is its ability to limit selection and information biases: control cases have similar clinical features, are identified through the same system and are subject to the same biases as cases [11,12]. The goal of this study was to assess the relative importance of known risk factors between the two common feline retroviral infections, FIV and FeLV, using the case-case study approach.
Data source and study participants
A dataset consisting of diagnostic test results from 29,182 cats tested for FIV and FeLV between August and November of the year 2004 and 2007 from the United States (US) and Canada was obtained from two previous cross-sectional studies [1,7]. The cats included in these studies were conveniently sampled from veterinary clinics and animal shelters across 40 contiguous states of the US and 9 Canadian provinces encompassing 641 US zip codes and Canadian forward sortation areas in 346 US counties and Canadian Census Divisions. The first study investigated cats in the US and Canada while the second study was restricted to the Canadian cat population.
Data collection has been described elsewhere [1,7]. Briefly, potential veterinary clinic participants in the US were identified from the membership roster of the American Association of Feline Practitioners (AAFP) as well as from the list of all individuals who had purchased test kits for FIV and FeLV. Potential animal shelter participants (including cat rescue organisations, and groups participating in Trap-Neuter-Release (TNR) programs) were derived from various Internet directories . In Canada, potential veterinary clinic and animal shelter (including cat rescue programs and feral cat programs in Canada) participants were identified as all those who had purchased test kits for FIV or FeLV or submitted samples to a diagnostic laboratory . Potential study participants were sent an invitation letter to participate in the study. Enrolled participants submitted the diagnostic results for FIV and FeLV along with information on age, sex, neuter status, outdoor exposure, health status and test date using a standard reporting form. The testing and reporting was performed from August to November 2004 for the American and Canadian participants in the first study and from August to November 2007 for the Canadian participants in the second study.
The testing for FIV and FeLV was carried out in-house or in-laboratory employing a commercially available ELISA (SNAP® Combo FeLV antigen/FIV antibody, PetCheck® FIV Antibody and PetCheck® FeLV Antigen; IDEXX Laboratories) using whole blood, serum or plasma. The manufacturer reported sensitivity and specificity of the assay for detecting FeLV antigen of 97.6% and 99.1%, and for detecting FIV antibodies of 100% and 99.5%, respectively. Confirmatory testing was not performed.
Information on postal code of testing facility, type of testing facility (clinic or shelter), age of the cat (juvenile [<6 months] or adult), sex and neuter status (sexually intact female, spayed female, sexually intact male or neutered male), access to outdoors (indoors or outdoors) and general health at time of testing (healthy or sick) was also retrieved from the dataset (Table 1).
Selection of study subjects: FIV and FeLV case groups
Cats testing positive for FIV antibodies in ELISA were compared to cats testing positive for FeLV antigen with all the cats having been tested for both infections. Cats were excluded from further analysis in this study if they tested positive for both FIV and FeLV.
Logistic regression models were fit to model the logit of the probability of FIV seropositivity as a function of predictor variables age, sex/neuter status, outdoor exposure, health status and testing facility in a random intercept logistic regression model framework.
Variables were screened for inclusion into the multivariable logistic regression model by fitting univariable logistic regression models, without random intercepts, and those predictor variables with a liberal significance level (α = 0.2) were selected. However, care was taken not to remove predictor variables that were deemed clinically relevant. Since all the predictor variables were categorical (i.e. indicator variables), the significance in the model of each group of the predictors was analyzed by applying a likelihood ratio test. Collinearity among the predictor variables with significant unconditional association with FIV seropositivity was assessed by using the Spearman rank-correlation test. When two variables were collinear, the one with the smaller P-value was considered for further multivariable analysis while the other was removed.
Backward selection was employed for multivariable model building and covariate removal from the model was based on the following criteria: (1) the highest non-significant P-value (with significance level α = 0.05); (2) a likelihood ratio test of the model with and without the variable that was non-significant and (3) the variable was not an important confounder for other variables in the model. A confounder was a non-intervening covariate whose removal from the model resulted in greater than 20% change in coefficients on the log-odds scale for any of the remaining variables in the model. Two-way interaction terms among type of testing facility, health status, outdoor exposure, age and sex were also assessed for statistical significance. However, interaction terms were dropped when these led to sparse cells and unrealistic estimates. Multicollinearity was tested among screened variables in the multivariable logistic regression model by estimating the variance inflation factor (VIF). All variables with a VIF value of 10 or above were considered to indicate multicollinearity, assuming that this was not due to variable construction (e.g. interaction terms) . Non-nested multivariable models were compared using the Akaike Information Criterion (AIC), and the model with lowest AIC value was considered to be better fitting.
To account for clustering by testing facility (i.e. clinics or shelters), all multivariable logistic regression models included a random intercept for testing facility. Relevance of the random effect term for facility ID was assessed by inspection of the variance component. A simpler model (without random effects) was chosen when the variance component was close to zero . Fit of the random effect model was assessed visually by plotting the QQ-plots of the Best Linear Unbiased Predictors (BLUPs) against the normal scores .
The random intercept models were fit in statistical software R (lme4 package) and Stata (xtmelogit) by seven point Gauss-Hermite adaptive quadrature method [14,15], using complete cases (i.e., any observations with missing values excluded from the analysis). However, the point estimates from the final model were compared to the same model fit with missing values (coded as unknown) to observe any gross deviation in direction and magnitude.
The Research Ethics Board at the University of Guelph did not require ethics approval for this study because secondary data was used without either patient or owner identifiers.
Table 1 presents the descriptive statistics of FIV and FeLV cases cross-tabulated by risk factors. The total number of cases included in this study was 1289. Out of these retroviral cases, 696 tested positive for FIV and 593 for FeLV.
Logistic regression analysis
All covariates met the inclusion criteria for multivariable modeling as explained above (Table 2). The final multivariable random intercept logistic regression model included the covariates/predictors age, sex/neuter status, outdoor exposure, and health status of cats (Table 3). The odds ratio (OR) associated with each variable is adjusted for the remaining variables in the model. No significant interactions were detected between the variables that remained in the final multivariable model.
The odds of cats being seropositive for FIV relative to FeLV was significantly greater for adult cats than juvenile cats (Table 3). Similarly, the intact and neutered males were significantly more likely to be seropositive for FIV than FeLV compared to intact females. The odds of being seropositive for FIV relative to FeLV was not significantly different between intact and spayed females based on the Wald test. Compared to cats kept indoors, cats with known outdoor exposure had higher odds of being seropositive for FIV relative to FeLV. For clinically ill cats, the odds of being seropositive for FIV relative to FeLV were smaller compared to cats without clinical illness.
The variance components obtained from the multilevel logistic regression model for the individual level and clinic/shelter level were 3.29 and 1.16, respectively.
A random effects logistic regression model was deemed appropriate due to clustering expected for cats tested within the same facility and because the variance of the random effect was 3.29, which given the associated small standard error was interpreted as the variance being different from zero (Table 3). Normal quantile plot of the BLUPs indicated no gross deviation from normality.
This case-case study is based on cross-sectional or prevalence data and thus generally not suited to identify risk factors. However, only known risk factors  were evaluated in this study with respect to their importance as risk factors for infection with FIV compared to FeLV. The results from this study imply that risk factors commonly associated with FIV and FeLV differ in their relative effects for these two diseases. For example adult, male, or outdoor cats are more likely to be seropositive for FIV than FeLV when compared to juvenile, female or cats kept exclusively indoors. In contrast, neuter status was not significantly different for either infection. Further, whether cats were tested at clinics or shelters was not different for these infections.
Most FIV infections are acquired as a consequence of bite wounds inflicted by an infected cat, presumably through inoculation of virus or virus infected cells [16,17]. Although, vertical transmission of infection from queen to kitten may occur, it is considered rare . Adult, male, outdoor exposed cats would be expected to have a higher likelihood of getting infected with FIV due to higher likelihood of encountering infected cats, and being prone to aggression and territorial fights. On the contrary, most FeLV infections occur after oro-nasal spread of the virus from the viremic cats [17,19-22]. FeLV infection, thus, is a concern in cats that are “friendly” and in close contact with infected cats through nursing, mutual grooming or sharing dishes, but also through bites .
This study found a higher likelihood of FIV (compared to FeLV) seropositivity in adults. In contrast to FIV, FeLV is reported to be age dependent with older cats becoming increasingly resistant to infection [23,24]. Of note, however, is the fact that while age at acquisition is similar for both infections, FeLV can cause serious, often fatal, disease. As a result, FeLV-infected cats have shorter survival rates [25,26] and not many live to adulthood, while most FIV infected cats do.
Higher probability of infection can be expected in males compared to females for FIV [9,27-37]. But for FeLV, most studies did not find an association between sex and seropositivity [28,38] except for a single report . The association between male sex and FIV infection has been primarily related to increased risk of infection transmission due to greater predisposition of males to exhibit territorial behaviour involving fighting. In this study, regression models included contrasts to compare the likelihood of seropositivity of FIV between intact and neutered male cats as well as between intact and spayed female cats. Although, compared to females, males were found to be more likely to test seropositive for FIV compared to FeLV, no significant differences were evident between intact and neutered cats for the same sex (Table 3 and 4). Various studies have reported an association between neutering and lower risk of infection of FIV and FeLV among domestic cats . However, there are reports suggesting that neutering and spaying have no significant effect on the prevalence of FIV [27,39,40] and that such cats still retain territorial aggressiveness [39,40]. It should be noted that when a predictor is common to both FIV and FeLV, due to its inherent design, a case–case study might not detect a difference between the two case groups. In other words, if neutering were significantly associated with both FIV and FeLV seropositivity, this study design would not detect it. Since a higher likelihood of seropositivity was found in intact compared to neutered cats when non-infected cats were included [1,7], it is possible that sterilization characteristics are not different between FIV and FeLV infected cats.
Cats were more likely seropositive for FIV than FeLV when exposed to outdoors than being indoors. This finding suggests that outdoor exposure is more important to acquire FIV infection than FeLV. Considering prevalence studies where non-infected cats were included, there seems to be consensus that the probability of FIV infection is higher for cats that roam outdoors [9,41] due increased opportunity for transmission via fights. In contrast, the relationship between outdoor exposure and FeLV infection is not very clear.
Healthy cats were more likely to test positive for FIV than FeLV compared to cats presenting as ill at the time of testing. Both viruses induce immunodeficiency, but FeLV is more rapidly pathogenic and its effects manifest sooner and include other disease conditions . FIV infection causes gradually developing immunodeficiency and has only a minor impact on lifespan. Therefore, cats with FeLV are more likely to be presented with illness. This contributes to more sick cats testing FeLV positive rather than FIV positive.
The variance components of the random effects model indicate that some degree of clustering was evident at testing facility (ICC = 0.26) suggesting that FIV seropositive status compared to FeLV was not independent of shelter or clinic.
A few important limitations of the case-case study design in the context of this study merits attention. For a detailed account of pros and cons of case-case studies in general the reader is referred to McCarthy and Giesecke . This study entailed comparison of FIV seropositive cats to FeLV seropositive cats with regard to known risk factors and explored the strength of their effects between the two infections. Therefore, care should be taken before extrapolating results of this study to the general population with non-infected cats. The risk factors that are common to both comparison groups tend to be underestimated or unidentified in a case-case study [11,12]. Since the study does not include a disease-free population, the odds ratios can only be interpreted as the odds of exposure to one disease group (FIV) in reference to the other (FeLV), and do not provide the estimate of the association between a risk factor and disease in the general population [42,43].
In conclusion, while similar risk factors have been reported for both FIV and FeLV infection, this study demonstrated, through comparison of one infection with the other, that adulthood, being male (neutered or not) and having access to outdoors are of greater importance to FIV seropositivity compared to FeLV. Clinical illness was a stronger predictor for FeLV seropositivity. Further studies are warranted to assess the implications of these findings in regard to the management and control of these infections.
Feline Immunodeficiency Virus
Feline Leukemia Virus
Enzyme Linked Immunosorbent Assay
American Association of Feline Practitioners
Variance Inflation Factor
Akaike Information Criterion
Best Linear Unbiased Predictors
Levy JK, Scott HM, Lachtara JL, Crawford PC. Seroprevalence of feline leukemia virus and feline immunodeficiency virus infection among cats in North America and risk factors for seropositivity. J Am Vet Med Assoc. 2006;228(3):371–6.
Little S, Bienzle D, Carioto L, Chisholm H, O’Brien E, Scherk M. Feline leukemia virus and feline immunodeficiency virus in Canada: recommendations for testing and management. Can Vet J. 2011;52(8):849–55.
Levy J. Feline leukemia virus and feline immunodeficiency virus. In: Miller L, Hurley K, Hoboken F, editors. Infectious disease management in animal shelters. NJ, USA: Wiley-Blackwell; 2009. p. 307–17.
Sellon RK, Hartmann K. Feline immunodeficiency virus infection. In: Greene CE, editor. Infectious diseases of the dog and cat. 3rd ed. Philadelphia, USA: Elsevier; 2006. p. 131–42.
Levy J, Crawford C, Hartmann K, Hofmann-Lehmann R, Little S, Sundahl E, et al. 2008 American Association of Feline Practitioners’ feline retrovirus management guidelines. J Feline Med Surg. 2008;10(3):300–16.
Hoover EA, Olsen RG, Hardy WD, Schaller JP, Mathes LE. Feline leukemia virus infection: age-related variation in response of cats to experimental infection. J Nat Cancer Inst. 1976;57(2):365–9.
Little S, Sears W, Lachtara J, Bienzle D. Seroprevalence of feline leukemia virus and feline immunodeficiency virus infection among cats in Canada. Can Vet J. 2009;50(6):644–8.
Goldkamp CE, Levy JK, Edinboro CH, Lachtara JL. Seroprevalences of feline leukemia virus and feline immunodeficiency virus in cats with abscesses or bite wounds and rate of veterinarian compliance with current guidelines for retrovirus testing. J Am Vet Med Assoc. 2008;232(8):1152–8.
Gleich SE, Krieger S, Hartmann K. Prevalence of feline immunodeficiency virus and feline leukaemia virus among client-owned cats and risk factors for infection in Germany. J Feline Med Surg. 2009;11(12):985–92.
Dohoo IR, Martin W, Stryhn H. Veterinary Epidemiologic Research. AVC Inc: Charlottetown; 2009.
McCarthy N, Giesecke J. Case-case comparisons to study causation of common infectious diseases. Int J Epidemiol. 1999;28(4):764–8.
Wilson N, Baker M, Edwards R, Simmons G. Case-case analysis of enteric diseases with routine surveillance data: Potential use and example results. Epidemiol Perspect Innov. 2008;5:6.
Twisk JWR. Applied multilevel analysis : a practical guide. Cambridge, UK; New York: Cambridge University Press; 2006.
R Development Core Team. R: a language and environment for statistical computing. In: R Foundation for Statistical Computing, Vienna, Austria. 2011. ISBN 3-900051-07-0.
StataCorp. Stata Statistical Software: Release 11. College Station, TX: StataCorp LP; 2009.
Yamamoto JK, Hansen H, Ho EW, Morishita TY, Okuda T, Sawa TR, et al. Epidemiologic and clinical aspects of feline immunodeficiency virus infection in cats from the continental United States and Canada and possible mode of transmission. J Am Vet Med Assoc. 1989;194(2):213–20.
Dunham SP, Graham E. Retroviral infections of small animals. Vet Clin North Am Small Anim Pract. 2008;38(4):879–901.
Allison RW, Hoover EA. Feline immunodeficiency virus is concentrated in milk early in lactation. AIDS Res Hum Retroviruses. 2003;19(3):245–53.
Jarrett O, Hardy WD, Golder MC, Hay D. The frequency of occurrence of feline leukaemia virus subgroups in cats. Int J Cancer. 1978;21(3):334–7.
Jarrett O, Golder MC, Stewart MF. Detection of transient and persistent feline leukaemia virus infections. Vet Rec. 1982;110(10):225–8.
Jarrett WF, Martin WB, Crighton GW, Dalton RG, Stewart MF. Transmission Experiments with Leukemia (Lymphosarcoma). Nature. 1964;202:566–7.
Jarrett WF, Crawford EM, Martin WB, Davie F. A Virus-Like Particle Associated with Leukemia (Lymphosarcoma). Nature. 1964;202:567–9.
Grant CK, Essex M, Gardner MB, Hardy Jr WD. Natural feline leukemia virus infection and the immune response of cats of different ages. Cancer Res. 1980;40(3):823–9.
Essex M, Cotter S, Sliski A, Hardy Jr W, Stephenson J, Aaronson S, et al. Horizontal transmission of feline leukemia virus under natural conditions in a feline leukemia cluster household. Int J Cancer. 1977;19(1):90–6.
Addie DD, Dennis JM, Toth S, Callanan JJ, Reid S, Jarrett O. Long-term impact on a closed household of pet cats of natural infection with feline coronavirus, feline leukaemia virus and feline immunodeficiency virus. Vet Rec. 2000;146(15):419–24.
Hartmann K. Clinical aspects of feline immunodeficiency and feline leukemia virus infection. Vet Immunol Immunopathol. 2011;143(3–4):190–201.
Hitt ME, Spangler L, McCarville C. Prevalence of feline immunodeficiency virus in submissions of feline serum to a diagnostic laboratory in Atlantic Canada. Can Vet J. 1992;33(11):723–6.
Lee IT, Levy JK, Gorman SP, Crawford PC, Slater MR. Prevalence of feline leukemia virus infection and serum antibodies against feline immunodeficiency virus in unowned free-roaming cats. J Am Vet Med Assoc. 2002;220(5):620–2.
Ishida T, Washizu T, Toriyabe K, Motoyoshi S, Tomoda I, Pedersen NC. Feline immunodeficiency virus infection in cats of Japan. J Am Vet Med Assoc. 1989;194(2):221–5.
Spada E, Proverbio D, dellaPepa A, Perego R, Baggiani L, DeGiorgi GB, et al. Seroprevalence of feline immunodeficiency virus, feline leukaemia virus and Toxoplasma gondii in stray cat colonies in northern Italy and correlation with clinical and laboratory data. J Feline Med Surg. 2012;14(6):369–77.
O’Connor Jr TP, Tonelli QJ, Scarlett JM. Report of the national FeLV/FIV awareness project. J Am Vet Med Assoc. 1991;199(10):1348–53.
Shelton GH, Waltier RM, Connor SC, Grant CK. Prevalence of feline immunodeficiency virus and feline leukemia-virus infections in pet cats. J Am Anim Hosp Assoc. 1989;25(1):7–12.
Cohen ND, Carter CN, Thomas MA, Lester TL, Eugster AK. Epizootiologic association between feline immunodeficiency virus-infection and feline leukemia-virus seropositivity. J Am Vet Med Assoc. 1990;197(2):220–5.
Grindem CB, Corbett WT, Ammerman BE, Tomkins MT. Seroepidemiologic survey of feline immunodeficiency virus infection in cats of Wake County, North Carolina. J Am Vet Med Assoc. 1989;194(2):226–8.
Sukura A, Grohn YT, Junttila J, Palolahti T. Association between feline immunodeficiency virus antibodies and host characteristics in Finnish cats. Acta Vet Scand. 1992;33(4):325–34.
Ueland K, Lutz H. Prevalence of feline leukemia-virus and antibodies to feline immunodeficiency virus in cats in Norway. J Vet Med Ser B-Infectious Dis Vet Public Health. 1992;39(1):53–8.
Akhtardanesh B, Ziaali N, Sharifi H, Rezaei S. Feline immunodeficiency virus, feline leukemia virus and Toxoplasma gondii in stray and household cats in Kerman-Iran: seroprevalence and correlation with clinical and laboratory findings. Res Vet Sci. 2010;89(2):306–10.
Muirden A. Prevalence of feline leukaemia virus and antibodies to feline immunodeficiency virus and feline coronavirus in stray cats sent to an RSPCA hospital. Vet Rec. 2002;150(20):621–5.
Ravi M, Wobeser GA, Taylor SM, Jackson ML. Naturally acquired feline immunodeficiency virus (FIV) infection in cats from western Canada: prevalence, disease associations, and survival analysis. Can Vet J. 2010;51(3):271–6.
Yilmaz H, Ilgaz A, Harbour DA. Prevalence of FIV and FeLV infections in cats in Istanbul. J Feline Med Surg. 2000;2(1):69–70.
Hosie MJ, Addie D, Belak S, Boucraut-Baralon C, Egberink H, Frymus T, et al. Feline immunodeficiency. ABCD guidelines on prevention and management. J Feline Med Surg. 2009;11(7):575–84.
Pogreba-Brown K, Ernst K, Harris RB. Case-case methods for studying enteric diseases: a review and approach for standardization. OA Epidemiol. 2014;2(1):7.
Martínez ME, Cruz GI, Brewster AM, Bondy ML, Thompson PA. What can we learn about disease etiology from case-case analyses? Lessons from breast cancer. Cancer Epidemiol Biomarkers Prev. 2010;19(11):2710–4.
This research was supported through a PhD Fellowship from the Ontario Veterinary College and funds from the OVC Pet Trust Foundation.
The authors declare that they have no competing interests.
BC carried out the data acquisition, statistical analysis and drafted the manuscript. OB conceived of the study, and participated in its data acquisition, analysis and helped to draft the manuscript. DP and DB provided intellectual inputs on study design, analysis and contributed to manuscript revision. All authors read and approved the final manuscript.
About this article
Cite this article
Chhetri, B.K., Berke, O., Pearl, D.L. et al. Comparison of risk factors for seropositivity to feline immunodeficiency virus and feline leukemia virus among cats: a case-case study. BMC Vet Res 11, 30 (2015) doi:10.1186/s12917-015-0339-3