Skip to main content

Evaluation of risk factors for treatment failure in canine patients undergoing photoactivated chromophore for keratitis – corneal cross-linking (PACK-CXL): a retrospective study using additive bayesian network analysis

Abstract

Background

Infectious keratitis is a common ophthalmic condition in canine patients. Sequelae can include keratomalacia and corneal perforation, a vision threatening outcome. Photoactivated chromophore for keratitis – corneal cross-linking (PACK-CXL) is a non-surgical, adjunctive treatment method for infectious keratitis. The goal of this retrospective, multicenter study was to determine risk factors for treatment failure following PACK-CXL in canine patients suffering from suspected infectious keratitis. Medical records from four veterinary ophthalmology services were reviewed, and information related to patient demographics, ophthalmic findings, the PACK-CXL protocol used, and epithelialization time was collected and analyzed. Due to the potential for intervariable relationships, an additive Bayesian network (ABN) analysis was performed to evaluate these complex relationships.

Results

Records for 671 eyes (668 dogs) were included in the analysis. Based on the ABN, in the population included here, patients who underwent an accelerated PACK-CXL protocol were less likely to experience treatment failure versus patients treated with a slow protocol. Mutual dependencies between exposure variables were identified by ABN, which would have been overlooked using classical regression. Corneal re-epithelialization time was shortened following PACK-CXL combined with topical medical therapy compared to PACK-CXL alone.

Conclusions

No risk factors associated with treatment failure were identified in the population included in the present study. Canine patients may benefit from the use of accelerated PACK-CXL protocols, especially when combined with topical antibiotics and anti-collagenolytic therapy. The reasons for this apparent positive impact on treatment outcome remain unclear.

Peer Review reports

Background

Infectious keratitis is a common ophthalmic condition in canine patients, which can be complicated by keratomalacia, or corneal melting. Keratomalacia is characterized by corneal stromal tissue loss, oftentimes rapidly progressive [1]. Therefore, progression of both infectious keratitis and keratomalacia may result in significant corneal scarring and corneal perforation, ultimately threatening vision and retention of the globe. Infectious keratitis is a challenging disease to treat, which is undoubtedly partially due to the complicated interplay between environmental (e.g., client compliance, presence of local pathogens and seasonality), patient (e.g., breed, age, ocular or systemic comorbidities), and treatment (e.g., available treatment options, clinician preference/experience) associated factors. Fortunately, numerous treatment strategies exist to address infectious keratitis in veterinary patients, including the use of corneal cross-linking (CXL) [2], a promising adjunctive, non-surgical treatment approach for infectious keratitis and keratomalacia [3, 4]. This technique refers to the application of a photosensitizing agent to the corneal surface and subsequent activation using an energy source (e.g., UV-A light), thereby creating new chemical bonds within and between collagen and proteoglycan molecules [5,6,7,8] in the corneal stroma. Corneal cross-linking has been shown to increase corneal collagen fiber diameter, increasing corneal stiffness and biomechanical stability [7, 9,10,11], and was initially developed in the late 1990s for the treatment of keratoconus in human patients [12, 13]. It has also been shown to increase the ability of the corneal stroma to resist digestion by collagenolytic enzymes, including collagenase, pepsin, trypsin, and matrix metalloproteinases [7, 8, 14,15,16,17,18,19,20,21]. Additionally, antimicrobial activity of CXL against various bacterial, fungal and parasitic (amoeba) agents has been demonstrated in vitro and in vivo [22,23,24,25]. Photoactivated chromophore for keratitis – corneal cross-linking (PACK-CXL) is a term that specifically indicates the use of this modality for the treatment of infectious keratitis in both human and veterinary medicine [2, 4, 14, 26, 27].

In the authors’ experience, the time required to perform a PACK-CXL treatment is typically less than the time required to perform most surgical stabilization techniques, and it may be performed in awake, quiet animals, or in animals that are sedated or under general anesthesia. Therefore, the authors suggest that PACK-CXL might present a superior treatment approach in the management of infectious keratitis and keratomalacia in some canine patients where surgery may not be a viable option, or where topical therapy alone may be insufficient (e.g. in individuals where a prolonged general anesthetic is not recommended due to concurrent systemic comorbidities, in cases where surgical stabilization may be predicted to fail due to an unstable corneal stroma, where stromal loss has not exceeded 50% and surgical stabilization is not yet required, or where client finances prohibit surgical intervention). It is, however, worth noting that, to the authors’ knowledge, there are currently no published, prospective, randomized controlled trials (RCTs) utilizing PACK-CXL as the sole treatment for suspected infectious keratitis in dogs. Thus, the use of this treatment modality as anything other than an adjunctive therapy in combination with conventional treatment methods remains experimental.

Despite the increasing popularity of PACK-CXL for the treatment of infectious keratitis, as suggested by the increasing number of veterinary papers and abstracts being published on this topic, the authors are not aware of any published research evaluating risk factors for treatment failure using PACK-CXL, or evaluating the proportion of treatment success in populations of canine patients that have undergone PACK-CXL therapy.

Evaluation of risk factors is critically important for clinicians to optimize treatment plans and maximize positive treatment outcomes in their patients. Prior identification of risk factors for treatment failure, or success, is also crucial for RCT planning. Unfortunately, assessment of risk factors in infectious keratitis is exceptionally complicated, likely due to the complex interactions between environmental, patient, and treatment factors.

A common approach in risk factor analysis is to perform a classical regression where all potential risk factors in the analysis are termed exposure variables and the outcome of interest is termed the outcome variable. Classical regression is designed to analyze experimental data with a balanced distribution of exposure variables between the compared groups [28], and it performs well in controlled experimental conditions. However, these conditions are not present in most observational studies, where complex, inter-related associations exist between variables. To analyze and understand complex associations, which can lead to the identification of risk factors, an additive Bayesian network (ABN) analysis may be employed [29,30,31,32] as an alternative to classical regression.

Additive Bayesian network analysis is based on machine learning, and is a multivariate (many outcomes and many variables possible at the same time) extension of classical regression models. The analysis results consist of two components. The first component is structural, resulting in the creation of directed acyclic graphs (DAGs). A DAG can be understood as a map of variables (nodes) and existing associations (arcs). The second component of an ABN consists of a set of parameters belonging to each arc, which represent the estimates of effect sizes, for example, odds ratios (ORs) or regression coefficients.

Currently, risk factors for treatment failure using PACK-CXL in veterinary medicine are unknown. The objectives of this exploratory retrospective study were to: (1) Explore associations between variables in cases of suspected infectious keratitis treated with PACK-CXL to aid in the generation of hypotheses for future studies. (2) Identify risk factors for treatment failure following PACK-CXL in the cases of suspected infectious keratitis presented here. (3) Establish the proportion of treatment success in the population of dogs studied here who received PACK-CXL as part of their therapy.

Materials and methods

Study Design and Patient Population

A retrospective, multi-institutional study was performed. Eyes treated at four ophthalmology services over a combined 10-year time period (France 2013–2021, Italy 2016–2021, Switzerland 2011–2021, United Kingdom 2017–2021) were evaluated for their potential inclusion in the study. Inclusion criteria included dogs that had undergone PACK-CXL therapy for suspected infectious keratitis as determined by the attending ophthalmologist and defined as loss of the corneal epithelium, in addition to stromal loss and/or stromal infiltrates and/or keratomalacia, where the treatment outcome was known. Cases were excluded if these criteria were not fulfilled. The eyes of individuals undergoing bilateral treatment were enrolled as separate cases. Detailed instructions sent to the collaborating ophthalmology services regarding data to be collected are available in Supplementary file 1. The collaborating ophthalmologists classified eligible cases as either treatment failures or successes (criteria for treatment failure or success are included in the “Recorded Data Points” section).

Recorded data points

Primary treatment outcome

failure or success. Treatment failure was defined as a requirement to deviate from the original referral practice treatment plan in order to stop/stabilize keratomalacia. Failure cases were those cases where a change in medical management, a surgical intervention, or second PACK-CXL treatment were required to stabilize the cornea, or where enucleation was pursued. Success was defined as no deviation from the original referral practice treatment plan, with retention of the globe.

Secondary treatment outcome

time to complete epithelialization (expressed in days) of the corneal surface defect.

Potential exposure variables

1) Patient demographics: age, breed, sex, skull type (categorised as: brachycephalic -used as baseline/reference category in the statistical model- or mesocephalic).

2) Ophthalmic co-morbidities were included only if they occurred in the affected eye, and were classified into 4 groups:

  1. a.

    Corneal disease - any individual with a history of corneal disease/corneal disease present, which is not infectious keratitis (e.g., endothelial dysfunction, pigment keratopathy).

  2. b.

    Ocular surgery - any individual with a history of having undergone prior ocular surgery (e.g., phacoemulsification, corneal grafting procedure).

  3. c.

    Nasolacrimal disease - any individual with nasolacrimal disease (e.g., qualitative or quantitative keratoconjunctivitis sicca).

  4. d.

    Other ocular disease - any individual with ocular disease present (e.g., eyelid conformation issues, history of uveitis or glaucoma, distichiasis), but excluding corneal or nasolacrimal disease.

Patients not suffering from any of the afore-mentioned conditions were used as a baseline in the statistical model.

3) Systemic disease was categorized as present or absent: presence was defined as any disease expected to have an impact on ocular health (e.g., endocrinopathies). Absence was defined as no systemic disease or any disease not expected to have an impact on ocular health (e.g., asymptomatic patient with cardiac disease, epilepsy) and was used as baseline.

4) Treatment history: time until referral (expressed in days), antibiotics used prior to referral (“AB prior”: yes/no, baseline: no), steroids used prior to referral (“Steroids prior”: yes/no, baseline: no).

5) Ophthalmic findings: ulcer size (expressed in mm), ulcer depth (expressed in %), keratomalacia at the time of examination (yes/no, baseline: no), hypopyon at the time of examination (yes/no, baseline: no).

6) Initial treatment plan: use of topical medications as part of the referral treatment plan in addition to PACK-CXL (“CXL/topical treatment”: yes/no, baseline: no), use of surgery as part of the referral treatment plan in addition to PACK-CXL (“CXL/surgery”: yes/no, baseline: no). All patients that underwent surgery also received topical medical therapy.

7) The PACK-CXL protocol used, including: fluence (baseline: standard-5.4 J/cm2), riboflavin concentration (baseline: standard − 0.1%), acceleration (baseline: fast, defined as any irradiation time below 10 min; additional details in Table 1).

Table 1 Protocol classification according to acceleration level

The data was initially evaluated using descriptive statistics [32], followed by advanced statistical modeling which is presented in this article. The primary outcome of treatment failure was analyzed with ABN analysis. The secondary outcome of time to corneal re-epithelialization after PACK-CXL treatment was evaluated using survival analysis. The raw data, metadata and R code for the performed analyses, are available on the Open Science Framework (OSF) repository under osf.io/4hk6s.

Additive bayesian network (ABN) analysis

Eighteen exposure variables (listed above and in Tables 2 and 3 and Figure S1) and the primary treatment outcome, were considered for ABN analysis. Age, sex, and breed, and bacterial culture results were excluded for the following reasons. Age and sex were similarly distributed in both the treatment success and failure groups (Table 4). Analyzing risk factors on a breed level would be very difficult due to a large number of subgroups with a small number of patients per subgroup. The statistical power of such subgroup analyses would be very limited. The authors therefore decided to analyze skull type instead. Finally, bacterial culture results were only available for a subset of patients and were therefore not considered further in this study. The ABN analysis was performed using a two-step approach; details can be found in Supplementary file 2. The strength of each arc was quantified and is reflected in the arc thickness in the DAG (see Fig. 1). The marginal posterior log odds ratios, correlation coefficients, and 95% credible intervals were estimated for each arc from the posterior distribution (Table 5). Additionally, to adjust for a clustering effect due to the multi-institutional nature of this study, “place” (clinic location) was used as a random effect in the ABN. For completeness, and to reveal significant associations selected in a classical approach, the same variables as considered in the ABN were analyzed with a generalised mixed model using the “lme4” package [33], with failure as the outcome, and the place as a random effect. All analyses were performed using R software, version 4.0.2.

Table 2 Number of dog eyes in each category after imputation of missing values for exposure variables
Table 3 Medical history data and continuous variables used in the ABN analysis
Table 4 Number of dog eyes after imputing missing values for variables excluded from the ABN analysis
Fig. 1
figure 1

Evaluation of risk factors associated with PACK-CXL treatment failure (primary treatment outcome): Additive Bayesian network (ABN) analysis. The nodes (squares, rectangles and ovals) represent exposure variables, and the red square represents the primary treatment outcome (treatment success/failure). The arcs represent the relationships between variables, with a dashed line indicating a negative association, and a solid line indicating a positive association. Arc thickness represents the strength of support for the association. Oval nodes represent variables with Gaussian distributions. Quadratic nodes represent variables with binomial distributions. For the variables without baseline indicated in the graph, the baseline value was “no”. Acceleration is the only exposure variable directly associated with the outcome. No other variables were directly linked to the outcome, but some variables were indirectly linked to the outcome through acceleration

Table 5 Regression coefficient estimates and 95% Credible Intervals (CrI) with their interpretation and data support

Survival analysis

The Kaplan-Meier method was used to analyze a time to event outcome (time between PACK-CXL and complete corneal re-epithelialization), and a Cox proportional hazards regression to estimate hazard ratios (HR), after confirming the validity of the proportional hazards’ assumptions (Supplementary file 2). Variables for the model were selected based on the Likelihood Ratio Test and Akaike information criterion (AIC). All considered variables are summarized in Tables S1 and S2. Only dogs that did not receive any form of corneal surgery as a part of the initial treatment plan, or enucleation, were included in this survival analysis. In other words, only eyes for which the epithelialization time could be evaluated were included. R version 4.0.5 with packages DescTools [34], ggplot2 [35], dplyr [36], Gmisc [37], and survival package [38] were used for these analyses.

Results

Six hundred and eighty four eyes were identified that met the basic inclusion criteria; thirteen eyes were excluded due to insufficient information related to treatment outcome, leaving records for 671 eyes (668 dogs) with three bilaterally treated patients. A comparison of the summary of the original data set (Table S3) with the summary of the data set with the imputed values (Table 2) showed that the two data sets were similar. Percentages presented in the original data set were within the CIs and similar to the percentages of the imputed data, therefore it can be assumed that the missing values are missing at random, and imputation was successful.

Descriptive statistics

The overall treatment success in the population of dogs in the present study, all of which underwent PACK-CXL treatment, was 90% (95% CI from 88 to 92%). The initial referral treatment plan included PACK-CXL only in 102 eyes (treatment success 86%, 95% CI from 80 to 93%), PACK-CXL and surgery in 201 eyes (treatment success 91%, 95% CI from 87 to 95%), and PACK-CXL and topical therapy in 368 eyes (treatment success 91%, 95% CI from 88 to 94%). Planned surgical procedures performed at the time of referral and concurrently with PACK-CXL included superficial lamellar keratectomy, corneoconjunctival transposition, conjunctival pedicle graft, corneal transplant, and the application of various collagen scaffolds. Detailed information regarding PACK-CXL protocol parameters is displayed in Tables 2 and 4. The median time to referral was 6 days (Table 3). The median age of dogs at the time of treatment was eight years with an interquartile range from 0.4 to 17.5 years. Eighty-five different breeds were represented in the study population, with 67.5% of included subjects being brachycephalic dogs. A similar distribution of age, eye laterality, and sex were noted in both the success and failure groups (Table 4).

Information related to treatment failure was available for 57/66 eyes. The most common rescue intervention following treatment failure was enucleation (25 eyes), followed by corneal grafting surgery (22 eyes) and corneoconjunctival transposition (6 eyes). Signs related to clinical deterioration after PACK-CXL treatment were recorded in 25 cases and included: keratomalacia (10 eyes), corneal perforation (9 eyes), and endophthalmitis (2 eyes). Tables 6 and 7 summarize the recorded data. The percentage of PACK-CXL treated cases that failed treatment differed across the participating clinics: Clinic A: 32.7%, Clinic B: 7%, Clinic C: 4.5%, Clinic D: 11.1%.

Table 6 Rescue interventions in PACK-CXL failures
Table 7 Reported signs of clinical deterioration in PACK-CXL failures

Additive bayesian network analysis

The final DAG consisted of 40 arcs and is presented in Fig. 1. Acceleration of the PACK-CXL protocol was the only variable directly associated with treatment outcome (OR 5.31, 95% CI from 2.58 to 10.65), as identified by ABN analysis, which means that acceleration could be a potential “success factor”. After adjusting for the clustering effect of ‘place’, acceleration remained directly associated with treatment outcome, but with a reduced effect size (OR 1.55, 95% CI from 0.49 to 4.80). No direct or statistically significant risk factors for treatment failure were identified.

When both the DAG and the estimated effect sizes (presented in Table 5) were considered, interesting associations could be appreciated since a DAG presents a graphical overview of the associations between considered variables and how they are related. For example, keratomalacia is linked to deeper (OR 1.4) and to larger (OR 2.57) ulcers with hypopyon (OR 3.22). Moreover, dogs with active keratomalacia had an OR of 3.24 for undergoing both PACK-CXL and surgery. As a result of the ABN analysis, it can be appreciated that these patients not only had active keratomalacia, but also larger and deeper ulcers, which may explain the treatment decision.

The exposure variables ‘ulcer size’, ‘ulcer depth’ and ‘AB prior’ (use of antibiotics prior to referral) were not directly linked to the treatment outcome in the ABN analysis; however, these variables were identified as significant in a classical generalised mixed model regression (p values 0.024, 0.045 and 0.032, respectively). As ABN has the capacity to model associations between all entered variables, the associations between ‘ulcer size’, ‘ulcer depth’, ‘AB prior’ and outcome, are suspected to be of an indirect, rather than of a direct nature. The regression analysis results are presented in Table S4 and Figure S2.

Survival analysis: time to epithelialization

Data from 433 canine eyes was included in the survival analysis. Of those, six eyes were censored due to missing information regarding time to epithelialization. Tables S1 and S2 summarize the considered exposure variables in the included eyes.

The Kaplan-Meier survival curves for the length of time until epithelialization following PACK-CXL or PACK-CXL with additional topical therapy are presented in Fig. 2. The median times to epithelialization were 21 days (95% CI from 16 to 23 days), and 14 days (95% CI from 14 to 15 days), for the groups receiving PACK-CXL only, and PACK-CXL + topical treatment, respectively. The survival curves of these two groups were significantly different (p < 0.001).

Fig. 2
figure 2

Corneal re-epithelialization time (secondary treatment outcome) of PACK-CXL + topical medical therapy compared to PACK-CXL alone: Kaplan-Meier survival analysis. The median survival time (dashed line) for each group represents the length of time within which the cornea of 50% of patients had re-epithelialized, which was 21 days (95% CI from 16 to 23 days), and 14 days (95% CI from 14 to 15 days), for the groups receiving CXL only, and CXL/medical treatment, respectively (p < 0.001). The straight lines represent the Kaplan-Meier curves and the surrounding dilute colored zones the 95% CIs. Tx: Treatment

Figure 3 presents the HR based on the Cox proportional hazard regression. Based on this analysis, when comparing two individual dogs with the same baseline exposure variables, a dog that received topical therapy in addition to PACK-CXL is 48% more likely to epithelialize at any given time, compared to a dog that received PACK-CXL only (HR = 1.48, p value 0.003, 95% CI from 1.14 to 1.92). Similarly, a dog that underwent a fast PACK-CXL protocol is 1.60 times more likely to epithelialize versus a dog that received a slow protocol (HR = 1.60, p value 0.017, 95% CI from 1.09 to 2.37). Finally, a dog that had undergone previous ocular surgery, suffered from corneal disease or another ocular disease, and/or hypopyon at presentation to the referral ophthalmology service is less likely to epithelialize at any given time point, compared to a dog without these conditions. Ulcer size was another significant factor influencing epithelialization time. A 1 mm increase in ulcer size led to a 5% reduction of the ability to epithelialize at any given time-point (HR = 0.95, p value = 0.012, 95% CI from 0.92 to 0.99).

Fig. 3
figure 3

Forest Plot for Cox proportional hazards model. Hazard ratio (HR) marked as black square, 95% CI as horizontal line. A HR < 1 indicates a reduced “risk” of epithelialization compared to the reference group. A HR > 1 indicates a higher “risk” of epithelialization compared to the reference group. Tx: Treatment. Dx: Disease. Variables for the model were selected based on a standard step-wise selection process; details can be found in Supplementary file 2. Based on this approach, age, skull type, time until referral, AB prior, steroids prior, systemic disease, nasolacrimal disease, ulcer depth, keratomalacia, riboflavin carrier, riboflavin concentration, and fluence were not included in the Cox proportional hazard regression

Discussion

The present observational study utilized ABN, a novel method for statistical analysis, instead of a regression model. This statistical methodology was selected since observational studies are typically comprised of interrelated variables, which may limit the utility of regression models. An ABN model does not require researchers to choose a single outcome variable with the remaining variables all being exposure variables. As a result, additional insights may be gained into associations existing between all the variables in the data set, which may not be possible with classical regression. Therefore, ABN may be a more appropriate methodology in observational studies where associations between variables are unknown, or poorly understood.

One purpose of this retrospective study was to identify associations between considered variables and treatment outcome, and subsequently, to identify risk factors for treatment failure in canine patients that had undergone PACK-CXL for the treatment of suspected infectious keratitis. The focus of this study was, therefore, not to compare different protocols (PACK-CXL alone, PACK-CXL + surgery, PACK-CXL + medical management) and establish which protocol was most successful. Instead, this study presents data associated with several recorded variables, including the different treatment approaches employed by various clinicians in the cases included here, and aims to identify if any may be risk factors for treatment failure. A large, comprehensive dataset was collected for this study, including factors suspected to be significant in terms of influencing treatment outcome and factors previously reported in the literature as risk factors for corneal ulcer treatment failure [39]. Several case reports on corneal ulcers in companion animals, focusing on potential predisposing factors and causative infectious agents, have been published [40,41,42,43]; however, to the authors’ knowledge, this is the first study evaluating risk factors for treatment failure following PACK-CXL using ABN. Although it has been suggested that brachycephalia and prior use of topical steroids may predispose a patient to corneal ulcers [40, 44], these two variables were not identified as direct risk factors associated with PACK-CXL treatment failure in the ABN in the studied patient population. The reason for this could come from the retrospective nature of the present study, specifically as the result of a selection bias, since the population of dogs selected in the present study may not be representative of the proportion of brachycephalic dogs in the general population. Ultimately, no risk factors for treatment failure were identified in the present study when ABN was utilized.

One exposure variable of interest in the present study was PACK-CXL treatment acceleration. The duration of the irradiation phase during PACK-CXL treatment was divided into a group of fast and a group of slow protocols, with a slow protocol defined as any protocol including at least one 30 min-3 mW/cm2 or one 10 min-9 mW/cm2 irradiation cycle. Patients undergoing an accelerated (fast) PACK-CXL protocol in the present study were less likely to experience treatment failure, meaning that acceleration could be a potential “success factor”. Effectiveness of accelerated PACK-CXL was previously described in case reports of infectious keratitis in dogs and cats [3, 45], and in human patients [46, 47]. These reports, however, did not include comparison groups. Based on the ABN analysis, acceleration is the only variable directly related to treatment outcome in the present study. When performing a generalized regression mixed model with the same variables as considered in the ABN, the exposure variable ‘acceleration’ as well as ‘ulcer size’, ‘ulcer depth’, and ‘AB prior’ are found to be significant. Since the latter three associations were not identified in the ABN, they are presumably the result of an overfitting, causing the identification of spurious significant associations, i.e., associations that wrongly imply a cause and effect between two variables, a common problem in classical regression analysis. As such, PACK-CXL acceleration was found to be directly linked to treatment outcome in both the ABN and classical regression analysis. The impact of this finding may be significant from a clinical perspective, as the administration of a 2 to 5-minute accelerated protocol to an awake, or sedated patient is more realistic than a 10 or 30-minute protocol, where general anesthesia would likely be required. Increased or equivalent effectivity of an accelerated PACK-CXL treatment would make PACK-CXL much more accessible from both a clinical and client-driven perspective and requires further investigation.

The effect size (the magnitude of the OR) for the use of accelerated PACK-CXL protocols was reduced when an adjustment for the four different collaborating clinics was implemented in the model. The reason for the discrepancy in treatment success/failure across clinics is unknown. Hence, there may be additional factors influencing treatment outcome which were not included, such as the degree of severity of ulcers treated with PACK-CXL (early vs. late-stage disease), or clinician preferences in terms of PACK-CXL protocols used in the different clinics.

Although the collected information is deemed important by medical professionals, and the list of variables included is relatively comprehensive, certain crucial variables may not have been considered in the analysis. The authors acknowledge that including whether or not all patients required general anesthesia for PACK-CXL therapy would have been of interest to the reader, and this variable could be included in future studies. It is also possible that variables critical for treatment outcome were “hidden” under the exposure variable ‘acceleration’. Additionally, some necessary, but arguably arbitrary decisions for the categorisation of the exposure variables were made, due to the small number of eyes in the various subgroups. This data aggregation could have had an impact on the results. It must also be acknowledged that the group of patients that underwent a slow PACK-CXL protocol was much smaller than the fast protocol group (Figure S1), reflecting the unbalanced distribution of exposure variables in this dataset. This may result in a loss of statistical power, which, in addition to selection bias, is another common problem in retrospective studies.

The last aim of this study was to determine the proportion of treatment success in this population of dogs who received PACK-CXL as a component of their therapy. In the population of dogs evaluated in the present study, almost 90% experienced a successful outcome. This treatment success proportion is similar to the success proportion for PACK-CXL treatment in human patients with infectious keratitis reported in a meta-analysis and recent randomized controlled trial results paper [48, 49].

The survival analysis of the present study revealed that the use of an accelerated PACK-CXL protocol combined with topical therapy (a combination of antibiotics and anti-collagenolytics) shortened the corneal re-epithelialization time when compared to patients undergoing only PACK-CXL. As previously noted, the use of PACK-CXL as the sole treatment for infectious keratitis in veterinary species remains controversial. Therefore, until further prospective, randomized studies investigating the possible applications of PACK-CXL as a stand-alone therapy in veterinary species have been published, it would be prudent to combine its use with conventional topical therapies.

This study is, in part, a hypothesis-generating step, which might help guide the design of future RCTs regarding the selection of variables to be tested or controlled for. This is useful, as it is simply not possible to run RCTs that account for all possible risk and “success” factors. Despite the relative limitations of the present study design, the authors believe that the methodology presented here is still superior to a classical regression model. Additive Bayesian network analysis offers an added value for the analysis such as graphical representation of possible associations between variables, which may allow for an improved understanding of the connection between various factors and treatment success/failure. In the present study, ABN prevented the authors from drawing incorrect conclusions (which could have been made if based only on the regression model), thereby mitigating incorrect clinical recommendations.

Lastly, the authors wish to be clear that the focus of the present study was not to compare different treatment protocols. Instead, the aim was to evaluate whether recorded variables, including those associated with the PACK-CXL protocol utilized, might represent potential risk factors for treatment failure. Further, it should be noted that the number of patients in each treatment group was variable, and as such, the groups are unbalanced. It is therefore not possible to compare the different treatment protocols (something which can be done in an RCT), nor was that the goal of this study.

In conclusion, no risk factors associated with failure were identified in the population included in the present study. An accelerated (i.e., fast) PACK-CXL protocol might be associated with treatment success. The secondary analysis suggests that the use of an accelerated PACK-CXL protocol combined with the use of topical antibiotics and anti-collagenolytics shortened the corneal re-epithelialization time when compared to the use of PACK-CXL alone in the cases included here. Adequately powered, prospective, controlled, randomized studies with a broader scope of collected variables are needed to compare the effectiveness of PACK-CXL to that of other treatment options. As a hypothesis-generating study, the study presented here provides a rationale to guide the design of future randomized controlled trials regarding the selection of risk factors to be tested or controlled for.

Data Availability

Supplementary information is available including the raw data set, the cleaned data set, and the data management plan, which can be found on the OSF repository under the same title as the manuscript (osf.io/4hk6s).

Mosaic plots and box plots, displaying the number of eyes in each subgroup from the variables included in the ABN, are available as supplementary materials (see Supplementary Figure S1). A summary of the raw data set is available as Table S3. Supplementary Figure S2 and Tables S1, S2 and S4 present the results of the generalised regression model and a summary of the exposure variables used in the Cox proportional hazard analysis.

Abbreviations

AB:

Antibiotic

ABN:

Additive Bayesian network

AIC:

Akaike information criterion

CI:

Confidence interval

CrI:

Credible interval

CXL:

Corneal cross-linking

DAG:

Directed acyclic graph

HPMC:

Hydroxypropyl methylcellulose

HR:

Hazard ratio

LRT:

Likelihood ratio test

OD:

Oculus dexter, right eye

OS:

Oculus sinister, left eye

OSF:

Open Science Framework

OR:

Odds ratio

OU:

Oculus uterque, both eyes

PACK-CXL:

Photoactivated chromophore for keratitis – corneal cross-linking

RCT:

Randomized controlled trial

References

  1. Gelatt KN. Veterinary Ophthalmology. New York: Wiley-Blackwell; 2021.

    Google Scholar 

  2. Spiess B, Pot SA, Florin M, Hafezi F. Corneal collagen cross-linking (CXL) for the treatment of melting keratitis in cats and dogs: a pilot study. Vet Ophthalmol. 2014;17:1–11.

    Article  CAS  PubMed  Google Scholar 

  3. Famose F. Evaluation of accelerated collagen cross-linking for the treatment of melting keratitis in 10 cats. Vet Ophthalmol. 2015;18:95–104.

    Article  CAS  PubMed  Google Scholar 

  4. Pot S, Gallhoefer N, Matheis F, Voelter-Ratson, Hafezi F. Corneal collagen cross-linking as treatment for infectious and noninfectious corneal melting in cats and dogs: results of a prospective, nonrandomized, controlled trial. Vet Ophthalmol. 2014;17:250–60.

    Article  CAS  PubMed  Google Scholar 

  5. Hayes S, Kamma-Lorger CS, Boote C, et al. The effect of riboflavin/UVA collagen cross-linking therapy on the structure and hydrodynamic behaviour of the ungulate and rabbit corneal stroma. PLoS ONE. 2013;8:1–12.

    Article  Google Scholar 

  6. Zhang Y, Conrad A, Conrad G. Effects of ultraviolet-A and riboflavin on interaction of collagen and proteoglycans during corneal cross-linking. J Biol Chem. 2011;286:13011–22.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Spoerl E, Seiler T. Techniques for stiffening the cornea. J Refract Surg. 1999;15:711–3.

    CAS  PubMed  Google Scholar 

  8. Wollensak G. Fundamental principals of corneal collagen cross-linking. In: Hafezi F, Randleman J, editors. Corneal collagen cross-linking. New Jersey: Slack Inc; 2013.

    Google Scholar 

  9. Raiskup F, Spoerl E. Corneal crosslinking with riboflavin and ultraviolet A. Ocul Surf. 2013;11:65–74.

    Article  PubMed  Google Scholar 

  10. Wollensak G, Wilsch M, Spoerl E, Seiler T. Collagen fiber diameter in the rabbit cornea after collagen crosslinking by riboflavin/UVA. Cornea. 2004;23:503–7.

    Article  PubMed  Google Scholar 

  11. Spoerl E, Huhle M, Seiler T. Induction of cross-links in corneal tissue. Exp Eye Res. 1998;66:97–103.

    Article  CAS  PubMed  Google Scholar 

  12. Van Tigchelt L, Van Eijgen J, Delbeke H. Alternative indications for corneal crosslinking. J Cataract Refract Surg. 2021;47:1360–6.

    Article  PubMed  Google Scholar 

  13. Raiskup-Wolf F, Hoyer A, Spoerl E, Pillunat LE. Collagen crosslinking with riboflavin and ultraviolet-A light in keratoconus: long-term results. J Cataract Refract Surg. 2008;34:796–801.

    Article  PubMed  Google Scholar 

  14. Spoerl E, Wollensak G, Seiler T. Increased resistance of crosslinked cornea against enzymatic digestion. Curr Eye Res. 2004;29:35–40.

    Article  CAS  PubMed  Google Scholar 

  15. Al-Sabai N, Koppen C, Tassignon MJ. UVA/riboflavin crosslinking as treatment for corneal melting. Bull Soc Belge Ophtalmol. 2010;315:13–7.

    Google Scholar 

  16. Marquart ME, O’Callaghan RJ. (2013) Infectious Keratitis: Secreted Bacterial Proteins That Mediate Corneal Damage. J Ophthalmol. 2013: p. 369094.

  17. Livingston ET, Mursalin HM, Callegan MC. A pyrrhic victory: the PMN response to ocular bacterial Infections. Microorganisms. 2019;7(11):537.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Aldahlawi N, Hayes S, Meek K. An investigation into corneal enzymatic resistance following epithelium-off and epithelium-on corneal cross-linking protocols. Exp Eye Res. 2016;153:141–51.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Aldahlawi NH, Hayes S, O’Brart DPS, Meek KM. Standard versus accelerated riboflavin–ultraviolet corneal collagen crosslinking: resistance against enzymatic digestion. J Cataract Refract Surg. 2015;41:1989–96.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Aldahlawi NH, Hayes S, O’Brart DPS, Akhbanbetova A, Littlechild SL, Meek KM. Enzymatic resistance of corneas crosslinked using riboflavin in conjunction with low energy, high energy, and pulsed UVA irradiation modes. Investig Opthalmology Vis Sci. 2016;57:1547–52.

    Article  CAS  Google Scholar 

  21. Zhang Y, Mao X, Schwend T, Littlechild S, Conrad GW. Resistance of corneal RFUVA–cross-linked collagens and small leucine-rich proteoglycans to degradation by matrix metalloproteinases. Investig Opthalmology Vis Sci. 2013;54:1014–25.

    Article  CAS  Google Scholar 

  22. Large TP, Mack S, Villiers E, Oliver J. In vitro susceptibility of canine corneal bacterial pathogens to three cross-linking protocols. Vet Ophthalmol. 2022;00:1–9.

    CAS  Google Scholar 

  23. Tal K, Gal-Or O, Pillar S, Zahavi A, Rock O, Bahar I. Efficacy of primary collagen cross-linking with photoactivated chromophore (PACK-CXL) for the treatment of Staphylococcus aureus–induced corneal ulcers. Cornea. 2015;34:1281–6.

    Article  PubMed  Google Scholar 

  24. Martins SAR, Combs JC, Noguera G, et al. Antimicrobial efficacy of riboflavin/UVA combination (365 nm) in vitro for bacterial and fungal isolates: a potential new treatment for infectious keratitis. Investig Opthalmology Vis Sci. 2008;49:3402–8.

    Article  Google Scholar 

  25. Makdoumi K, Backman A. Photodynamic UVA-riboflavin bacterial elimination in antibiotic resistant bacteria. Clin Exp Ophthalmol. 2016;44:582–6.

    Article  PubMed  Google Scholar 

  26. Panda A, Krishna SN, Kumar S. Photo-activated riboflavin therapy of refractory corneal ulcers. Cornea. 2012;31:1210–3.

    Article  PubMed  Google Scholar 

  27. Hellander-Edman A, Makdoumi K, Mortensen J, Ekesten B. Corneal cross-linking in 9 horses with ulcerative keratitis. BMC Vet Res. 2013;9:128.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Babyak MA. What you see may not be what you get: a brief, nontechnical introduction to overfitting in regression-type models. Psychosom Med. 2004;66:411–21.

    PubMed  Google Scholar 

  29. Hartnack S, Odoch T, Kratzer G, et al. Additive bayesian networks for antimicrobial resistance and potential risk factors in non-typhoidal Salmonella isolates from layer hens in Uganda. BMC Vet Res. 2019;15:212.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Kratzer G. Bayesian network modeling applied to feline calicivirus Infection among cats in Switzerland. Front Vet Sci. 2020;7:17.

    Article  Google Scholar 

  31. Yamaguchi E, Hayama Y, Shimizu Y, Murato Y, Sawai K, Yamamoto T. Additive bayesian network analysis of the relationship between bovine Respiratory Disease and management practices in dairy heifer calves at pre-weaning stage. BMC Vet Res. 2021;17:360.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Shukla, Kowalska M, Arteaga K et al. (2022) Photoactivated chromophore for keratitis – corneal cross-linking (PACK-CXL): retrospective multicenter study in canine and feline patients. Proceedings of the European College of Veterinary Ophthalmologists’ Conference, Salzburg, Austria.

  33. Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. J Stat Softw. 2015;67:1–48.

    Article  Google Scholar 

  34. Signorell A. (2021)Package “DescTools” tools for descriptive statistics. https://cran.r-project.org/web/packages/DescTools/index.html. Accessed 23 Sep 2022.

  35. Wickham H. Ggplot2 elegant graphics for data analysis. New York: Springer-Verlag; 2016.

    Google Scholar 

  36. Wickham H. (2022) Package “dplyr” a grammar of data manipulation. https://dplyr.tidyverse.org/reference/dplyr-package.html. Accessed 23 Sep 2022.

  37. Gordon M. (2022) Gmisc: Descriptive statistics, transition plots, and more. https://cran.r-project.org/web/packages/Gmisc/Gmisc.pdf. Accessed 23 Sep 2022.

  38. Therneau T. (2022) A package for survival analysis in R. https://cran.r-project.org/web/packages/survival/citation.html. Accessed 23 Sep 2022.

  39. Morlet N, Minassian D, Butcher J. Risk factors for treatment outcome of suspected microbial keratitis. Br J Ophthalmol. 1999;83:1027–31.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Hindley KE, Groth AD, King M, Graham K, Billson FM. Bacterial isolates, antimicrobial susceptibility, and clinical characteristics of bacterial keratitis in dogs presenting to referral practice in Australia. Vet Ophthalmol. 2016;19:418–26.

    Article  CAS  PubMed  Google Scholar 

  41. Suter A, Voelter K, Hartnack S, Spiess BM, Pot SA. Septic keratitis in dogs, cats, and horses in Switzerland: associated bacteria and antibiotic susceptibility. Vet Ophthalmol. 2018;21:66–75.

    Article  CAS  PubMed  Google Scholar 

  42. Prado MR, Rocha MFG, Brito EHS, et al. Survey of bacterial microorganisms in the conjunctival sac of clinically normal dogs and dogs with ulcerative keratitis in Fortaleza, Ceara, Brazil. Vet Ophthalmol. 2005;8:33–7.

    Article  PubMed  Google Scholar 

  43. Lin CT, Petersen-Jones SM. Antibiotic susceptibility of bacteria isolated from cats with ulcerative keratitis in Taiwan. J Small Anim Pract. 2008;49:80–3.

    Article  PubMed  Google Scholar 

  44. O’Neill DG, Lee MM, Brodbelt DC, et al. Corneal ulcerative Disease in dogs under primary veterinary care in England: epidemiology and clinical management. Canine Genet Epidemiol. 2017;4:5.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Famose F. Evaluation of accelerated collagen cross-linking for the treatment of melting keratitis in eight dogs. Vet Ophthalmol. 2014;17:358–67.

    Article  PubMed  Google Scholar 

  46. Li M, Yu T, Gao X, Wu XY. Accelerated corneal collagen cross-linking in clinical management of infectious keratitis. J Int Med Res. 2020;48:1–11.

    Google Scholar 

  47. Barac IR, Balta G, Zemba M, et al. Accelerated vs. conventional collagen cross–linking for infectious keratitis. Exp Ther Med. 2021;21:1–4.

    Article  Google Scholar 

  48. Papaioannou L, Miligkos M, Papathanassiou M. Corneal collagen cross-linking for infectious keratitis: a systematic review and meta-analysis. Cornea. 2016;35:62–71.

    Article  PubMed  Google Scholar 

  49. Hafezi F, Hosny M, Shetty R, et al. PACK-CXL vs. antimicrobial therapy for bacterial, fungal, and mixed infectious keratitis: a prospective randomized phase 3 trial. Eye Vis. 2022;9:2.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

SP, SH and MK conceived the study, AS contributed to the discussions regarding exposure variable inclusion. AS, KA, MC, CD and FF collected the data. MK and AS cleaned the data set, MK performed all initial data analyses. MK and SH performed the final data analysis and MK created all tables and figures. MK, AS, SP and SH discussed the results and formulated the conclusions. MK and AS drafted the initial manuscript, and proofread and revised all materials as required. KA, MC, CD, FF, SH and SP proofread the manuscript, revised the main manuscript text and tables as required. All authors have made a significant contribution to the text and have approved the final version. SH and SP are both last authors. MK and AS are both first authors.

Corresponding author

Correspondence to M. E. Kowalska.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was not required for this study due to its retrospective nature; in addition, the owners of the patients described in this article who underwent treatment for suspected infectious keratitis, were required to sign treatment consent forms prior to treatment being administered.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kowalska, M.E., Shukla, A.K., Arteaga, K. et al. Evaluation of risk factors for treatment failure in canine patients undergoing photoactivated chromophore for keratitis – corneal cross-linking (PACK-CXL): a retrospective study using additive bayesian network analysis. BMC Vet Res 19, 227 (2023). https://doi.org/10.1186/s12917-023-03779-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12917-023-03779-x

Keywords