- Research article
- Open Access
Evaluation and optimization of a conventional SPCE for FMD post-vaccination monitoring
BMC Veterinary Researchvolume 14, Article number: 371 (2018)
Foot-and-mouth disease (FMD) can be controlled by either stamping out or vaccination, a choice which depends on both the economic importance of the livestock sector as well as the disease status. In FMD-free countries with vaccination, such as Korea, vaccination programs should guarantee prevention against transmission of FMD. Monitoring of vaccination programs is also essential for ensuring sufficient coverage that will limit the transmission of FMDV. There are several methods to screen FMD virus (FMDV) structural protein (SP) antibodies including SPCE (Solid-phase competitive ELISA), LPBE (Liquid-phase blocking ELISA), and VNT (Virus neutralization test). Among these, SPCE is widely used for serological monitoring since VNT—the gold standard method—has certain practical limitations, such as high costs in terms of time and labor. However, whether SPCE can ensure the vaccination status of individual animals and whole farms is unclear. In this study, SPCE, LPBE and VNT were compared with respect to correlation with each other and sensitivity at commercial pig farms.
The positive results obtained by PrioCHECK SPCE differed from those obtained by LPBE and VNT. The sensitivity of SPCE relative to those of the other tests was fairly low. The raw data of SPCE were most highly correlated with those of VNT with XJ strain, while their positivity and negativity were most highly correlated with LPBE. The results of ROC analysis proposed new cut-off for PrioCHECK SPCE higher than the previous 50% inhibition.
The high false positive rate of PrioCHECK SPCE suggested that high seropositivity by SPCE may not guarantee a true vaccination coverage. Adjusting the cut-off percentage (%) inhibition value for SPCE is needed to address this problem, and it is highly recommended that routine FMDV serological monitoring programs using PrioCHECK SPCE should be combined with alternative methods such as LPBE or VNT.
Foot-and-mouth disease (FMD) is a viral disease caused by the FMD virus (FMDV), which belongs to the genus Aphthovirus in the Picornaviridae family . The contagious nature of the virus and its various serotypes make it a major threat to animal husbandry worldwide . Rapid and precise diagnosis is a prerequisite for preventing the spread of this disease. One diagnostic approach is to detect FMDV-specific antibodies; serological monitoring tests usually detect antibodies against either non-structural proteins (NSPs) [3,4,5,6,7] or structural protein (SPs). Solid-phase competition enzyme-linked immunosorbent assay (ELISA) (SPCE) [8,9,10], liquid-phase blocking ELISA (LPBE) [11, 12], and the virus neutralization test (VNT)  are typically used for SP antibody screening. They are performed in support of four main purposes: 1) to certify individual animals prior to import or export; 2) to confirm suspected cases of FMD; 3) to substantiate absence of infection; and 4) to demonstrate the efficacy of vaccination .
In FMD-free countries with vaccination, such as Korea, SPCE is adopted as a screening method for evaluating herd immune status after FMD vaccination because the gold standard method, VNT, is time and labor consuming. In Korea, there is a cut-off value of vaccination coverage by SPCE according to the relevant regulations, and farms with less than this value are subject to a fine. Despite these efforts, FMD has still been detected in premises with sufficient vaccination coverage above the cut-off value. Moreover, it is unclear whether SPCE is an appropriate method to certify individual animals and whether it demonstrates efficacy for the evaluation of vaccination status.
In the present study, we investigated whether PrioCHECK SPCE is appropriate for determining the FMD vaccination status of farms by comparing the vaccination coverage and correlation to those obtained by other SP antibody test methods and by assessing the relative sensitivity and specificity of the assay.
SP antibody response after vaccination
To compare the performance of the three SP antibody tests, we evaluated vaccination coverage and antibody response based on logarithmic titers determined by each assay. Results of LPBE were confirmed by performing the assay using reagents from the World Reference Laboratory for Foot-and-Mouth Disease (data not shown).
The development of SP antibody was compared among the three methods used in the study (Fig. 1a–c). In the case of SPCE, the antibody level was highest 12 weeks after the vaccination in group I (Fig. 1a), whereas the level peaked after 8 weeks in group II (Fig. 1b). In group III, the antibody response was highest 8 weeks after the second vaccination (Fig. 1c).
Interestingly, the percentage of positive reactions before vaccination was above 50% when tested by SPCE, but it was below 20% when tested by LPBE and VNT in all groups (Fig. 1d–f). No NSP antibody was detected in any of the samples (data not shown). However, there were no significant differences between LPBE or VNT with XJ strain (VNT/XJ) and SPCE titers except for group II at 8 weeks of age. SPCE differed significantly from VNT/GX at 20 and 24 weeks of age in group I, at 8, 16, 20 and 24 weeks of age in group II, and at 24 weeks of age in group III. At market age, the mean vaccination coverage of SPCE were 88.56, 87.98 and 100% for each group.
Scatter plots and calculated regression lines for each assay
To further investigate the correlation between PrioCHECK SPCE and other assays and obtain regression lines, scatter plots were generated that showed logarithmic titers of SPCE on the x-axis and those of LPBE or VNT on the y-axis. The results for four positive and three negative reference serum samples obtained by SPCE were highly correlated with those obtained by LPBE (R2 = 0.973, P < 0.0001) (Fig. 2a). However, not all the field samples that tested positive by SPCE were positive by LPBE (R2 = 0.517) (Fig. 2b). Nevertheless, we observed a trend that all but seven samples, positive by LPBE, had a log10 titer > 0.85 by SPCE. On the contrary, LPBE titers of samples positive by SPCE ranged from 1.51 to 3.61.
In the scatter plots for SPCE and VNT, R2 was higher when SPCE was matched with VNT/XJ (R2 = 0.579) than when it was matched with VNT/GX (R2 = 0.438) (Fig. 2c, d). Most serum samples positive by VNT had a log10 titer > 0.85 by SPCE, except six and two samples of the XJ and GX strain, respectively. On the other hand, VNT titers of sera positive by SPCE ranged from 0.3 to 3.46.
Correlation and relative sensitivity of SPCE compared to other tests
We calculated the Pearson correlation coefficient between PrioCHECK SPCE and other SP tests by comparing the data at the individual level. Overall, the highest correlation coefficient was between VNT/XJ and VNT/GX (r = 0.803, P < 0.001) (Table 1). SPCE showed the highest correlation with VNT/XJ (r = 0.761), followed by LPBE (r = 0.719) and VNT/GX (r = 0.662).
The relative sensitivity and specificity of SPCE were compared with LPBE, VNT/XJ and VNT/GX (Table 2). A total of 25, 19, and 9 samples confirmed positive by LPBE, VNT/XJ, and VNT/GX, respectively, were negative by SPCE. Conversely, 147, 164, and 342 samples positive by SPCE were negative by LPBE, VNT/XJ, and VNT/GX, respectively.
SPCE showed the highest concordance with LPBE, followed by VNT/XJ and VNT/GX (Table 2). Cohen’s kappa of SPCE was highest with LPBE. False negative rates were less than 10%. However, the false positive rate was more than 20%, and in case of SPCE with VNT/GX, it was 50.4%. It means that more than half of pigs identified as positive by SPCE screening did not have sufficient antibodies for protection.
Standardization of cut-off value for SPCE
To decrease false positive rate of PrioCHECK SPCE, we determined the optimal cut-off for PI of SPCE in 1/10 dilution and generated receiver operated characteristic (ROC) curves using the results obtained by other SP tests as standards (Fig. 3). Because the results of PrioCHECK SPCE were expressed as PI in general, PI results, not log10 titer, were used in this time. The area under the curve (AUC), sensitivity, and specificity were also calculated, and the optimal cut-off value was determined to obtain the maximum sensitivity and specificity.
The AUC was largest when the standard was VNT/XJ, followed by LPBE and VNT/GX (P < 0.0001) (Fig. 3). The optimal cut-off for SPCE was 63.55% when compared with LPBE, with a sensitivity of 0.801 and specificity of 0.800. For VNT/XJ, the cut-off value was 67.23% and the sensitivity and specificity were 0.834 and 0.829, respectively. For VNT/GX, the cut-off value was 76.83% and the sensitivity and specificity were 0.753 and 0.753, respectively.
In this study, we compared PrioCHECK SPCE with LPBE and VNT in terms of their potential to demonstrate efficacy for the evaluation of vaccination status at the herd level and certification of animals at the individual level. All these methods detected SP antibodies generated 5–8 days after FMDV infection or vaccination in pigs . However, there was disparity among the results, possibly due to the antigen used in each assay, that is, the vaccine strains O/Mya-98/XJ/2010 and O/Cathay/GX/09–7 for VNT and O/SEA/Mya-98 for LPBE.
We expected a high correlation between LPBE and VNT since the former was considered a replacement assay for the latter . A high correlation coefficient proved this to some degree.
The antibody responses measured by SPCE are consistent with those reported in previous studies [17, 18]. More specifically, the vaccination coverage of group I was higher than that of group II at market age. Additionally, both groups had the highest vaccination coverage at 20 weeks of age. These results, along with previous findings by our group and others [17, 19], suggest that vaccination at 8 weeks of age achieves the highest vaccination coverage as detected by SPCE.
The antibody titer and vaccination coverage determined by SPCE were relatively similar to those determined by LPBE and VNT at 4–12 weeks after vaccination and differed from the values measured before and 16 weeks after vaccination. The significant difference in the results obtained during the late period of vaccination poses a potential threat since SPCE was performed immediately before the animals were taken to the market and vaccination is usually performed only once from 8 to 12 weeks of age in many countries. Moreover, vaccination coverage by SPCE was above 50% even before the vaccination. It suggests that SPCE is less specific than other SP test methods since there was no infection during the study, supported by the absence of NSP antibody.
One of the characteristics of PrioCHECK SPCE was the high false positive rate and relatively low correlation coefficient compared to the other test methods. As a general rule of thumb, specific tests are needed to rule in diagnoses, and highly sensitive tests are needed to rule them out.  Thus, the results of SPCE do not fully reflect the protective capacity of sera, unlike LPBE and VNT, which measure the neutralizing capacity. In addition, a high false positive rate can be a serious problem in FMD-endemic countries, given the highly contagious nature of FMDV.
Our study showed that almost 60% of the serum samples were positive for PrioCHECK SPCE before vaccination. Therefore, 50% inhibition is inadequate as a cut-off value; the results of the ROC analysis suggested 63.55% inhibition as a minimum value. We also found that 1:10 is the optimal dilution for PrioCHECK SPCE because there was no overlap between positive and negative sera (data not included). It was demonstrated previously that 30% inhibition at 1:5 dilution was the optimal cut-off for differentiating positive from negative serum , and that 60% inhibition was a proper cut-off for SPCE . Further studies are needed to establish a definitive standard.
This study evaluated and optimized PrioCHECK type O SPCE for post-vaccination monitoring. The positive results obtained by SPCE were higher than those obtained by LPBE and VNT, especially at 8 weeks of age. SPCE showed a relatively high false positive rate compared with LPBE and VNT, suggesting that positivity by PrioCHECK SPCE is not sufficient to certify animals and to confirm the implementation of vaccination. Adjusting the cut-off PI value for SPCE may be a possible solution to this problem. The raw data of PrioCHECK SPCE had the highest correlation with VNT/XJ, while the positivity and negativity were highly correlated with LPBE. Nevertheless, correlations between SPCE and other tests were lower than those among other tests. It is highly recommended that routine FMDV post-vaccination monitoring and corresponding regulatory programs using PrioCHECK SPCE should be combined with alternative methods such as LPBE or VNT.
The pigs used in this study were kept on three farrow-to-finish commercial farms in Pocheon, Gyeonggi province. Routine vaccination programs for porcine circovirus type 2 virus, classical swine fever virus, FMDV, and Mycoplasma hyopneumoniae were carried out. Infectious diseases such as porcine epidemic diarrhea and FMD were not detected. On each farm, 60 piglets were raised and selected at the age of 7 weeks; these pigs were divided into three groups based on the results of PrioCHECK SPCE antibody level against FMD type O. Each group consisted of 20 pigs for each farm and the average antibody levels were similar among the groups. After this study, all pigs of market age were sent to the abattoir and slaughtered humanely. They were stunned with electricity and bled without consciousness according to the Article 10 of Animal Protection Law of Republic of Korea.
Vaccination and sample collection
Animals were vaccinated with inactivated FMD type O bivalent vaccine consisting of O/Mya-98/XJ/2010 and O/Cathay/GX/09–7 strains in oil adjuvant (Jinyu Baoling Bio-pharmaceutical Co., Hohhot, China). These strains were selected based on their genetic homology to field strains isolated in Korea and neighboring countries. The vaccine was formulated to contain at least six times the 50% protective dose.
A single dose (2 ml) of the vaccine was injected intramuscularly into group I (8 weeks old) and group II (12 weeks old). Group III was vaccinated twice at 8 and 12 weeks old. These schedules were designed to analyze antibody response after vaccination in the presence of maternally derived antibodies. Blood samples were collected at 8, 12, 16, 20, and 24 weeks of age in all three groups to evaluate SP antibody titers. The sample size fluctuated during the experimental period because some of the pigs died. Serum samples were stored at − 20 °C or − 70 °C until the analysis.
FMDV type O SP antibody levels were determined using the PrioCHECK FMDV Type O Antibody ELISA kit (Prionics AG, Schlieren-Zurich, Switzerland) according to the manufacturer’s instructions. PrioCHECK SPCE was chosen because it is most frequently adopted as a primary screening method in Korea. Briefly, a microtiter plate coated with FMD type O antigen was incubated with a 1/10 dilution of serum for 1 h at room temperature. After washing, a predetermined dilution of conjugate was added, and the plate was incubated for 1 h at room temperature. The plate was washed and the chromogenic substrate 3,3′,5,5′-tetramethylbenzidine (TMB) was added. The results were expressed as percentage inhibition (PI) relative to the maximum optical density at 450 nm. FMDV type O SP antibodies were considered to be absent and present in the serum if the PI was < 50 and ≥ 50%, respectively. Additionally, serum samples were 1:2 serially diluted and the 50% endpoint titers were calculated.
LPBE was performed using a commercial kit (Lanzhou Veterinary Research Institute, Lanzhou, China) according to the manufacturer’s manual. The assay is based on specific blocking of a defined amount of FMDV antigen by antibodies in the test serum in liquid phase. Briefly, a mixture of viral antigen (O/SEA/Mya-98) and diluted test serum was incubated overnight at 4 °C in liquid phase. The mixture was transferred to a trapping antibody-coated immune plate and incubated for 1 h at 37 °C. After washing, the plate was incubated with FMDV type O guinea pig antibody for 30 min at 37 °C. The plate was washed, rabbit anti-guinea pig IgG conjugated with horseradish peroxidase was added, and incubated for 30 min at 37 °C. After washing, the chromogenic substrate, TMB, was added. The results were expressed as the 50% endpoint titer, that is, the dilution at which the reaction of the test serum yields an optical density equivalent to half of the reaction (antigen) control wells. If the titer was equal to or above 1/64 (1.81 log10), samples were considered to be positive.
Serum samples were tested for virus-neutralizing antibodies against FMDV vaccine strains (O/Mya-98/XJ/2010 and O/GX/09–7) according to the standard protocol of the Animal and Plant Quarantine Agency (Gimcheon, Korea). Two-fold dilutions of the sample were distributed across the plate, starting from a 1/2 dilution. Previously titrated virus was added within log10 1.5–2.5 TCID50 per well. After 1 h incubation at 37 °C, LFBK cell suspension was added at 2.5 × 104 cells per well. Plates were incubated at 37 °C for 3 days. Titers were expressed as the final dilution that inhibited virus growth in 100% of the wells. A titer of ≥1/45 (1.65 log10) and < 1/16 of the final serum dilution in the serum/virus mixture was considered positive and negative, respectively.
Data are presented as mean ± standard deviation. The Pearson correlation coefficient was calculated using Prism v.6.0 software (Graph Pad Inc., La Jolla, CA, USA). Scatter plots were generated using the same program. Group means were compared by the one-way analysis of variance with multiple comparisons. Cohen’s kappa of the assay was calculated by comparing the number of true positives and true negatives. Receiver Operating Characteristic (ROC) curves that illustrate the diagnostic ability of assay were drawn. The optimal cut-off value and the sensitivity and specificity were determined using the ROC curves.
Area under curve
Enzyme-linked immunosorbent assay
Liquid-phase blocking ELISA
Receiver operated characteristic
Solid phase competition ELISA
Tissue culture infective dose
Virus neutralization test
Belsham GJ. Distinctive features of foot-and-mouth disease virus, a member of the picornavirus family; aspects of virus protein synthesis, protein processing and structure. Prog Biophys Mol Biol. 1993;60(3):241–60.
Krystynak RH, Charlebois PA. The potential economic impact of an outbreak of foot-and-mouth disease in Canada. Can Vet J. 1987;28(8):523–7.
Berger HG, Straub OC, Ahl R, Tesar M, Marquardt O. Identification of foot-and-mouth disease virus replication in vaccinated cattle by antibodies to non-structural virus proteins. Vaccine. 1990;8(3):213–6.
Bergmann IE, de Mello PA, Neitzert E, Beck E, Gomes I. Diagnosis of persistent aphthovirus infection and its differentiation from vaccination response in cattle by use of enzyme-linked immunoelectrotransfer blot analysis with bioengineered nonstructural viral antigens. Am J Vet Res. 1993;54(6):825–31.
Neitzert E, Beck E, de Mello PA, Gomes I, Bergmann IE. Expression of the aphthovirus RNA polymerase gene in Escherichia coli and its use together with other bioengineered nonstructural antigens in detection of late persistent infections. Virology. 1991;184(2):799–804.
Sorensen KJ, Madsen KG, Madsen ES, Salt JS, Nqindi J, Mackay DK. Differentiation of infection from vaccination in foot-and-mouth disease by the detection of antibodies to the non-structural proteins 3D, 3AB and 3ABC in ELISA using antigens expressed in baculovirus. Arch Virol. 1998;143(8):1461–76.
Lubroth J, Brown F. Identification of native foot-and-mouth disease virus non-structural protein 2C as a serological indicator to differentiate infected from vaccinated livestock. Res Vet Sci. 1995;59(1):70–8.
Chenard G, Miedema K, Moonen P, Schrijver RS, Dekker A. A solid-phase blocking ELISA for detection of type O foot-and-mouth disease virus antibodies suitable for mass serology. J Virol Methods. 2003;107(1):89–98.
Mackay DK, Bulut AN, Rendle T, Davidson F, Ferris NP. A solid-phase competition ELISA for measuring antibody to foot-and-mouth disease virus. J Virol Methods. 2001;97(1–2):33–48.
Paiba GA, Anderson J, Paton DJ, Soldan AW, Alexandersen S, Corteyn M, Wilsden G, Hamblin P, MacKay DK, Donaldson AI. Validation of a foot-and-mouth disease antibody screening solid-phase competition ELISA (SPCE). J Virol Methods. 2004;115(2):145–58.
Hamblin C, Barnett IT, Hedger RS. A new enzyme-linked immunosorbent assay (ELISA) for the detection of antibodies against foot-and-mouth disease virus. I. Development and method of ELISA. J Immunol Methods. 1986;93(1):115–21.
Hamblin C, Kitching RP, Donaldson AI, Crowther JR, Barnett IT. Enzyme-linked immunosorbent assay (ELISA) for the detection of antibodies against foot-and-mouth disease virus. III. Evaluation of antibodies after infection and vaccination. Epidemiol Infect. 1987;99(3):733–44.
Golding SM, Hedger RS, Talbot P. Radial immuno-diffusion and serum-neutralisation techniques for the assay of antibodies to swine vesicular disease. Res Vet Sci. 1976;20(2):142–7.
Health WOfA. OIE terrestrial manual 2012. In: Foot and mouth disease (infection with foot and mouth disease virus); 2012.
Alexandersen S, Zhang Z, Donaldson AI, Garland AJ. The pathogenesis and diagnosis of foot-and-mouth disease. J Comp Pathol. 2003;129(1):1–36.
Ferris NP, Kitching RP, Oxtoby JM, Philpot RM, Rendle R. Use of inactivated foot-and-mouth disease virus antigen in liquid-phase blocking ELISA. J Virol Methods. 1990;29(1):33–41.
Kim AY, Tark D, Kim H, Kim JS, Lee JM, Kwon M, Bae S, Kim B, Ko YJ. Determination of optimal age for single vaccination of growing pigs with foot-and-mouth disease bivalent vaccine in South Korea. J Vet Med Sci. 2017;79(11):1822–5.
Lee HS, Lee NH, Seo MG, Ko YJ, Kim B, Lee JB, Kim JS, Park S, Shin YK. Serological responses after vaccination of growing pigs with foot-and-mouth disease trivalent (type O, a and Asia1) vaccine. Vet Microbiol. 2013;164(3–4):239–45.
Dekker A, Chenard G, Stockhofe N, Eble PL. Proper timing of foot-and-mouth disease vaccination of piglets with maternally derived antibodies will maximize expected protection levels. Front Vet Sci. 2016;3:52.
Stevenson M. An Introduction to Veterinary Epidemiology. Palmerston North: Massey University; 2008.
The authors would like to thank Chang-Seon Song and In-Soo Choi for assistance with revision of the manuscript, and Sang-Oh Lee for technical assistance.
This work was supported by Korea Institute of Planning and Evaluation for Technology in Food, Agriculture, Forestry (IPET) through Technology Commercialization Support Program, funded by Ministry of Agriculture, Food and Rural Affairs (MAFRA) (112157-3). We would also like to acknowledge the financial support from the R&D Convergence Program of National Research Council of Science & Technology (NST) of Republic of Korea (Grant No. CAP-16-02-KIST).
Availability of data and materials
Data and materials are available from the corresponding authors upon reasonable request.
The authors confirm that the work complies with the ethical policies of the journal. The work was approved by the Institutional Animal Care and Use Committee of the Konkuk University (Seoul, Republic of Korea) under Authority No.: KU18107. The authors obtained approval for conducting the study in written consents from owners of all farms.
Consent for publication
The authors declare that they have no competing interests.
About this article
- Foot-and-mouth disease
- Serological monitoring
- Vaccination coverage
- Solid-phase competitive ELISA
- Liquid-phase blocking ELISA
- Virus neutralization test