Email updates

Keep up to date with the latest news and content from Acta Veterinaria Scandinavica and BioMed Central.

Open Access Highly Accessed Research

Latent class analysis of the diagnostic characteristics of PCR and conventional bacteriological culture in diagnosing intramammary infections caused by Staphylococcus aureus in dairy cows at dry off

Sara Ellinor Cederlöf1, Nils Toft2, Bent Aalbaek3 and Ilka Christine Klaas2*

Author Affiliations

1 Hushållningssällskapet Västernorrland, Trädgårdsgatan 7, Härnösand, Sweden

2 Department of Large Animal Science, University of Copenhagen, Grønnegårdsvej, Frederiksberg C, Denmark

3 Department of Veterinary Disease Biology, University of Copenhagen, Ridebanevej, Frederiksberg C, Denmark

For all author emails, please log on.

Acta Veterinaria Scandinavica 2012, 54:65  doi:10.1186/1751-0147-54-65

The electronic version of this article is the complete one and can be found online at: http://www.actavetscand.com/content/54/1/65


Received:13 June 2012
Accepted:15 November 2012
Published:20 November 2012

© 2012 Cederlöf et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Staphylococcus aureus is one of the most common causes of intramammary infections in dairy cows at dry off. Reliable identification is important for disease management on herd level and for antimicrobial treatment of infected animals. Our objective was to evaluate the test characteristics of PathoProof ™ Mastitis PCR Assay and bacteriological culture (BC) in diagnosing bovine intramammary infections caused by S. aureus at dry off at different PCR cycle threshold (Ct)-value cut-offs.

Methods

Sterile quarter samples and non-sterile composite samples from 140 animals in seven herds were collected in connection with the dairy herd improvement (DHI) milk recording. All quarter samples were analyzed using BC whereas all composite samples were analyzed with PathoProof ™ Mastitis PCR Assay. Latent class analysis was used to estimate test properties for PCR and BC in the absence of a perfect reference test. The population was divided into two geographically divided subpopulations and the Hui-Walter 2-test 2-populations model applied to estimate Se, Sp for the two tests, and prevalence for the two subpopulations.

Results

The Se for PCR increased with increasing Ct-value cut-off, accompanied by a small decrease in Sp. For BC the Se decreased and Sp increased with increasing Ct-value cut-off. Most optimal test estimates for the real-time PCR assay were at a Ct-value cut-off of 37; 0.93 [95% posterior probability interval (PPI) 0.60-0.99] for Se and 0.95 [95% PPI 0.95-0.99] for Sp. At the same Ct-value cut-off, Se and Sp for BC were 0.83 [95% PPI 0.66-0.99] and 0.97 [95% PPI 0.91-0.99] respectively. Depending on the chosen PCR Ct-value cut-off, the prevalence in the subpopulations varied; the prevalence increased with increasing PCR Ct-value cut-offs.

Conclusion

Neither BC nor real-time PCR is a perfect test in detecting IMI in dairy cows at dry off. The changes in sensitivity and prevalence at different Ct-value cut-offs for both PCR and BC may indicate a change in the underlying disease definition. At low PCR Ct-value cut-offs the underlying disease definition may be a truly/heavily infected cow, whereas at higher PCR Ct-value cut-offs the disease definition may be a S. aureus positive cow.

Keywords:
Staphylococcus aureus; PCR; Latent class analysis; Sensitivity; Specificity; Mastitis; Bacteriological culture

Background

Staphylococcus aureus is one of the most important causes of intramammary infections (IMI) in dairy cows at dry off [1]. The majority of cases are subclinical. A recent study reports that S. aureus was the second most commonly isolated pathogen in samples collected pre dry off [2] and a prevalence of 8.2% has been reported for quarter level samples from dairy cows at dry off [3]. Selective dry cow treatment is receiving more attention since there is an increasing focus on proper use of antibiotics. Blanket dry cow treatment is prohibited in Denmark and selective dry cow treatments are only allowed after a microbiological diagnosis [4]. Reliable identification of cows with S. aureus IMI is important for disease management on herd level, for selecting cows for dry cow treatment and in general for appropriate antimicrobial treatment of infected animals. Bacteriological culture (BC) is considered the standard in diagnosing bovine IMI [5], but approximately 39% of milk samples from subclinical cases of IMI showed no growth on BC [6]. Studies have shown ranges of sensitivity (Se) between 0.75 to 0.93 for single samples analyzed with BC [7,8]. S. aureus are known to be shed in a cyclic pattern from infected quarters [7] and repeated sampling over time can be necessary in order to increase the Se [7,9]. However, a recent study showed that culture of a single milk sample resulted in the highest Se and specificity (Sp), 0.904 and 0.998 respectively for S. aureus, when IMI was defined as one or more colonies in pure or mixed culture [10].

The use of molecular methods to detect pathogens has increased over the last years. A real-time polymerase chain reaction (PCR) based reagent kit available in Denmark, PathoProof ™ Mastitis PCR Assay (Finnzymes Oy, Espoo, Finland) can target 11 different IMI causing bacterial species and groups and analyze for penicillin resistance among Staphylococci[11]. Cycle threshold (Ct) -value is a key variable when evaluating real-time PCR results. The Ct-value represents the number of cycles required to reach a particular threshold fluorescence signal level. The fewer cycles required to reach the threshold level, the greater amount of DNA in the sample [12]. An extensive review regarding the choice of Ct-value cut-off in real-time PCR assays, given from both an epidemiological and an analytical point of view is written by Caraguel et al. 2011 [13]. PathoProof ™ Mastitis PCR Assay gives a semi-quantitative result (+, ++, +++) where + equals a Ct-value cut-off between 30 and 37, ++ 24–30 and +++ < 24 respectively for S. aureus[14].

Several studies suggest that assays based on PCR could serve as a useful tool in diagnosing IMI pathogens [15-17]. Arguments in favor of PCR include the short analysis time compared to BC, the ability to detect growth-inhibited and dead bacteria and PCR’s high analytical sensitivity. Evidence indicates that PCR may produce a diagnosis in cases of clinical mastitis or subclinical mastitis where BC turned out negative [11,18]. Others have shown that the Se and Sp for the PCR assay for S. aureus and all major pathogens to range between 0.86 to 0.94 and 0.91 to 0.95 respectively [19,20].

In Denmark, PCR analysis has been allowed to substitute BC for microbiological diagnosis prior to selective dry cow treatment since July 2010. In 2012, PCR testing of cows after day 200 in lactation was reported from 767 Danish dairy farms [21]. Farmers can order PCR tests on cow-level samples from routine dairy herd improvement (DHI) milk recordings, which are analyzed using PathoProof ™ Mastitis PCR assay [4,22]. Although Denmark already utilizes the PCR assay in routine mastitis testing, relatively few published studies evaluate its accuracy under field circumstances for clinical cases of mastitis [11,18] and to our knowledge no study evaluates its accuracy for IMI based on cow-or quarter level samples.

Regarding diagnosis of IMI, there is no perfect gold standard [23]. If using a non-perfect test as reference standard when evaluating new test methods, new methods will be punished for diagnosing correctly if the non-perfect test does not. This will result in an underestimation of Se and Sp [24]. Using latent class analysis (LCA), it is possible to estimate Se and Sp without having a gold standard. The disease status exists but is not known; it is latent [25,26].

The objective of this study was to evaluate the Se and Sp of PathoProof ™ Mastitis PCR Assay and BC in diagnosing bovine IMI caused by S. aureus at dry off with LCA. Specifically we tested the effect of using different PCR Ct-value cut-offs on the Se and Sp of both tests.

Methods

Herds and animals

The source population for this study was all Danish dairy herds using PCR to diagnose IMI in their cows at dry off, which is the main reason for farmers to order PCR tests. A convenience sample of seven Danish herds was included in this study. The herds were selected based on geographic location and willingness to participate during two weeks of March 2011. The herds had to expect at least ten pre dry off cows for PCR at their next DHI milk recording. The cows selected for PCR sampling were dried off within a week after the DHI milk recording. The farmers selected cows for PCR test mainly based on previous somatic cell counts. The farmers ordered PCR sampling for the selected cows for the subsequent routine DHI recording in the Danish Cattle Database where the results of the PCR tests are registered.

Samples for PCR

Milk samples submitted for the PathoProof ™ Mastitis PCR Assay were collected automatically at cow-level during DHI milk recording under non-sterile conditions in sample tubes containing bronopol to restrict bacterial growth during the routine milk recording. In herds with milking parlour, the samples for PCR were metered by Tru-Test electronic milk meter. Samples were handled either by the manager/staff of the farms or a technician. In automatic milking system (AMS) herds, composite samples were taken by the Lely Shuttle milk sampling unit. Milk samples from the DHI milk recording were transported by a technician to Eurofins│Steins in Holstebro, Denmark. Samples taken during the morning milking arrived at the laboratory the same day, samples taken during evening milking arrived the following day.

Samples for bacteriological culture

Within 24 hours after PCR sampling, the first author collected sterile quarter foremilk samples for BC from the same cows. Following disinfection of the teat ends using cotton swabs soaked in 70% alcohol and let to dry, aseptic samples (app. 10 mL) were collected in sterile plastic tubes. The first few mL of milk was discarded and latex gloves were worn during the sampling. In the five herds with milking parlour, pre-milking quarter samples were collected. In the two AMS herds, quarter milk samples were collected in the separation area at the exit of the robotic unit. Samples for bacterial culture were frozen at – 20°C after sampling and stored until further analysis.

Bacterial culture

The milk samples where thawed at room temperature, i.e. 20-25°C, before plating. Volumes of 0.01 mL of milk samples were plated on blood agar, prepared from Oxoid blood agar base (Oxoid, Basingstoke, Hampshire, England) supplemented with 5% sterile bovine blood. The cultures were incubated aerobically at 37°C and read after 1 and 2 day’s incubation. Representative colonies were sub-cultured. Colony morphology, hemolysis, cell shape, Gram stain ability and catalase reaction were recorded. Cultures having intermediate sized, smooth, white or yellow, hemolytic colonies consisting of catalase positive, Gram positive cocci, were considered as staphylococci [27,28]. Such isolates were subjected to coagulase testing, using equine plasma [29]. When ≥ 1 CFU of coagulase positive staphylococci were demonstrated in at least one mammary quarter of a cow, it was included as positive. Samples containing more than three different colony types were considered as contaminated and the cow was excluded from the study.

Real-time PCR assay

A commercial real-time PCR test kit (PathoProof™ Mastitis PCR Assay, Finnzymes Oy, Espoo, Finland) was used for analysis of the composite milk samples collected at the milk recordings. The milk samples were kept refrigerated during transportation to the laboratory and until analyzed with PCR. The PCR test was performed by Eurofins│Steins in Holstebro, Denmark. The laboratory follows standard procedures for the PCR assay described elsewhere [30].

Statistical analysis

To estimate Se and Sp for the PathoProof ™ Mastitis PCR Assay and BC, a Bayesian latent class analysis was used. The analysis was based on the Hui-Walter paradigm: (i) the tests are conditionally independent (ii) the population is divided into two subpopulations with different disease prevalence and (iii) sensitivity and specificity of the tests is the same in all populations [25]. The population was divided into two subpopulations based on geographical location, with herds located on Jutland/Fyn and herds located on Zealand. The Hui-Walter 2-test 2-populations model was used to estimate Se, Sp and prevalence for the two tests, PCR and BC, and for the two subpopulations. The Bayesian version of a latent class analysis was conducted in OpenBUGS version 3.1.2 [31]. This software uses a Markov Chain Monte Carlo (MCMC) sampling algorithm to obtain a Monte Carlo sample from the posterior distribution. The first 10.000 samples were discarded as burn-in to allow convergence. The following 50.000 iterations were used for posterior inference. Uninformative priors Beta (1, 1) were used for all parameters. The MCMC chain was after initial burn-in, assessed by visual inspection of time-series plots of variables as well as Gelman-Rubin diagnostic plots, to assess whether convergence had appeared [32]. Posterior inference presented medians and corresponding 95% posterior probability intervals (PPI, which can be seen as the Bayesian analogue of a confidence interval) for the prevalence in the two subpopulations and Se and Sp for the two tests, PCR and BC. As explained in Toft et al. 2007 [24], Bayesian posterior probabilities (POPR) were calculated in order to decide in favor of or against one of the two tests at the pre-defined PCR Ct-value cut-off for positive samples; 37. To investigate the effect of low and moderate concentration of DNA in the samples on the test characteristics of both tests, latent class analysis was carried out at PCR Ct-value cut-offs ≤ 32, ≤ 34, ≤ 37 and ≤ 39.

Results

Descriptive statistics

During editing 17 animals were excluded from analysis because of the following reasons: For 10 animals, one or several quarter samples for BC could not be reliably identified, four animals had missing results from the PCR assay and three animals had one or several quarter samples that were classified as contaminated i.e. samples with more than three different bacterial colonies. After editing complete samples from 140 Danish Holstein-Friesian and Jersey dairy cows from seven different herds were eligible for analysis. One of the herds was tested at DHI milk recording in the start of early April 2011 and from one included herd, only six cows were at dry off and selected for PCR sampling at the DHI milk recording.

The cows included in this study had a SCC on the test day between 8.000 – 5.340.000 cells/mL, with an average of 483.000 (CI 95% 343.000; 623.000). The cows produced on the test day between 8.5 – 34 kg of milk with an average of 23 kg (CI 95% 22; 24). Parity ranged from one to 13, with an average of 2.6 (CI 95% 2.3; 2.9).

Cross-classified results of the PCR and BC for selected Ct-value cut-offs are shown in Table 1 where the results are divided into the two subpopulations, Jutland/Fyn and Zealand.

Table 1. The total number of cows found positive for S. aureus in two geographically divided subpopulations by PCR and bacteriological culture (BC), as a function of the Ct-value cut-off for PCR

Test characteristics for PCR and bacteriological culture

Latent class estimates of Se and Sp for BC and PCR are presented in Table 2 at different PCR Ct-value cut-offs. The Se for PCR increased as expected when the Ct-value cut-off increased, albeit with a corresponding (but smaller) decrease in Sp. For BC the Se decreased and Sp increased with increasing PCR Ct-value cut-off. Similarly, Table 3 gives the prevalence in the two populations where an increased prevalence is also observed with increasing PCR Ct-value cut-off. When calculating the POPR for the Sp at PCR Ct-value cut-off 37 against Sp of BC, it was found to be 0.305, i.e. in only 30% of the cases will the PCR assay be the most specific method. This illustrates that there were no statistical evidence that one of the two tests should be more specific.

Table 2. Estimate and 95 % posterior probability interval (PPI) of sensitivity (Se) and specificity (Sp) of PCR and bacteriological culture (BC) at PCR Ct-value cut-off 32, 34, 37 and 39, as tests for diagnosing intramammary infections by S. aureus

Table 3. Estimates and 95 % posterior probability interval (PPI) of prevalence in the two populations; Jutland/Fyn and Zealand as a function of the Ct-value cut-off for PCR

Discussion

This study estimated the test characteristics of a commercially available PCR assay, PathoProof ™ Mastitis PCR Assay, and BC to identify IMI with S. aureus in dairy cows at dry off. The study was done using LCA to avoid the assumption of an available perfect reference test. The findings were ambiguous. PCR had lower Se and higher Sp than BC for low PCR Ct-value cut-offs, but it was reversed for higher PCR Ct-value cut-offs. Surprisingly, Se and Sp of BC were affected by the choice of the PCR Ct-value cut-off. Increasing prevalence at increasing PCR Ct-value cut offs support the assumption of a quantitative relationship between Ct-values and infection load in the sample [12].

A PCR assay detects DNA from both viable and non-viable bacteria while BC is only capable of detecting viable bacteria [11]. In cases where the infection is cured, either due to treatment or self-cure, bacterial DNA can still be present in the udder and the cow can be falsely diagnosed as positive by the PCR assay [33]. When increasing the PCR Ct-value cut-off, the Se of BC decreases, indicating that the bacteria detected by PCR could be non-viable, in amounts lower than the detection threshold of the BC or derived from other sources than the milk. When using a high PCR Ct-value cut-off, more animals may be false positive by PCR due to different reasons for example non-viable bacteria in low concentrations. Since S. aureus commonly inhabits cow skin [34], the bacteria could furthermore be a result of contamination, teat canal infections or teat skin infections. Carry-over in the milking system could also be a possibility [35]. The results also indicate that the disease definition is changing depending on the PCR Ct-value cut-off. The effect is shown in the prevalence estimates where a PCR Ct-value cut-off of 32 results in a disease prevalence of 23% in subpopulation Jutland/Fyn. When the PCR Ct-value cut-off is increased to 37, the disease prevalence has increased to 37% in the same population. One could argue that a PCR Ct-value cut-off at 32 indicates the presence of a high amount of bacteria in the milk, which most likely are associated with an active IMI. When the amount of bacteria in the milk is high, we increase the probability that viable bacteria are present, which can be detected by BC. When increasing the PCR Ct-value cut-off, the disease definition is apparently changing, reflected by an increasing prevalence. Higher PCR Ct-values may indicate that the amount of bacteria is below the detection threshold of BC, that the bacteria present are non-viable and/or that the bacteria derive from other sources than the infected mammary gland. Under the assumption that the disease definition changes dependent on the chosen PCR Ct-value cut-off, changes in test estimates for both tests at different PCR Ct-value cut-off for the real-time PCR may be a logical consequence.

In this study however, both BC and the real-time PCR assay had relatively high Se and Sp, depending on the PCR Ct-value cut-off, indicating that both tests can serve as useful tools in diagnosing IMI caused by S. aureus. Friendship et al., 2010 [19] evaluated the PathoProof ™ Mastitis PCR Assay in detecting S. aureus. All cows in the study originated from herds with a known history of intramammary infections due to S. aureus. The study found a Se for the PCR Assay of 0.94 and Sp of 0.95 when using BC as gold standard. Koskinen et al. 2010 [20], found the Se and Sp for the PathoProof ™ Mastitis PCR Assay to be 0.862 and 0.916 respectively when evaluated for all pathogens [20]. These Se and Sp are similar to those found in this study, where Se and Sp for the PCR assay were estimated to 0.93 and 0.95 respectively at PCR Ct-value cut-off 37. The later article argues that the use of BC as reference standard most likely results in an underestimation of test estimates for the PCR due to inaccuracy of the reference test. Our study can support this assumption and support the use of LCA in situations where no perfect reference test is available.

All milk samples used for BC in this study were frozen prior to analysis. Freezing has been shown to both increase the likelihood for obtaining S. aureus in the milk sample [36-38] and decrease or to show no effect in detection rates [39-41]. Evaluating the effect of freezing on BC results was beyond the scope of our study. Thus, we cannot exclude that freezing might have affected the results.

PCR is shown to be able to detect mastitis bacteria in samples that yielded no growth in bacteriological culture [18], which is an advantage in cases where the aetiology of the mastitis is of special interest. Another advantage is the speed of the real-time PCR analysis compared to BC; there is a possibility for the same-day results.

When interpreting the Ct-value given by the PCR assay, one should consider the type of sample and the sampling conditions. The samples for PCR were in this study collected under non-sterile conditions and metered by the milking equipment. In these samples there is a possibility for contamination from the previous cows and other sources than the milk. Pre-milking practices in the herd and condition of the milking equipment may have an influence on the obtained Ct-values. However, differences between the included herds made the estimation of these factors not possible. The results given in form of a Ct-value should furthermore be interpreted with all other available information for the cow, such as history, clinical signs and SCC in the milk. This should however also be the practice with results from BC.

Model assumptions

An implied assumption of the LCA is that the two tests are conditionally independent given disease status. Given that there is no culturing involved in the PCR procedure, this assumption is justified, however, only when accepting the underlying disease definitions discussed above.

In this study, the population was divided based on geographical location, Jutland/Fyn and Zealand. The difference in prevalence found here was not large, but as the herds were selected to present problems, we could not expect large differences. In Toft et al. 2005 [26], the importance of the difference in true prevalence was examined. Although smaller differences might infer some bias, it is more important that the assumption about constant Se and Sp across populations is justified.

Both farms using AMS and conventional milking systems were included in the study. A total of 25 cows originated from AMS herds. A study by Lovendahl and Bjerring [35], indicates that carryover problems are not negligible in the AMS system compared to conventional systems. It could be assumed that a higher proportion of cows could be classified as false positive due to carryover. Excluding the 25 cows originating from AMS herds did not result in any notable differences on the estimates of test accuracy.

Conclusion

Results in this study indicate that neither BC nor real-time PCR is a perfect test in detecting IMI in dairy cows at dry off. The changes in sensitivity and prevalence at different Ct-value cut-offs for both PCR and BC may indicate a change in the underlying disease definition. At low PCR Ct-value cut-offs the underlying existing, but latent disease definition may be a truly/heavily infected cow, whereas at higher PCR Ct-value cut-offs the disease definition may be a S. aureus positive cow.

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

The study was designed by SEC and ICK. SEC performed the collection of samples, the laboratory work and the analysis of results was done by all authors. NT and SEC performed all statistical calculations. BA supervised the bacteriological culturing. All authors revised, read and approved the final manuscript.

Acknowledgements

We gratefully acknowledge all the farmers that participated in this study. SEC wants to thank Professor Carsten Enevoldsen at the Department of Large Animal Science at University of Copenhagen for excellent support in the starting period of this project.

References

  1. Bradley AJ, Green MJ: The importance of the nonlactating period in the epidemiology of intramammary infection and strategies for prevention.

    Vet Clin N Am -Food Anim Pract 2004, 20(3):547-568. Publisher Full Text OpenURL

  2. Reyher KK, Dufour S, Barkema HW, Des Côteaux L, DeVries TJ, Dohoo IR, Keefe GP, Roy J, Scholl DT: The national cohort of dairy farms—a data collection platform for mastitis research in Canada.

    J Dairy Sci 2011, 94(3):1616-1626. PubMed Abstract | Publisher Full Text OpenURL

  3. Petzer I, Lourens DC, van der Schans TJ, Watermeyer JC, van Reenen R, Rautenbach GH, Thompson P: Intramammary infection rate during the dry period in cows that received blanket dry cow therapy: efficacy of 6 different dry-cow intra-mammary antimicrobial products.

    J S Afr Vet Assoc -Tydskr Suid-Afr Vet Ver 2009, 80(1):23-30. OpenURL

  4. Anonymous:

    Announcement on the veterinary use, dispensing and prescribing of drugs for animals. 2010. [Danish (Bekendtgørelse 785 af 25/06/2010 om dyrlægers anvendelse, udlevering og ordinering af lægemidler til dyr)]

    [https://www.retsinformation.dk/Forms/R0710.aspx?id=132613 webcite]

    OpenURL

  5. National Mastitis Council: Laboratory handbook on bovine mastitis. Madison: WI: NMC; 1999. OpenURL

  6. Bradley AJ, Leach KA, Breen JE, Green LE, Green MJ: Survey of the incidence and aetiology of mastitis on dairy farms in England and Wales.

    Vet Rec 2007, 160(8):253-258. PubMed Abstract | Publisher Full Text OpenURL

  7. Sears PM, Smith BS, English PB, Herer PS, Gonzalez RN: Shedding pattern of Staphylococcus aureus from bovine intramammary infections.

    J Dairy Sci 1990, 73(10):2785-2789. PubMed Abstract | Publisher Full Text OpenURL

  8. Hicks CR, Eberhart RJ, Sischo WM: Comparison of microbiologic culture, an enzyme-linked immunosorbent assay, and determination of somatic cell count for diagnosing Staphylococcus aureus mastitis in dairy cows.

    J Am Vet Med Assoc 1994, 204(2):255-260. PubMed Abstract OpenURL

  9. Buelow KL, Thomas CB, Goodger WJ, Nordlund KV, Collins MT: Effect of milk sample collection strategy on the sensitivity and specificity of bacteriologic culture and somatic cell count for detection of Staphylococcus aureus intramammary infection in dairy cattle.

    Prev Vet Med 1996, 26(1):1-8. Publisher Full Text OpenURL

  10. Dohoo IR, Smith J, Andersen S, Kelton DF, Godden S: Diagnosing intramammary infections: evaluation of definitions based on a single milk sample.

    J Dairy Sci 2011, 94(1):250-261. PubMed Abstract | Publisher Full Text OpenURL

  11. Koskinen MT, Wellenberg GJ, Sampimon OC, Holopainen J, Rothkamp A, Salmikivi L, van Haeringen WA, Lam TJGM, Pyörälä S: Field comparison of real-time polymerase chain reaction and bacterial culture for identification of bovine mastitis bacteria.

    J Dairy Sci 2010, 93(12):5707-5715. PubMed Abstract | Publisher Full Text OpenURL

  12. Heid CA, Stevens J, Livak KJ, Williams PM: Real time quantitative PCR.

    Genome Res 1996, 6(10):986-994. PubMed Abstract | Publisher Full Text OpenURL

  13. Caraguel CGB, Stryhn H, Gagne N, Dohoo IR, Hammell KL: Selection of a cutoff value for real-time polymerase chain reaction results to fit a diagnostic purpose: analytical and epidemiologic approaches.

    J Vet Diagn Invest 2011, 23(1):2-15. PubMed Abstract | Publisher Full Text OpenURL

  14. Finnzymes: Instruction Manual- PathoProofTM Mastitis PCR Assay F-870S/L, version 1.2, April 2008. Espoo, Finland, 2008.

  15. Riffon R, Sayasith K, Khalil H, Dubreuil P, Drolet M, Lagace J: Development of a rapid and sensitive test for identification of major pathogens in bovine mastitis by PCR.

    J Clin Microbiol 2001, 39(7):2584-2589. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  16. Phuektes P, Browning CF, Anderson G, Mansell PD: Multiplex polymerase chain reaction as a mastitis screening test for Staphylococcus aureus, Streptococcus agalactiae, Streptococcus dysgalactiae and Streptococcus uberis in bulk milk samples.

    J Dairy Res 2003, 70(2):149-155. PubMed Abstract | Publisher Full Text OpenURL

  17. Gillespie BE, Oliver SP: Simultaneous detection of mastitis pathogens, Staphylococcus aureus, Streptococcus uberis, and Streptococcus agalactiae by multiplex real-time polymerase chain reaction.

    J Dairy Sci 2005, 88(10):3510-3518. PubMed Abstract | Publisher Full Text OpenURL

  18. Taponen S, Salmikivi L, Simojoki H, Koskinen MT, Pyörälä S: Real-time polymerase chain reaction-based identification of bacteria in milk samples from bovine clinical mastitis with no growth in conventional culturing.

    J Dairy Sci 2009, 92(6):2610-2617. PubMed Abstract | Publisher Full Text OpenURL

  19. Friendship C, Kelton D, van de Water D, Slavic D, Koskinen MT: Field evaluation of the pathoproof mastitis PCR assay for the detection of Staphylococcus aureus infected cows using DHI samples. In NMC annual meeting proceedings. January 31-February 3 2010. Albuquerque, New Mexico: NMC; 2010:226-227. OpenURL

  20. Koskinen MT, Holopainen J, Salmikivi L: Field comparison of real-time PCR and conventional bacterial culturing in bovine mastitis testing. In Mastitis research into practice: proceedings of the 5th IDF mastitis conference, 21-24 March 2010. Edited by Hillerton JB, Eric Hillerton J. Christchurch, New Zealand: New Zealand Veterinary Association, VetLearn Staff; 2010:486-488. OpenURL

  21. Bennedsgaard TW: Personal communication. Tjele, Denmark: Aarhus University, Department of Animal Bioscience and Health, Blichers Alle' 20, 8830; 2012. OpenURL

  22. Katholm J:

    News for veterinarians- newsletter regarding welfare and health, no. 2. 2010. Aktuelt til dyrlæger- nyhedsbrev om velfærd og sundhed, nr. 2 2010,Videncentret for landbrug, kvæg, Danish.

    [https://www.landbrugsinfo.dk/Kvaeg/Sundhed-og-dyrevelfaerd/Sider/AktuelttilDyrlaeger0032010.aspx#PCRMælkeprøver webcite]

    OpenURL

  23. Sanford CJ, Keefe GP, Sanchez J, Dingwell RT, Barkema HW, Leslie KE, Dohoo IR: Test characteristics from latent-class models of the California Mastitis Test.

    Prev Vet Med 2006, 77(1–2):96-108. PubMed Abstract | Publisher Full Text OpenURL

  24. Toft N, Åkerstedt J, Tharaldsen J, Hopp P: Evaluation of three serological tests for diagnosis of Maedi-Visna virus infection using latent class analysis.

    Vet Microbiol 2007, 120(1–2):77-86. PubMed Abstract | Publisher Full Text OpenURL

  25. Hui SL, Walter SD: Estimating the error rates of diagnostic-tests.

    Biometrics 1980, 36(1):167-171. PubMed Abstract | Publisher Full Text OpenURL

  26. Toft N, Jørgensen E, Højsgaard S: Diagnosing diagnostic tests: evaluating the assumptions underlying the estimation of sensitivity and specificity in the absence of a gold standard.

    Prev Vet Med 2005, 68(1):19-33. PubMed Abstract | Publisher Full Text OpenURL

  27. National Mastitis Council: Microbiological procedures for the diagnosis of bovine udder infections and determination of milk quality. Madison, WI: NMC; 2004. OpenURL

  28. Quinn PJ, Markey BK, Carter ME, Donnelly WJC, Leonard FC: Veterinary microbiology and microbial disease. Oxford, UK: Blackwell Science Ltd.; 2006. OpenURL

  29. Barrow GI, Feltham RKA: Cowan and Steel's manual for the identification of medical bacteria. UK: Cambridge University Press; 1993. PubMed Abstract | Publisher Full Text OpenURL

  30. Koskinen MT, Holopainen J, Pyörälä S, Bredbacka P, Pitkälä A, Barkema HW, Bexiga R, Roberson J, Sølverød L, Piccinini R, Kelton D, Lehmusto H, Niskala S, Salmikivi L: Analytical specificity and sensitivity of a real-time polymerase chain reaction assay for identification of bovine mastitis pathogens.

    J Dairy Sci 2009, 92(3):952-959. PubMed Abstract | Publisher Full Text OpenURL

  31. Spiegelhalter D, Thomas A, Best N, Lunn D:

    OpenBUGS user manual, version 3.2.1 March 2011. 2011.

    [http://www.openbugs.info/Manuals/Manual.html webcite]

    OpenURL

  32. Toft N, Innocent GT, Gettinby G, Reid SWJ: Assessing the convergence of Markov Chain Monte Carlo methods: an example from evaluation of diagnostic tests in absence of a gold standard.

    Prev Vet Med 2007, 79(2–4):244-256. PubMed Abstract | Publisher Full Text OpenURL

  33. Wellenberg GJ, Sampimon OC, Rothkamp A, van Haeringen WA, Lam TJGM: Detection of mastitis pathogens by real-time PCR in clinical and subclinical mastitis samples. In Mastitis research into practice: proceedings of the 5th IDF mastitis conference, 21-24 March 2010. Edited by Hillerton JB, Eric Hillerton J. Christchurch, New Zealand: New Zealand Veterinary Association, VetLearn Staff; 2010:539-544. OpenURL

  34. Haveri M, Hovinen M, Roslof A, Pyorala S: Molecular types and genetic profiles of Staphylococcus aureus strains isolated from bovine intramammary infections and extramammary sites.

    J Clin Microbiol 2008, 46(11):3728-3735. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  35. Lovendahl P, Bjerring MA: Detection of carryover in automated milk sampling equipment.

    J Dairy Sci 2006, 89(9):3645-3652. PubMed Abstract | Publisher Full Text OpenURL

  36. Villanueva MR, Tyler JW, Thurmond MC: Recovery of Streptococcus agalactiae and Staphylococcus aureus from fresh and frozen bovine milk.

    J Am Vet Med Assoc 1991, 198(8):1398-1400. PubMed Abstract OpenURL

  37. Godden SM, Jansen JT, Leslie KE, Smart NL, Kelton DF: The effect of sampling time and sample handling on the detection of Staphylococcus aureus in milk from quarters with subclinical mastitis.

    Can Vet J -Rev Vet Can 2002, 43(1):38-42. OpenURL

  38. Hubackova M, Rysanek D: Effects of freezing milk samples on the recovery of alimentary pathogens and indicator microorganisms.

    Acta Vet Brno 2007, 76(2):301-307. Publisher Full Text OpenURL

  39. Schukken YH, Smit JAH, Grommers FJ, Vandegeer D, Brand A: Effect of freezing on bacteriologic culturing of mastitis milk samples.

    J Dairy Sci 1989, 72(7):1900-1906. PubMed Abstract | Publisher Full Text OpenURL

  40. Dinsmore RP, English PB, Gonzalez RN, Sears PM: Use of augmented cultural techniques in the diagnosis of the bacterial cause of clinical bovine mastitis.

    J Dairy Sci 1992, 75(10):2706-2712. PubMed Abstract | Publisher Full Text OpenURL

  41. Murdough PA, Deitz KE, Pankey JW: Effects of freezing on the viability of nine pathogens from quarters with subclinical mastitis.

    J Dairy Sci 1996, 79(2):334-336. PubMed Abstract | Publisher Full Text OpenURL