Improving the Quality of Surgical and Treatment Processes Using Cumulative Sum Control Charts: A Comprehensive and Applied Review

Document Type : Original Article

Authors

1 Associated Professor of Malek Ashtar University of Technology, Department of Industrial Engineering, Tehran, Iran

2 ** Master's student in Industrial Engineering, Malek Ashtar University of Technology

Abstract
Introduction & Objective: Developing the use of statistical process control (SPC) methods for the healthcare area is evaluated as an attractive contribution. Analyzing patient data using SPC approach plays an important role to monitor effectively a health care process, improving the quality surgical processes, and other medical service processes. Among SPC methods, cumulative sum approach have been attracted more attention in the medical literature due to its simple formulation and interpretation, as well as more sensitivity to detect medium and small shifts compared to other methods. The aim of this study is to provide analytically positive effects of using CUSUM charts for hospitals, surgical, and therapeutic processes. Materials & Methods: This study is a comprehensive literature review. This paper investigates comprehensively researches and results of the used CUSUM charts in different areas of healthcare focusing on reported reliable scientific sources without any limitation of time. Results: This study reveals that different cumulative sum control chart types are proposed to use in therapeutic and surgical processes leading to improvement of the processes. The analysis indicates that risk adjustment methods considering patients’ risk before surgery is more superior compared to other CUSUM types. This approach focuses on homogenizing and adjusting the effect of physical and physiological conditions corresponding to patients. Conclusions: Cumulative sum charts should be used considering strength and weakness points of each chart as well as data probability distribution. This paper reveals that the use of risk-adjusted cumulative sum charts can be more accurately reflect the performance results of a surgery compared to other chart types. Furthermore the use of CUSUM methods for learning curves is capable of monitoring effectively the performance of medical trainees.

Keywords


1. Woodall WH. Bridging the Gap between Theory and Practice in Basic Statistical Process Monitoring. Quality Engineering. 2016 Jul 9 (just-accepted): 00-.
2. Woodall WH, Mohammed MA, Lucas JM, Watkins R. The Use of Control Charts in Health-Care and Public-Health Surveillance (with discussion). Journal of Quality Technology. 2006 Apr 1; 38(2): 89.
3. Rollo JL, Fauser BA. Computers in total quality management. Statistical process control to expedite stats. Archives of pathology & laboratory medicine. 1993 Sep; 117(9): 900-5.
4. Carey RG, Teeters JL. CQI case study: reducing medication errors. The Joint Commission journal on quality improvement. 1995 May; 21(5): 232-7.
5. Ziegenfuss Jr JT, McKenna CK. Ten tools of continuous quality improvement: a review and case example of hospital discharge. American journal of medical quality: the official journal of the American College of Medical Quality. 1994 Dec; 10(4): 213-20.
6. Shahian DM, Williamson WA, Svensson LG, Restuccia JD, D'Agostino RS. Applications of statistical quality control to cardiac surgery. The Annals of thoracic surgery. 1996 Nov 30; 62(5): 1351-9.
7. Cornélissen G, Halberg F, Hawkins D, Otsuka K, Henke W. Individual assessment of antihypertensive response by self-starting cumulative sums. Journal of medical engineering & technology. 1997 Jan 1; 21 (3-4): 111-20.
8. Linford LH, Clemmer TP, Oniki TA. Development of a blood glucose protocol using statistical quality control techniques. Nutrition in clinical practice: official publication of the American Society for Parenteral and Enteral Nutrition. 1997 Feb; 12(1): 38.
9. Ornstein SM, Jenkins RG, Lee FW, Sack JL, LaKier EI, Roskin SD, Wulfman JS, Wriston GA. The computer-based patient record as a CQI tool in a family medicine center. The Joint Commission journal on quality improvement. 1997 Jul; 23(7):
347-61.
10.    Nelson EC, Splaine ME, Batalden PB, Plume SK. Building measurement and data collection into medical practice. Annals of Internal Medicine. 1998 Mar 15; 128(6): 460-6.
11.    Levett JM, Carey RG. Measuring for improvement: from Toyota to thoracic surgery. The Annals of thoracic surgery. 1999 Aug 31; 68(2): 353-8.
12.    Pollard JB, Garnerin P. Outpatient preoperative evaluation clinic can lead to a rapid shift from inpatient to outpatient surgery: a retrospective review of perioperative setting and outcome. Journal of Clinical Anesthesia. 1999 Feb 28; 11(1): 39-45.
13.    Schwab RA, Sorbo SM, Cunningham MR, Craven K, Watson WA. Using statistical process control to demonstrate the effect of operational interventions on quality indicators in the emergency department. Journal for Healthcare Quality. 1999 Jul 8; 21(4):
38-41.
14.    Alemi F, Sullivan T. Tutorial on risk adjusted
X-bar charts: applications to measurement of diabetes control. Quality Management in Healthcare. 2001 Jan 1; 9(3): 57-65.
15.    Aronsky D, Kendall D, Merkley K, James BC, Haug PJ. A comprehensive set of coded chief complaints for the emergency department. Academic Emergency Medicine. 2001 Oct 1; 8(10): 980-9.
16.    Quinn DC, Graber AL, Elasy TA, Thomas J, Wolff K, Brown A. Overcoming turf battles: developing a pragmatic, collaborative model to improve glycemic control in patients with diabetes. The Joint Commission Journal on Quality and Patient Safety. 2001 May 1; 27(5): 255-64.
17.    Böelle PY, Bonnet F, Valleron AJ. An integrated system for significant anesthetic events monitoring. In Proceedings of the AMIA Symposium 2001
(p. 62). American Medical Informatics Association.
18.    Burnett L, Chesher D, Burnett JR. Optimizing the availability of'stat'laboratory tests using Shewhart'c'control charts. Annals of clinical biochemistry. 2002 Mar 1; 39(2): 140-4.
19.    Chu J, Neuhauser DV, Schwartz I, Aye HH. The efficacy of automated/electrical twitch obtaining intramuscular stimulation (atoims/etoims) for chronic pain control: evaluation with statistical process control methods. Electromyography and clinical neurophysiology. 2001 Dec; 42(7): 393-401.
20.    Fasting S, Gisvold SE. Statistical process control methods allow the analysis and improvement of anesthesia care. Canadian Journal of Anesthesia. 2003 Oct 1; 50(8): 767-74.
21.    Mertens WC, Higby DJ, Brown D, Parisi R, Fitzgerald J, Benjamin EM, Lindenauer PK. Improving the care of patients with regard to chemotherapy-induced nausea and emesis: the effect of feedback to clinicians on adherence to antiemetic prescribing guidelines. Journal of Clinical Oncology. 2003 Apr 1; 21(7): 1373-8.
22.    Norberg A, Christopher NC, Ramundo ML, Bower JR, Berman SA. Contamination rates of blood cultures obtained by dedicated phlebotomy vs intravenous catheter. Jama. 2003 Feb 12; 289(6):
726-9.
23.    Schnelle JF, Newman DR, Fogarty TE, Wallston K, Ory M. Assessment and Quality Control of Incontinence Care in Long-Term Nursing Facilities. Journal of the American Geriatrics Society. 1991 Feb 1; 39(2): 165-71.
24.    Bluth EI, Havrilla M, Blakeman C. Quality improvement techniques: value to improve the timeliness of preoperative chest radiographic reports. AJR. American journal of roentgenology. 1993 May; 160(5): 995-8.
25.    Dey ML, Sluyter GV, Keating JE. Statistical process control and direct care staff performance. The journal of mental health administration. 1994 Mar 1; 21(2): 201-9.
26.    Shaha SH. Acuity systems and control charting. Quality Management in Healthcare. 1995 Apr 1; 3(3): 22-30.
27.    Johnson CC, Martin M. Effectiveness of a physician education program in reducing consumption of hospital resources in elective total hip replacement. Southern medical journal. 1996 Mar; 89(3): 282-9.
28.    Tsacle EG, Aly NA. An expert system model for implementing statistical process control in the health care industry. Computers & industrial engineering. 1996 Oct 31; 31(1): 447-50.
29.    Konrad C, Gerber H, Schuepfer G, Schmucki O. Transurethral resection syndrome: effect of the introduction into clinical practice of a new method for monitoring fluid absorption. Journal of clinical anesthesia. 1998 Aug 31; 10(5): 360-5.
30.    Bonetti PO, Waeckerlin A, Schuepfer G, Frutiger A. Improving time-sensitive processes in the intensive care unit: the example of ‘doortoneedle time’in acute myocardial infarction. International Journal for Quality in Health Care. 2000 Aug 1; 12(4): 311-7.
31.    Roman SH, Chassin MR. Windows of opportunity to improve diabetes care when patients with diabetes are hospitalized for other conditions. Diabetes Care. 2001 Aug 1; 24(8): 1371-6.
32.    Hyrkäs K, Lehti K. Continuous quality improvement through team supervision supported by continuous self-monitoring of work and systematic patient feedback. Journal of nursing management. 2003 May 1; 11(3): 177-88.
33.    Atashgar k,Ebrahim Tarimoghadam A, Batouei M. Identification multi path change point for blood pressure in cardiovascular diseases using the entropy method. 12th International Industrial Engineering conference; Tehran2016.
34.    Iravani T, Atashgar K. Monitoring satisfaction of patients in a treatment process using
Servequal- Kano-Demerit hybrid approach.  12th International Industrial Engineering conference; Tehran2016.
35.    Kalaei M, Atashgar K, Miri S. Cost reduction of using drug in a process of varicocelectomy surgery focusing on analyzing the effectiveness of antibiotic on infection. Iranian accounting & Management Conference; Tehran2015.
36.    Guinane CS, Sikes JI, Wilson RK. Using the PDSA cycle to standardize a quality assurance program in a quality improvement-driven environment. The Joint Commission journal on quality improvement. 1994 Dec; 20(12): 696-705.
37.    Boggs PB, Hayati F, Washburne WF, Wheeler DA. Using statistical process control charts for the continual improvement of asthma care. The Joint Commission journal on quality improvement. 1999 Apr; 25(4): 163-81.
38.    Ratcliffe MB, Khan JH, Magee KM, McElhinney DB, Hubner C. Collection of process data after cardiac surgery: Initial implementation with a
Java-based intranet applet. The Annals of thoracic surgery. 2000 Jun 30; 69(6): 1817-21.
39.    Sinanan M, Wicks K, Peccoud M, Canfield J, Poser L, Sailer L, Stephens K, Edwards D. Formula for surgical practice resuscitation in an academic medical center. The American journal of surgery. 2000 May 15; 179(5): 417-21.
40.    Alemi F, Neuhauser D. Time-between control charts for monitoring asthma attacks. The Joint Commission Journal on Quality and Patient Safety. 2004 Feb 1; 30(2): 95-102.
41.    Re RN, Krousel-Wood MA. How to use continuous quality improvement theory and statistical quality control tools in a multispecialty clinic. QRB. Quality review bulletin. 1990 Nov; 16(11): 391-7.
42.    Boggs PB, Wheeler D, Washburne WF, Hayati F. Peak expiratory flow rate control chart in asthma care: chart construction and use in asthma care. Annals of Allergy, Asthma & Immunology. 1998 Dec 31; 81(6): 552-62.
43.    Solodky C, Chen H, Jones PK, Katcher W, Neuhauser D. Patients as partners in clinical research: a proposal for applying quality improvement methods to patient care. Medical care. 1998 Aug 1; 36(8): AS13-20.
44.    Vitez TS, Macario A. Setting performance standards for an anesthesia department. Journal of clinical anesthesia. 1998 Mar 31; 10(2): 166-75.
45.    Konrad C, Gerber H, Schupfer G, Jenzer S, Schmucki O. Detection of fluid volume absorption by end-tidal alcohol monitoring in patients undergoing endoscopic renal pelvic surgery. Journal of clinical anesthesia. 1999 Aug 31; 11(5): 386-90.
46.    Alemi F, Oliver DW. Tutorial on risk-adjusted P-charts. Quality Management in Healthcare. 2001 Oct 1; 10(1): 1-9.
47.    Caron A, Neuhauser DV. Health care organization improvement reports using control charts for key quality characteristics: ORYX measures as examples. Quality Management in Healthcare. 2001 Jan 1; 9(3): 28-39.
48.    Carey RG. Improving patient satisfaction: a control chart case study. The Journal of ambulatory care management. 2002 Jul 1; 25(3): 78-83.
49.    Hart MK, Robertson JW, Hart RF, Lee KY. Application of Variables Control Charts to
Risk-adjusted Time-ordered Healthcare Data. Quality Management in Healthcare. 2004 Mar 1; 13(2):
99-119.
50.    McKenzie L. Process management: Two control charts. The Health Care Manager. 1993 Sep 1; 12(1): 70-81.
51.    Oniki TA, Clemmer TP, Arthur LK, Linford LH. Using statistical quality control techniques to monitor blood glucose levels. In Proceedings of the Annual Symposium on Computer Application in Medical Care 1995 (p. 586). American Medical Informatics Association.
52.    Piccirillo JF. The use of patient satisfaction data to assess the impact of continuous quality improvement efforts. Archives of Otolaryngology-Head & Neck Surgery. 1996 Oct 1; 122(10): 1045-8.
53.    Saturno PJ, Felices F, Segura J, Vera A, Rodriguez JJ, ARIAM Group. Reducing time delay in the thrombolysis of myocardial infarction: an internal quality improvement project. Am J Med Qual. 2000 May 1; 15: 85-93.
54.    Staker LV. Changing clinical practice by improving systems: the pursuit of clinical excellence through practice-based measurement for learning and improvement. Quality Management in Healthcare. 2000 Jan 1; 9(1): 1-3.
55.    Marshall T, Mohammed MA, Lim HT. Understanding variation for clinical governance: an illustration using the diagnosis and treatment of sore throat. Br J Gen Pract. 2002 Apr 1; 52(477): 277-83.
56.    Rosow E, Adam J, Coulombe K, Race K, Anderson R. Virtual instrumentation and real-time executive dashboards: Solutions for health care systems. Nursing Administration Quarterly. 2003 Jan 1; 27(1): 58-76.
57.    Atashgar K, Kalaei M, Rasuli O. Managing the variability factors affect on the level of patient satisfactions using Servequal-Demerit approach.  Management Tools and Techniques conference; Tehran 2015.
58.    Atashgar K, Khosravi B. Quality Improvement and Cost Reduction Using Six Sigma Approach: Focused on Taleghani Hospital. Health Inf Manage 2015; 11(7): 850.
59.    Laffe G, Zimmerman S. Using control charts to analyze serial patient-related data. Quality Management in Healthcare. 1994 Oct 1; 3(1): 70-7.
60.    Nelson FE, Hart MK, Hart RF. Application of control chart statistics to blood pressure measurement variability in the primary care setting. Journal of the American Academy of Nurse Practitioners. 1994 Jan 1; 6(1): 17-28.
61.    KhorshidKhani N, Atashgar K. Monitoring Profile of Hypertensive disease.  International Conference on Industrial Engineering & Management; Tehran 2016.
62.    Stewart LJ, Greisler D, Feldman KJ. Measuring primary care practice performance within an integrated delivery system: a case study. Journal of Healthcare Management. 2002 Jul 1; 47(4): 250.
63.    Purba M. Use of a control chart to monitor diarrhoea admissions: a quality improvement exercise in West Kalimantan Provincial Hospital, Pontianak, Indonesia. Journal of quality in clinical practice. 1999 Sep 1; 19(3): 145-7.
64.    Curran ET, Benneyan JC, Hood J. Controlling methicillin-resistant Staphylococcus aureus: a feedback approach using annotated statistical process control charts. Infection Control & Hospital Epidemiology. 2002; 23(01): 13-8.
65.    Marshall T, Mohammed MA. Understanding variation in quality improvement: the treatment of sore throats in primary care. Family practice. 2003 Feb 1; 20(1): 69-73.
66.    Woodall WH, Adams BM, Benneyan JC. The use of control charts in healthcare. Statistical methods in healthcare. 2012 Jul 19: 251-67.
67.    Rogers CA, Reeves BC, Caputo M, Ganesh JS, Bonser RS, Angelini GD. Control chart methods for monitoring cardiac surgical performance and their interpretation. The Journal of Thoracic and Cardiovascular Surgery. 2004 Dec 31; 128(6): 811-9.
68.    Montgomery DC. Statistical quality control. New York: Wiley; 2009.
69.    Atashgar K. Advanced Statistical Quality Control. Iran-Tehran: Training and Research Institute of Defence Industries; 2014.
70.    Page ES. Continuous inspection schemes. Biometrika. 1954 Jun 1; 41(1.2): 100-15.
71.    Woodall WH, Fogel SL, Steiner SH. The monitoring and improvement of surgical-outcome quality. Journal of Quality Technology. 2015 Oct 1; 47(4): 383.
72.    Novick RJ, Fox SA, Stitt LW, Kiaii BB,
Abu-Khudair W, Lee A, Benmusa A, Swinamer SA, Rayman R, Menkis AH, McKenzie FN. Effect of
off-pump coronary artery bypass grafting on
risk-adjusted and cumulative sum failure outcomes after coronary artery surgery. Journal of cardiac surgery. 2002 Nov 1; 17(6): 520-8.
73.    Macé L, Bertrand S, Lucron H, Grollmuss O, Dopff C, Mattéi MF, Bosser G, Le Tacon S, Monin P, Marçon F. [Paediatric cardiac surgery and autoevaluation: risk score, complexity score and graphic analysis]. Archives des maladies du coeur et des vaisseaux. 2005 May; 98(5): 477-84.
74.    Rogers CA, Ganesh JS, Banner NR, Bonser RS. Cumulative risk adjusted monitoring of 30-day mortality after cardiothoracic transplantation: UK experience. European journal of cardio-thoracic surgery. 2005 Jun 1; 27(6): 1022-9.
75.    Sherlaw-Johnson C, Morton A, Robinson MB, Hall A. Real-time monitoring of coronary care mortality: a comparison and combination of two monitoring tools. International journal of cardiology. 2005 Apr 20; 100(2): 301-7.
76.    Robinson IA, Blackham RB, Cozens NJ, Sharp J. Good practice in head and neck fine needle aspiration cytology as assessed by CUSUM. Cytopathology. 2002 Dec 1; 13(6): 335-42.
77.    Sharp JF, Cozens N, Robinson I. Assessment of surgical competence in parotid surgery using a CUSUM assessment tool. Clinical Otolaryngology & Allied Sciences. 2003 Jun 1; 28(3): 248-51.
78.    Hill GB, Spicer CC, Weatherall JA. The computer surveillance of congenital malformations. British Medical Bulletin. 1968 Sep 1; 24(3): 215-8.
79.    Bjerkedal T, Bakketeig LS. Surveillance of congenital malformations and other conditions of the newborn. International Journal of Epidemiology. 1975 Mar 1; 4(1): 31-6.
80.    Weatherall JA, Haskey JC. Surveillance of malformations. British Medical Bulletin. 1976 Jan 1; 32(1): 39-44.
81.    Morton AP, Clements AC, Doidge SR, Stackelroth J, Curtis M, Whitby M. Surveillance of
healthcare-acquired infections in Queensland, Australia: data and lessons from the first 5 years. Infection Control & Hospital Epidemiology. 2008 Aug 1; 29(08): 695-701.
82.    Praus M, Schindel F, Fescharek R, Schwarz S. Alert systems for post-marketing surveillance of adverse drug reactions. Statistics in medicine. 1993 Dec 30; 12(24): 2383-93.
83.    Hutwagner ML, Thompson MW, Seeman GM, Treadwell T. The bioterrorism preparedness and response early aberration reporting system (EARS). Journal of Urban Health. 2003 Mar 1; 80(1): i89-96.
84.    Hutwagner LC, Thompson WW, Seeman GM, Treadwell T. A simulation model for assessing aberration detection methods used in public health surveillance for systems with limited baselines. Statistics in medicine. 2005 Feb 28; 24(4): 543-50.
85.    Hutwagner L, Browne T, Seeman GM, Fleischauer AT. Comparing aberration detection methods with simulated data. Emerg Infect Dis. 2005 Feb 1; 11(2): 314-6.
86.    Bolsin S, Colson M. The use of the Cusum technique in the assessment of trainee competence in new procedures. International Journal for Quality in Health Care. 2000 Oct 1; 12(5): 433-8.
87.    Hawkins DM, Olwell DH. CUSUM design. In Cumulative Sum Charts and Charting for Quality Improvement 1998 (pp. 31-45). Springer New York.
88.    Nizard RS, Porcher R, Ravaud P, Vangaver E, Hannouche D, Bizot P, Sedel L. Use of the Cusum technique for evaluation of a CT-based navigation system for total knee replacement. Clinical orthopaedics and related research. 2004 Aug 1; 425: 180-8.
89.    Adeoti OA. Application of CUSUM control chart for monitoring HIV/AIDS patients in Nigeria. International Journal of Statistics and Applications. 2013; 3(3): 77-80.
90.    Baldewijns G, Luca S, Nagels W, Vanrumste B, Croonenborghs T. Automatic detection of health changes using statistical process control techniques on measured transfer times of elderly. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2015 Aug 25 (pp. 5046-5049). IEEE.
91.    Patel MJ. A study of some control charts in medicine and epidemiology. Rajkot, India: Saurashtra University; 2011.
92.    Lim TO, Soraya A, Ding LM, Morad Z. Assessing doctors’ competence: application of CUSUM technique in monitoring doctors’ performance. International Journal for quality in health care. 2002 Jun 1; 14(3): 251-8.
93.    Biau DJ, Resche-Rigon M, Godiris-Petit G, Nizard RS, Porcher R. Quality control of surgical and interventional procedures: a review of the CUSUM. Quality and Safety in Health Care. 2007 Jun 1; 16(3): 203-7.
94.    Biau DJ, Porcher R, Salomon LJ. CUSUM: a tool for ongoing assessment of performance. Ultrasound in Obstetrics & Gynecology. 2008 Mar 1; 31(3):
252-5.
95.    Steiner SH, Cook RJ, Farewell VT, Treasure T. Monitoring surgical performance using risk-adjusted cumulative sum charts. Biostatistics. 2000 Dec 1; 1(4): 441-52.
96.    Ewan WD, Kemp KW. Sampling inspection of continuous processes with no autocorrelation between successive results. Biometrika. 1960 Dec 1; 47(3.4): 363-80.
97.    Lucas JM. Cumulative sum (CUSUM) control schemes. Communications in Statistics-Theory and Methods. 1985 Jan 1; 14(11): 2689-704.
98.    Chen R. A Survillance System for Congenital Malformations. Journal of the American Statistical Association. 1978 Jun 1; 73(362): 323-7.
99.    Fatahi AA, Noorossana R, Dokouhaki P, Babakhani M. A review on statistical monitoring of rare events and their necessity in healthcare area. Payesh. 2011; 10(4): 429-37.
100. Barbujani G. A review of statistical methods for continuous monitoring of malformation frequencies. European journal of Epidemiology. 1987 Mar 1; 3(1): 67-77.
101. Vardeman S, Ray DO. Average run lengths for CUSUM schemes when observations are exponentially distributed. Technometrics. 1985 May 1; 27(2): 145-50.
102. Bourke PD. Detecting a shift in fraction nonconforming using run-length control charts with 100% inspection. Journal of Quality Technology. 1991; 23(3): 225-38.
103. Wald A. Sequential method of sampling for deciding between two courses of action. Journal of the American Statistical Association. 1945 Sep 1; 40(231): 277-306.
104. Spiegelhalter D, Grigg O, Kinsman R, Treasure TO. Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery. International Journal for Quality in Health Care. 2003 Feb 1; 15(1): 7-13.
105. Williams SM, Parry BR, Schlup MM. Quality control: an application of the cusum. BMJ: British medical journal. 1992 May 23; 304(6838): 1359.
106. Chang WR, McLean IP. CUSUM: A tool for early feedback about performance? BMC medical research methodology. 2006 Mar 2; 6(1): 8.
107. Siddiqui KM, Izawa JI. Systematic methods for measuring outcomes: How they may be used to improve outcomes after Radical cystectomy. Arab journal of urology. 2015 Jun 30; 13(2): 122-7.
108. Matheny JG. Reducing the risk of human extinction. Risk analysis. 2007 Oct 1; 27(5): 1335-44.
109. Poloniecki J, Valencia O, Littlejohns P. Cumulative risk adjusted mortality chart for detecting changes in death rate: observational study of heart surgery. Bmj. 1998 Jun 6; 316(7146): 1697-700.
110. Spiegelhalter D, Grigg O, Kinsman R, Treasure TO. Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery. International Journal for Quality in Health Care. 2003 Feb 1; 15(1): 7-13.
111. Lawrence DR, Valencia O, Smith EE, Murday A, Treasure T. Parsonnet score is a good predictor of the duration of intensive care unit stay following cardiac surgery. Heart. 2000 Apr 1; 83(4): 429-32.
112. Martinez-Alario J, Tuesta ID, Plasencia E, Santana M, Mora ML. Mortality Prediction in Cardiac Surgery Patients Comparative Performance of Parsonnet and General Severity Systems. Circulation. 1999 May 11; 99(18): 2378-82.
113. Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R, Euro SCORE Study Group. European system for cardiac operative risk evaluation (EuroSCORE). European journal of cardio-thoracic surgery. 1999 Jul 1; 16(1): 9-13.
114. Roques F, Michel P, Goldstone AR, Nashef SA. The logistic euroscore. European heart journal. 2003 May 1; 24(9): 882-.
115. Sergeant P, de Worm E, Meyns B, Wouters P. The challenge of departmental quality control in the reengineering towards off-pump coronary artery bypass grafting. European journal of cardio-thoracic surgery. 2001 Sep 1; 20(3): 538-43.
116. De Leval MR, François K, Bull C, Brawn W, Spiegelhalter D. Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations. The Journal of Thoracic and Cardiovascular Surgery. 1994 Mar; 107(3): 914-23.
117. Caputo M, Reeves BC, Rogers CA, Ascione R, Angelini GD. Monitoring the performance of residents during training in off-pump coronary surgery. The Journal of thoracic and cardiovascular surgery. 2004 Dec 31; 128(6): 907-15.
118. Tekkis PP, McCulloch P, Steger AC, Benjamin IS, Poloniecki JD. Mortality control charts for comparing performance of surgical units: validation study using hospital mortality data. Bmj. 2003 Apr 12; 326(7393): 786.
119. Sasikumar R, Devi SB. Cumulative Sum Charts and Its Healthcare Applications; A Systematic Review. Sri Lankan Journal of Applied Statistics. 2014 Apr 5; 15(1).
120. Steiner SH. Risk-adjusted monitoring of outcomes in health care. Statistics in Action: A Canadian Outlook. 2014 Mar 3: 225-41.
121. Axelrod DA, Guidinger MK, Metzger RA, Wiesner RH, Webb RL, Merion RM. Transplant Center Quality Assessment Using a Continuously Updatable, Risk-Adjusted Technique (CUSUM). American Journal of Transplantation. 2006 Feb 1; 6(2): 313-23.
122. Axelrod DA, Kalbfleisch JD, Sun RJ, Guidinger MK, Biswas P, Levine GN, Arrington CJ, Merion RM. Innovations in the assessment of transplant center performance: implications for quality improvement. American Journal of Transplantation. 2009 Apr 1; 9(4p2): 959-69.
123. Beiles CB, Morton AP. Cumulative sum control charts for assessing performance in arterial surgery. ANZ journal of surgery. 2004 Mar 1; 74(3): 146-51.
124. Collins GS, Jibawi A, McCulloch P. Control chart methods for monitoring surgical performance: a case study from gastro-oesophageal surgery. European Journal of Surgical Oncology (EJSO). 2011 Jun 30; 37(6): 473-80.
125. Novick RJ, Fox SA, Stitt LW, Forbes TL, Steiner S. Direct comparison of risk-adjusted and
non–risk-adjusted CUSUM analyses of coronary artery bypass surgery outcomes. The Journal of thoracic and cardiovascular surgery. 2006 Aug 31; 132(2): 386-91.
126. Harris JR, Forbes TL, Steiner SH, Lawlor DK, DeRose G, Harris KA. Risk-adjusted analysis of early mortality after ruptured abdominal aortic aneurysm repair. Journal of vascular surgery. 2005 Sep 30; 42(3): 387-e1.
127. Moore R, Nutley M, Cina CS, Motamedi M, Faris P, Abuznadah W. Improved survival after introduction of an emergency endovascular therapy protocol for ruptured abdominal aortic aneurysms. Journal of vascular surgery. 2007 Mar 31; 45(3):
443-50.
128. Chen TT, Chung KP, Hu FC, Fan CM, Yang MC. The use of statistical process control (risk-adjusted CUSUM, risk-adjusted RSPRT and CRAM with prediction limits) for monitoring the outcomes of
out-of-hospital cardiac arrest patients rescued by the EMS system. Journal of evaluation in clinical practice. 2011 Feb 1; 17(1): 71-7.
129. Twijnstra AR, Blikkendaal MD, Driessen SR, van Zwet EW, de Kroon CD, Jansen FW. Tailor-made proficiency curves in laparoscopic hysterectomy: enhancing patient safety using CUSUM analysis. Gynecological Surgery. 2014 Nov 1; 11(4): 235-40.
130. Lovegrove J, Valencia O, Treasure T, Sherlaw-Johnson C, Gallivan S. Monitoring the results of cardiac surgery by variable life-adjusted display. The Lancet. 1997 Oct 18; 350(9085): 1128-30.
131. Hart GK, Mullany D, Cook DA, Pilcher D, Duke G. Review of the application of risk-adjusted charts to analyse mortality outcomes in critical care. Critical Care and Resuscitation. 2008 Sep; 10(3): 239.
132. Collett D, Sibanda N, Pioli S, Bradley JA, Rudge C. The UK scheme for mandatory continuous monitoring of early transplant outcome in all kidney transplant centers. Transplantation. 2009 Oct 27; 88(8): 970-5.
133. Sherlaw-Johnson C. A method for detecting runs of good and bad clinical outcomes on variable
life-adjusted display (VLAD) charts. Health care management science. 2005 Feb 1; 8(1): 61-5.
134. Sherlaw-Johnson C, Wilson AP, Keogh B, Gallivan S. Monitoring the occurrence of wound infections after cardiac surgery. Journal of Hospital Infection. 2007 Apr 30; 65(4): 307-13.
135. Grunkemeier GL, Wu YX, Furnary AP. Cumulative sum techniques for assessing surgical results. The Annals of thoracic surgery. 2003 Sep 30; 76(3): 663-7.
136. Grunkemeier GL, Jin R, Wu Y. Cumulative sum curves and their prediction limits. The Annals of thoracic surgery. 2009 Feb 1; 87(2): 361-4.
137. Noyez L. Control charts, Cusum techniques and funnel plots. A review of methods for monitoring performance in healthcare. Interactive cardiovascular and thoracic surgery. 2009 Sep 1; 9(3): 494-9.
138. Kestin IG. A statistical approach to measuring the competence of anaesthetic trainees at practical procedures. British Journal of Anaesthesia. 1995 Dec 1; 75(6): 805-9.
139. Naik VN, Devito I, Halpern SH. Cusum analysis is a useful tool to assess resident proficiency at insertion of labour epidurals. Canadian journal of anaesthesia. 2003 Aug 1; 50(7): 694-8.
140. Parry BR, Williams SM. Competency and the Colonoscopist A Learning Curve. Australian and New Zealand Journal of Surgery. 1991 Jun 1; 61(6): 419-22.
141. Van Rij AM, McDonald JR, Pettigrew RA, Putterill MJ, Reddy CK, Wright JJ. Cusum as an aid to early assessment of the surgical trainee. British journal of surgery. 1995 Nov 1; 82(11): 1500-3.
142. Young A, Miller JP, Azarow K. Establishing learning curves for surgical residents using Cumulative Summation (CUSUM) Analysis. Current surgery. 2005 Jun 30; 62(3): 330-4.
143. Tekkis PP, Senagore AJ, Delaney CP, Fazio VW. Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and
left-sided resections. Annals of surgery. 2005 Jul 1; 242(1): 83-91.
144. Song MH, Tajima K, Watanabe T, Ito T. Learning curve of coronary surgery by a cardiac surgeon in Japan with the use of cumulative sum analysis. The Japanese Journal of Thoracic and Cardiovascular Surgery. 2005 Oct 1; 53(10): 551-6.
145. Forbes TL, De Rose G, Harris KA. A CUSUM analysis of ruptured abdominal aortic aneurysm repair. Annals of vascular surgery. 2002 Oct 1; 16(5): 527-33.
146. Novick RJ, Fox SA, Stitt LW, Kiaii BB, Swinamer SA, Rayman R, Wenske TR, Boyd WD. Assessing the learning curve in off-pump coronary artery surgery via CUSUM failure analysis. The Annals of thoracic surgery. 2002 Jan 1; 73(1): S358-62.
147. Naik VN, Devito I, Halpern SH. Cusum analysis is a useful tool to assess resident proficiency at insertion of labour epidurals. Canadian journal of anaesthesia. 2003 Aug 1; 50(7): 694-8.
148. Novick RJ, Fox SA, Kiaii BB, Stitt LW, Rayman R, Kodera K, Menkis AH, Boyd WD. Analysis of the learning curve in telerobotic, beating heart coronary artery bypass grafting: a 90 patient experience. The Annals of thoracic surgery. 2003 Sep 30; 76(3):
749-53.
149. Kestin IG. A statistical approach to measuring the competence of anaesthetic trainees at practical procedures. British Journal of Anesthesia. 1995 Dec 1; 75(6): 805-9.
150. Calsina L, Clará A, Vidal-Barraquer F. The use of the CUSUM chart method for surveillance of learning effects and quality of care in endovascular procedures. European Journal of Vascular and Endovascular Surgery. 2011 May 31; 41(5): 679-84.
151. Duclos A, Carty MJ, Peix JL, Colin C, Lipsitz SR, Kraimps JL, Menegaux F, Pattou F, Sebag F, Voirin N, Touzet S. Development of a charting method to monitor the individual performance of surgeons at the beginning of their career. PloS one. 2012 Jul 31; 7(7): e41944.