Does delivery volume of family physicians predict maternal and newborn outcome? =============================================================================== * Michael C. Klein * Andrea Spence * Janusz Kaczorowski * Ann Kelly * Stefan Grzybowski ## Abstract **Background:** The number of births attended by individual family physicians who practice intrapartum care varies. We wanted to determine if the practice–volume relations that have been shown in other fields of medical practice also exist in maternity care practice by family doctors. **Methods:** For the period April 1997 to August 1998, we analyzed all singleton births at a major maternity teaching hospital for which the family physician was the responsible physician. Physicians were grouped into 3 categories on the basis of the number of births they attended each year: fewer than 12, 12 to 24, and 25 or more. Physicians with a low volume of deliveries (72 physicians, 549 births), those with a medium volume of deliveries (34 physicians, 871 births) and those with a high volume of deliveries (46 physicians, 3024 births) were compared in terms of maternal and newborn outcomes. The main outcome measures were maternal morbidity, 5-minute Apgar score and admission of the baby to the neonatal intensive care unit or special care unit. Secondary outcomes were obstetric procedures and consultation patterns. **Results:** There was no difference among the 3 volume cohorts in terms of rates of maternal complications of delivery, 5-minute Apgar scores of less than 7 or admissions to the neonatal intensive care unit or the special care unit, either before or after adjustment for parity, pregnancy-induced hypertension, diabetes, ethnicity, lone parent status, maternal age, gestational age, newborn birth weight and newborn head circumference at birth. High- and medium-volume family physicians consulted with obstetricians less often than low-volume family physicians (adjusted odds ratio [OR] 0.586 [95% confidence interval, CI, 0.479–0.718] and 0.739 [95% CI 0.583–0.935] respectively). High- and medium-volume family physicians transferred the delivery to an obstetrician less often than low-volume family physicians (adjusted OR 0.668 [95% CI 0.542–0.823] and 0.776 [95% CI 0.607–0.992] respectively). Inductions were performed by medium-volume family physicians more often than by low-volume family physicians (adjusted OR 1.437 [95% CI 1.036–1.992]. **Interpretation:** Family physicians' delivery volumes were not associated with adverse outcomes for mothers or newborns. Low-volume family physicians referred patients and transferred deliveries to obstetricians more frequently than high- or medium-volume family physicians. Further research is needed to validate these findings in smaller facilities, both urban and rural. More than 20 years ago, Luft and associates1 conducted one of the earliest volume–outcome studies. Since then, many studies addressing the relation between volume of procedures and patient outcomes have been published.2,3 In some of these studies, either the hospital size or the physician procedural volume was used as a surrogate for physician expertise. Among studies analyzing hospital volumes and outcomes, better outcomes have been associated with higher patient volumes in some instances4,5,6,7 but not others.3,8,9 Some studies of individual provider volume have shown a positive relation between volume and outcomes,10,11 whereas others have shown no relation or inconsistent results.3,12 Finally, a few studies analyzing both hospital volume and provider volume have reported a positive volume–outcome relation.13,14 Criticism levelled at the methods used in volume–outcome studies have addressed the lack of adjustment for case mix, different cutoff points for volume categories and retrospective design.3 Other factors that have an effect on patient outcomes but that have not been included in previous volume analyses include health maintenance organization status, physician certification and years since graduation, and patient socioeconomic status, age and ethnicity. Furthermore, most of the studies on volume have covered surgical or oncology specialities. The few studies that have been done on volume and outcome in maternity care have shown variable effects. Rural health care is often associated with lower volumes of obstetric procedures. However, no differences in maternal or newborn outcomes have been shown in some comparisons of births in urban and rural locations.15,16,17,18 Other studies have shown poorer maternal and newborn outcomes in low-volume hospitals, neonatal intensive care units (NICUs) and rural locations.19,20,21,22 Conversely, higher volume (hospitals with more than 1000 deliveries per year) has been associated with more maternal lacerations or complications.23 When the health care provider has been the unit of analysis, a relation between volume and maternal or newborn outcome has been demonstrated in at least one study24 but not in others.25,26 Low volume has been defined as 20 to 24 deliveries per year.24,26 Hass and colleagues24 reported an adjusted odds ratio (OR) of 1.4 for low birth weight for infants delivered by low-volume non-board-certified physicians relative to high-volume non-board-certified physicians; the adjusted OR was 1.56 for low-volume board-certified physicians relative to high-volume board-certified physicians (98.7% of whom were obstetricians). Possible explanations for the differences among studies include differences in health care delivery systems, insurance coverage, experience and training of providers, maternal risk factors, triage or transfer of high-risk cases, choice of outcome measures, and changes over time in access to care, quality assurance and standard of living. Relations have been reported between maternal or newborn outcomes and smoking, maternal history of low birth weight (for previous pregnancies), pregnancy–induced hypertension, diabetes, prepregnancy weight, gestational weight gain, maternal height and age, multiple gestation, previous vaginal birth after cesarean section, history of previous delivery problems, parity, large-for-date fetus, ethnicity and fetal sex.25,27,28,29 Few studies of the relation between volume of births and obstetric outcome have been able to control for these potentially confounding variables and adjust for maternal risk factors. Our database of detailed accounts of births in one hospital setting allowed us to examine this issue more rigorously. We posed 2 research questions: Is there a relation between the volume of deliveries attended by individual family physicians and maternal and newborn outcomes? If there are differences in outcomes, are they related to different physician practice styles and consultation patterns? ## Methods We studied all births, excluding multiple gestations, at BC Women's Hospital and Health Centre from April 1997 to August 1998. The final sample consisted of 152 family physicians who attended a total of 4444 singleton births, which represented slightly fewer than half of the births at the institution during the study period. The remaining births, coded as “obstetrician responsible,” were excluded from our analysis. We classified physicians into 3 categories of delivery volume on the basis of births attended per year: low (fewer than 12), medium (12 to 24) and high (25 or more). These categories are equivalent to those employed by the Society of Obstetricians and Gynaecologists of Canada (SOGC).30 These volume categories corresponded to fewer than 18, 19 to 36, or 37 or more births for the 18-month study period. Data on all births at our hospital are routinely collected from charts and entered into a database used for research and quality assurance purposes. The information recorded relates to the mother, the newborn, the delivery and the physician attending the birth. All data are measured, collected and reported by nursing or medical staff and are routinely abstracted from charts by trained medical records abstractors on the basis of guidelines developed by the Canadian Institute for Health Information (CIHI) and adapted by the facility.31 According to standard CIHI criteria, a birth is attributed to a family physician if he or she was considered the caregiver “most responsible” for the care of a particular patient, even if the care was shared with an obstetrician or the delivery was managed or performed by an obstetrician.31 This method attributes responsibility to the family physician when he or she is the admitting physician. The designation of an obstetric consult is based on a written consultation, progress notes, or a delivery or operative report in the patient's chart. Our methods are intended to ensure that consultants are not held responsible for outcomes when they assist family physicians. Race or ethnicity is coded according to 12 categories, which we collapsed into white and other (including Asian, Hispanic and Middle Eastern). The data on ethnicity are abstracted through 3 different sources: a structured nursing form, a structured antenatal form and physician progress notes. Entries are made by the designated professional. The main outcome measures were maternal complications, 5-minute Apgar score less than 7, and admission to a NICU or special care unit. Maternal complications were grouped into a complex maternal morbidity index created specifically for this study, which reflected the presence of at least one of the following conditions: postpartum urinary tract infection, postpartum hemorrhage, intrapartum or postpartum pyrexia, complications of cesarean section (such as infection, hematoma or hemorrhage) or severe (greater than second-degree) perineal trauma. Because some of these outcomes are rare, we grouped all maternal complications into one measure. This index is based on presence or absence. Secondary outcomes were obstetric procedures and consultation patterns: continuous electronic fetal monitoring, induction, oxytocin augmentation, epidural analgesia, episiotomy, instrumentation, cesarean section, obstetric consultation and delivery performed by the family physician or obstetrician. The potential confounders available in the database and used in the multivariate analyses were parity, pregnancy-induced hypertension, gestational diabetes (type 1 or 2), ethnicity (white or other), lone parent status, maternal age, gestational age, birth weight and head circumference at birth. We employed both univariate and multivariate analyses. In the univariate analysis, categorical variables were compared by means of the 𝛘2 test. Multiple logistic regression was used to estimate the adjusted effect of family physicians' delivery volume on maternal and newborn outcomes, as well as their use of selected procedures and consultation patterns. The continuous variables (maternal age, gestational age, birth weight and head circumference at birth) were categorized, and indicator variables were used. An indicator variable was also used to represent the 3 delivery volume cohorts. The variable for physicians' delivery volume was retained in all models, regardless of significance. All potential confounding factors were entered by means of forward selection stepwise logistic regression analysis and the likelihood ratio test, with a threshold for selection of *p* < 0.05. ORs and 95% confidence intervals (CIs) were calculated by logistic regression analysis. The probability of a type I error (α) was chosen to be 0.05 (2-tailed). Our study received ethical approval from the University of British Columbia. ## Results A total of 4444 births were attended by 152 family physicians during the study period (Table 1). The 72 family physicians with a low volume of deliveries attended a total of 549 births, the 34 medium-volume family physicians attended 871 births, and the 46 high-volume family physicians attended 3024 births. There were few demographic or risk differences between the women attended by the 3 family physician cohorts. Statistically significant differences included percentage of white women (43.7%, 54.5% and 40.2% respectively, *p* < 0.001), percentage of women who were lone parents (8.6%, 10.6% and 6.3% respectively, *p* < 0.001) and percentage of newborns with head circumference greater than 35 cm (47.2%, 49.7% and 54.4% respectively, *p* = 0.047). View this table: [Table1](http://www.cmaj.ca/content/166/10/1257/T1) Table 1. In the univariate analysis there were no statistically significant differences among the volume cohorts in the percentage of women with complex maternal morbidity, in percentage of infants with 5-minute Apgar score less than 7 or in rates of admission to the NICU or the special care unit (Table 2). Because of the possible differences in case mix and the distribution of risk factors across the 3 volume cohorts, the analyses were adjusted for variables potentially associated with the outcomes of interest. The multivariate logistic regression analyses adjusted for statistically significant confounders confirmed that there were no statistically significant differences in maternal and newborn outcomes on the basis of physicians' delivery volume (Table 3). View this table: [Table2](http://www.cmaj.ca/content/166/10/1257/T2) Table 3. View this table: [Table3](http://www.cmaj.ca/content/166/10/1257/T3) Table 2. Because of the possible association between procedures and maternal and newborn outcomes, we also analyzed the use of procedures and consultation patterns. In the univariate analyses, the only significant differences between the low-, medium- and high-volume cohorts were for induction of labour (14.4%, 19.3% and 15.1% respectively, *p* = 0.008), obstetric consultation (53.0%, 48.1% and 43.2% respectively, *p* < 0.001), and deliveries by an obstetrician (34.6%, 31.0% and 28.6% respectively, *p* = 0.013) (Table 4). View this table: [Table4](http://www.cmaj.ca/content/166/10/1257/T4) Table 4. The multivariate logistic regression analyses, adjusted for maternal and newborn risk and demographic factors, showed that high- and medium-volume family physicians consulted with obstetricians less often than low-volume family physicians (adjusted OR 0.586 [95% CI 0.479–0.718] and 0.739 [95% CI 0.583–0.935] respectively) (Table 5). High- and medium-volume family physicians also transferred the delivery to an obstetrician less often than low-volume family physicians (adjusted OR 0.668 [95% CI 0.542–0.823] and 0.776 [95% CI 0.607–0.992] respectively). Births were induced more often for patients of medium-volume family physicians (19.3%) than for patients of low-volume family physicians (14.4%) (adjusted OR 1.437 [95% CI 1.036–1.992]). Patients of medium-volume family physicians were significantly less likely to undergo episiotomy (17.2%) than patients of low-volume family physicians (22.7%) (adjusted OR 0.662 [95% CI 0.482–0.911]). View this table: [Table5](http://www.cmaj.ca/content/166/10/1257/T5) Table 5. ## Interpretation The number of births that a family physician attends was not associated with rates of adverse outcomes in this large urban teaching hospital. This lack of a relation between delivery volume and maternal and newborn outcomes concurs with the findings of LeFevre25 and Tilyard and collaborators26 but not those of Hass and associates.24 Hass and associates24 used birth weight as the outcome variable, but we did not find any significant difference in birth weight among the volume cohorts in this study. Low-volume family physicians consulted with obstetricians and transferred deliveries to obstetricians more often than their higher-volume colleagues, a finding similar to that reported by Tilyard and collaborators.26 The tendency for patients of medium-volume family physicians to undergo slightly more inductions and slightly fewer episiotomies was unexpected and difficult to interpret. It is most likely a statistical difference of little clinical importance. None of the literature reviewed reported differences in practice patterns between low- and medium-volume physicians. Rates of continuous electronic fetal monitoring, induction, use of epidural analgesia, performance of cesarean section and obstetric consultation were higher in this population than in similar populations, but rates of oxytocin augmentation and episiotomy use were lower.32,33,35 It is unlikely that patient risk factors were responsible for the higher procedure rates, since the risk factors in our population were similar to those reported in other studies. It is possible that the higher rate of procedure use was a result of more frequent obstetric consultation (45.4% of the mothers in this study were referred for such consultation).36 Most family physicians practising obstetrics in British Columbia have a low volume of deliveries (mean 31.6 per year), although the self-reported national average is 40.37 The average for our study population was 29 births in 18 months or 19.3 births/year. Of the 152 physicians in our sample, 72 (47.4%) had a low volume of deliveries. The SOGC has until recently recommended that “physicians with low volumes of obstetrical patients should restrict their practice to ‘normal’ obstetrics and should update their skills every 2 to 3 years.”30 Two provincial medical regulatory bodies have already recommended application of this guideline. If this policy were to be enforced, it might result in many low-volume family physicians abandoning maternity care, which would in turn limit access to maternity care. We have shown that low-volume family physicians can achieve maternal and newborn outcomes comparable to those of high-volume physicians, if, they are able to consult with obstetricians when needed. Thus the SOGC and provincial guidelines may have to be revised. There are a number of possible reasons why the outcomes in this study did not vary with physician volume, for example, the existence of maternity care policies and procedures, the higher obstetric consultation rate by low-volume physicians and a lower-risk study population. Ethnicity might also have been a factor. It has been reported that perinatal outcomes among Chinese women and infants are better than those of white women and newborns.27,28 Of the women in this study, 60% were non-white, whereas 31% of women in the Vancouver area belong to visible minorities.38 Because of the inconsistent coding of ethnicity, we are unable to correctly estimate the percentage of the study group that was Chinese. It is therefore possible that the patients were generally “healthier” than might be expected. Apart from ethnicity, the risk factors in this study population were similar to or higher than those reported elsewhere.32,33,34 We cannot say if access to the resources of a tertiary care facility, including obstetricians and pediatricians, was a factor enabling low-volume family physicians to achieve similar outcomes to their higher-volume counterparts. The results of this study may not be generalizable to smaller centres, where obstetric and pediatric consults are not as readily available. We did not include the number of years in practice as a variable, but this characteristic might affect maternal and newborn outcomes. Further work in other institutions, with similar data collection methods and adjustment for case mix, risk, hospital size, and urban or rural location as well as number of years of experience of the physician, is needed to validate these findings. This is the next phase of our investigations. In conclusion, the number of births that a family physician attends does not appear to be a factor in birth outcomes, at least in a large urban teaching hospital with appropriate resources and expertise. In this setting, low-volume physicians tended to consult with obstetricians more frequently. The conventional wisdom relating to volume and outcome is based primarily on surgical practices and should not be applied to other types of medical practice. ## Postscript In light of this and other evidence, the SOGC, the College of Family Physicians of Canada and the Society of Rural Physicians of Canada have come together to affirm that competence in obstetric care does not depend on the number of births attended annually. This position replaces SOGC policy statement 24 on the recommended number of deliveries to maintain competence.30 ## Footnotes * *This article has been peer reviewed.* *Contributors:* Michael C. Klein is the senior author and was the principal investigator for the study. He initiated the work and maintained overall responsibility for the integrity of the research and the writing. Andrea Spence was the research assistant on the project. She did some of the data manipulation and constructed some of the presentations for the initial version of the paper. She remained involved in the writing of the paper and verification of the data. Janusz Kaczorowski was the principal statistical and epidemiological resource for the study. He conducted most of the analyses and wrote the Methods section. Ann Kelly conducted some of the analyses and participated in the rewriting and editing of the manuscript. Stefan Grzybowski was part of the research group and was involved in editing the manuscript. *Acknowledgements:* We thank Dr. Stu Iglesias for reviewing an earlier version of this paper, Janet Alred for secretarial support; Corrine Nishi, HRA, Information Analysis Department, Children's and Women's Health Centre of British Columbia, for data management services; members of the Department of Family Practice of the Children's and Women's Health Centre of British Columbia for their support and commitment to improving care for their patients; and the British Columbia Research Institute for Children's and Women's Health for partial financial support of this and related projects. *Competing interests:* None declared. ## References 1. 1. Luft HS, Bunker JP, Enthoven AC. Should operations be regionalized? The empirical relation between surgical volume and mortality. N Engl J Med 1979;301:1364-9. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1056/NEJM197912203012503&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=503167&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1979HX81100003&link_type=ISI) 2. 2. Hillner, BE, Smith TJ, Desch CE. Hospital and physician volume or specialization and outcomes in cancer treatment: importance in quality of cancer care. J Clin Oncol 2000;18(11):2327-40. [Abstract/FREE Full Text](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiamNvIjtzOjU6InJlc2lkIjtzOjEwOiIxOC8xMS8yMzI3IjtzOjQ6ImF0b20iO3M6MjI6Ii9jbWFqLzE2Ni8xMC8xMjU3LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 3. 3. Shackley P, Slack R, Booth A, Michaels J. Is there a positive volume–outcome relationship in peripheral vascular surgery? Results of a systematic review. Eur J Vasc Endovasc Surg 2000;20(4):326-35. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S1078-5884(00)91188-2&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=11035964&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000165058700002&link_type=ISI) 4. 4. Nathans AB, Jurkovich GJ, Maier RV, Grossman DC, Mackenzie EF, Moore M, et al. Relationship between trauma center volume and outcomes. JAMA 2001;285(9):1164-71. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1001/jama.285.9.1164&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=11231745&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000167194700019&link_type=ISI) 5. 5. Theimann DR, Coresh J, Oetgen WJ, Powe NR. The association between hospital volume and survival after acute myocardial infarction in elderly patients. N Engl J Med 1999;340(21):1640-8. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1056/NEJM199905273402106&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=10341277&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000080494200006&link_type=ISI) 6. 6. Begg CG, Cramer LD, Hoskins WJ, Brennan MF. Impact of hospital volume on operative mortality for major cancer surgery. JAMA 1998;280(20):1747-51. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1001/jama.280.20.1747&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=9842949&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000077081400029&link_type=ISI) 7. 7. Schrag D, Cramer LD, Bach PB, Cohen AM, Warren JL, Begg CB. Influence of hospital procedure volume on outcomes following surgery for colon cancer. JAMA 2000;284(23):3028-35. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1001/jama.284.23.3028&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=11122590&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000165847200028&link_type=ISI) 8. 8. Simunovic M, To T, Baxter N, Balshem A, Ross E, Cohen Z, et al. Hospital procedure volume and teaching status do not influence treatment and outcome measures of rectal cancer surgery in a large general population. J Gastrointest Surg 2000;4(3):324-30. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S1091-255X(00)80083-9&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=10769097&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000087138800020&link_type=ISI) 9. 9. Maynard C, Every NR, Chapko MK, Ritchie JL. Outcome of coronary angioplasty procedures performed in rural hospitals. Am J Med 2000;108 (9): 710-3. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S0002-9343(00)00388-0&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=10924647&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000088450400003&link_type=ISI) 10. 10. Tu JV, Austin PC, Chan BT. Relationship between annual volume of patients treated by admitting physicians and mortality after acute myocardial infarction JAMA 2001;285(24):3116-22. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1001/jama.285.24.3116&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=11427140&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000169388900025&link_type=ISI) 11. 11. Kreder HJ, Deyo RA, Koespell T, Swiontkowski MF, Kreuter W. Relationship between the volume of total hip replacements performed by providers and rate of postoperative complications in the state of Washington. J Bone Joint Surg Am 1997;79(4):485-94. [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=9111392&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) 12. 12. Hodgson DC, Fuchs CS, Ayanian JZ. Impact of patient and provider characteristics on the treatment outcomes of colorectal cancer. J Natl Cancer Inst 2001; 93(7):501-15. [Abstract/FREE Full Text](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiam5jaSI7czo1OiJyZXNpZCI7czo4OiI5My83LzUwMSI7czo0OiJhdG9tIjtzOjIyOiIvY21hai8xNjYvMTAvMTI1Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 13. 13. McGrath PD, Wennberg DE, Dickens JD Jr, Siewers AE, Lucas FL, Alenka DJ, et al. Relationship between operator and hospital volume and outcomes following percutaneous coronary intervention in the era of the coronary stent. JAMA 2000;284(24):3139-44. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1001/jama.284.24.3139&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=11135777&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000165994100031&link_type=ISI) 14. 14. Gordon TA, Bowman HM, Bass EB, Lillemoe KD, Yeo CJ, Heitmiller RF, et al. Complex gastrointestinal surgery: impact of provider experience on clinical and economic outcomes. J Am Coll Surg 1999;189(1):46-56. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S1072-7515(99)00072-1&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=10401740&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000081230900008&link_type=ISI) 15. 15. Black DP, Fyfe IM. The safety of obstetric services in small communities in northern Ontario. CMAJ 1984;130:571-6. [Abstract](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czo5OiIxMzAvNS81NzEiO3M6NDoiYXRvbSI7czoyMjoiL2NtYWovMTY2LzEwLzEyNTcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 16. 16. Rosenblatt RA, Reinken J, Shoemack P. Is obstetrics safe in small hospitals? Lancet 1985;2(8452):429-32. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S0140-6736(85)92747-3&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=2863454&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1985APH3400014&link_type=ISI) 17. 17. Viisainen K, Gissler M, Hemminki E. Birth outcomes by level of obstetric care in Finland: a catchment area based analysis. J Epidemiol Community Health 1994;48(4):400-5. [Abstract/FREE Full Text](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiamVjaCI7czo1OiJyZXNpZCI7czo4OiI0OC80LzQwMCI7czo0OiJhdG9tIjtzOjIyOiIvY21hai8xNjYvMTAvMTI1Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 18. 18. LeFevre M, Sanner L, Anderson S, Tsutakawa R. The relationship between neonatal mortality and hospital level. J Fam Pract 1992;35(3):259-64. [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=1517721&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1992JM59400014&link_type=ISI) 19. 19. Larson EH, Hart G, Rosenblatt RA. Is metropolitan residence a risk factor for poor birth outcome in the US? Soc Sci Med 1997;45(2):171-88. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S0277-9536(96)00332-2&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=9225406&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1997XE61000001&link_type=ISI) 20. 20. Phipps CS, Bronstein JM, Buxton E, Phibbs RH. The effects of patient volume and level of care at the hospital of birth on neonatal mortality. JAMA 1996; 276(13):1054-9. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1001/jama.1996.03540130052029&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=8847767&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1996VK03500026&link_type=ISI) 21. 21. Heaphy PE, Bernard SL. Maternal complications of normal deliveries: variation among rural hospitals. J Rural Health 2000;16(2):139-47. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1111/j.1748-0361.2000.tb00447.x&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=10981365&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000088711200007&link_type=ISI) 22. 22. Moster D, Terje Lie R, Markestad T. Neonatal mortality rates in communities with small maternity units compared with those having larger maternity units. *BJOG* 200l;108:904-9. 23. 23. Garcia FAR, Miller HB, Huggins GR, Goedon TA. Effect of academic affiliation and obstetric volume on clinical outcomes and cost of childbirth. Obstet Gynecol 2001;97(4):567-76. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1016/S0029-7844(00)01219-9&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=11275029&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=000167810800016&link_type=ISI) 24. 24. Hass JS, Orav EJ, Goldman L. The relationship between physicians' qualifications and experience and the adequacy of prenatal care and low birth weight. Am J Public Health 1995;85:1087-91. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access\_num=10.2105/AJPH.85.8_Pt_1.1087&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=7625501&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1995RN32000013&link_type=ISI) 25. 25. LeFevre ML. Physician volume and obstetric outcome. Med Care 1992; 30 (9): 866-71. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1097/00005650-199209000-00010&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=1518318&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1992JN02900010&link_type=ISI) 26. 26. Tilyard MW, Williams S, Seddon RJ, Oakley ME, Murdoch CJ. Is outcome for general practitioner obstetricians influenced by workload and locality? N Z Med J 1988;101:207-9. [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=3362469&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) 27. 27. Wen SW, Kramer MS. A comparison of perinatal mortality between ethnic Chinese and ethnic whites: why the Chinese rate was lower. Ethn Health 1997; 2 (3):177-82. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1080/13557858.1997.9961826&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=9426982&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) 28. 28. Wen SW, Kramer MS. A comparison of birth weight distributions between ethnic Chinese and ethnic whites. Am J Epidemiol 1995;141(12):1177-87. [Abstract/FREE Full Text](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYW1qZXBpZCI7czo1OiJyZXNpZCI7czoxMToiMTQxLzEyLzExNzciO3M6NDoiYXRvbSI7czoyMjoiL2NtYWovMTY2LzEwLzEyNTcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 29. 29. Novicoff W, Wagner D, Knaus W, Kane E, Cecere F, Draper E, et al. Initial development of system wide maternal–fetal outcomes assessment program. Am J Obstet Gynecol 2000;183(2):291-300. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.1067/mob.2000.108087&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=10942461&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) 30. 30. SOGC clinical practice guidelines for obstetrics. Policy statement no. 24: Number of deliveries to maintain competence. Ottawa: Society of Obstetrics and Gynaecology of Canada; 1996 Nov. 31. 31. Appendix B-2: Assignment of physician and physician provider type at Children's and Women's. In: *Abstracting guidelines*. Vancouver: Children's & Women's Health Centre of British Columbia; [no date]. 32. 32. Rosenblatt RA, Dobie SA, Hart LG, Schneeweiss R, Gould D, Raine TR, et al. Interspecialty difference in the obstetric care of low-risk women. Am J Public Health 1997;87(3):344-51. [CrossRef](http://www.cmaj.ca/lookup/external-ref?access_num=10.2105/AJPH.87.3.344&link_type=DOI) [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=9096532&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) [Web of Science](http://www.cmaj.ca/lookup/external-ref?access_num=A1997WR01700006&link_type=ISI) 33. 33. Reid AJ, Carroll JC, Ruderman J, Murray MA. Consultation in family practice obstetrics. Can Fam Physician 1995;41:591-8. [PubMed](http://www.cmaj.ca/lookup/external-ref?access_num=7787489&link_type=MED&atom=%2Fcmaj%2F166%2F10%2F1257.atom) 34. 34. Reid AJ, Carroll JC, Ruderman J, Murray MA. Differences in intrapartum obstetric care provided to women at low risk by family physicians and obstetricians. CMAJ 1989;140:625-33. [Abstract](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czo5OiIxNDAvNi82MjUiO3M6NDoiYXRvbSI7czoyMjoiL2NtYWovMTY2LzEwLzEyNTcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 35. 35. Ruderman J, Carroll JC, Reid AJ, Murray MA. Are physicians changing the way they practise obstetrics? CMAJ 1993;148(3):409-15. [Abstract](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czo5OiIxNDgvMy80MDkiO3M6NDoiYXRvbSI7czoyMjoiL2NtYWovMTY2LzEwLzEyNTcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 36. 36. Deutchman ME, Sills D, Connor PD. Perinatal outcomes: a comparison between family physicians and obstetricians. J Am Board Fam Pract 1995;8(6):440-7. [Abstract/FREE Full Text](http://www.cmaj.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6NzoiOC82LzQ0MCI7czo0OiJhdG9tIjtzOjIyOiIvY21hai8xNjYvMTAvMTI1Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 37. 37. Obstetrical care. In: *CFPC National Family Physician Survey summary report*. Toronto: College of Family Physicians of Canada; 1998 Oct. Available: www .cfpc .ca/research/janus/janussum4.asp#types (accessed 2002 Mar 8). 38. 38. Visible minority population, 1996 census, census metropolitan areas. In: *Canadian statistics*. Ottawa: Statistics Canada; [no date]. Available: [www.statcan.ca/english/Pgdb/People/Population/demo40h.htm](http://www.statcan.ca/english/Pgdb/People/Population/demo40h.htm) (accessed 2002 Mar 8).