Email updates

Keep up to date with the latest news and content from BMC Surgery and BioMed Central.

Open Access Highly Accessed Research article

Sentinel lymph node biopsy for breast cancer using methylene blue dye manifests a short learning curve among experienced surgeons: a prospective tabular cumulative sum (CUSUM) analysis

Jeffrey M East12*, Christopher SP Valentine12, Emil Kanchev3 and Garfield O Blake3

Author Affiliations

1 Department of Surgery, Cornwall Regional Hospital, Montego Bay, Jamaica

2 Department of Surgery, Radiology, Anesthesia and Intensive Care, University of the West Indies, Mona, Kingston 6, Jamaica

3 Department of Pathology, Cornwall Regional Hospital, Montego Bay, Jamaica

For all author emails, please log on.

BMC Surgery 2009, 9:2  doi:10.1186/1471-2482-9-2


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2482/9/2


Received:11 June 2008
Accepted:27 January 2009
Published:27 January 2009

© 2009 East et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The benefits of sentinel lymph node biopsy (SLNB) for breast cancer patients with histologically negative axillary nodes, in whom axillary lymph node dissection (ALND) is thereby avoided, are now established. Low false negative rate, certainly with blue dye technique, mostly reflects the established high inherent accuracy of SLNB and low axillary nodal metastatic load (subject to patient selection). SLN identification rate is influenced by volume, injection site and choice of mapping agent, axillary nodal metastatic load, SLN location and skill at axillary dissection. Being more subject to technical failure, SLN identification seems to be a more reasonable variable for learning curve assessment than false negative rate.

Methylene blue is as good an SLN mapping agent as Isosulfan blue and is much cheaper. Addition of radio-colloid mapping to blue dye does not achieve a sufficiently higher identification rate to justify the cost. Methylene blue is therefore the agent of choice for SLN mapping in developing countries.

The American Society of Breast Surgeons recommends that, for competence, surgeons should perform 20 SLNB but admits that the learning curve with a standardized technique may be "much shorter". One appropriate remedy for this dilemma is to plot individual learning curves.

Methods

Using methylene blue dye, experienced breast surgeons performed SLNB in selected patients with breast cancer (primary tumor < 5 cm and clinically negative ipsilateral axilla). Intraoperative assessment and completion ALND were performed for standardization on the first 13 of 24 cases. SLN identification was plotted for each surgeon on a tabular cumulative sum (CUSUM) chart with sequential probability ratio test (SPRT) limits based on a target identification rate of 85%.

Results

The CUSUM plot crossed the SPRT limit line after 8 consecutive, positively identified SLN, signaling achievement of an acceptable level of competence.

Conclusion

Tabular CUSUM charting, based on a justified choice of parameters, indicates that the learning curve for SLNB using methylene blue dye is completed after 8 consecutive, positively identified SLN. CUSUM charting may be used to plot individual learning curves for trainee surgeons by applying a proxy parameter for failure in the presence of a mentor (such as failed SLN identification within 15 minutes).

Background

The benefits of sentinel lymph node biopsy (SLNB) in breast cancer patients with histologically negative axillary nodes, in whom axillary lymph node dissection (ALND) is thereby avoided, have now been well established [1]. The risks of lymphedema of the ipsilateral upper limb and distressing paraesthesiae and pain syndromes associated with ALND are reduced with consequential improved quality of life. SLNB is an accurate test of the metastatic status of axillary nodes [2], particularly when adjacent, palpably abnormal nodes are also reaped [3], with a false negative rate not exceeding 5% in properly selected patients [4] (those with primary breast tumors not exceeding 5 cm [5] and clinically negative axillae) and therefore, not surprisingly, has also been established as an oncologically safe and adequate procedure with disease free and overall survival similar to stage-matched patients having ALND [6-8].

Methylene blue dye is much cheaper than Isosulfan blue [9], does not cause hypersensitivity reactions [10] nor other significant complications (except skin necrosis [11], avoidable by meticulous injection technique when performing breast conserving surgery) and, most importantly, is as good as and possibly better at SLN mapping than Isosulfan blue [9,10,12-16]. Side effects such as blue discoloration of urine, stool and skin (does not cause tattooing) over the injection site are temporary and benign [17]. In North America and Europe, it is recommended that blue dye and radio-tracer mapping be combined as this approach may yield a higher SLN identification rate than blue dye alone [5,18-20], although some studies have not confirmed this advantage [12,16,21]. Radio-tracer mapping is very expensive (prohibitively so in most developing countries), cumbersome (requiring time-consuming preoperative preparation and increased operating time), has no significant SLN detection advantage as single agent over blue dye [12] (except detection of internal mammary SLN, an uncommon finding of doubtful clinical and therapeutic significance) and may pose radiation risk to pathologists handling the nodes [22]. Combination of the two techniques achieves a range of 0% to 18% increase in SLN identification rate over blue dye alone [5,12,16,18-21]. Since 60% of clinically negative axillae are also pathologically negative [23], combining the radio-labeled tracer technique with the blue dye technique stands to benefit only an additional 0 to 11 per 100 women (by way of avoidance of ALND). This seems to be an unjustifiably high price to pay for such a small additional benefit, especially since SLNB is not a therapeutic procedure and does not offer any survival advantage to patients. Methylene blue dye as a single agent is therefore well suited to enable surgeons in developing countries to offer the important technique of SLNB without significantly compromising the quality of the test.

The American Society of Breast Surgeons recommends that, for competence, surgeons should perform 20 SLNB procedures either under supervised mentoring by an experienced colleague or followed immediately by completion ALND [4,24]. It is also recommended that the false negative rate not exceed 5% and the SLN identification rate not be less than 85%. Low false negative rate is a reflection of the high inherent accuracy with which the sentinel node reflects the metastatic status of axillary nodes, now an established fact [2], as well as a function of selection of patients for the procedure who are less likely to harbor lymph node metastases. SLN identification rate is, like false negative rate, subject to axillary nodal metastatic load (patient selection) but also to injection site, volume and choice of mapping agent, location of the SLN, and, importantly, the surgeon's skill at dissecting the axilla. Being more susceptible to technical failure, SLN identification therefore seems to be a more reasonable target for learning curve analysis than false negative rate. Others agree that SLN identification should be the objective of the learning process, especially since failure to find the SLN does not have therapeutically deleterious consequences, ALND being performed in those cases [25].

The American Society of Breast Surgeons admits that the learning curve for surgeons using a standardized technique may be "much shorter" than 20 cases [24] but does not suggest a remedy by way of a reliable method for assessing individual learning curves. It should hardly be surprising that experienced breast surgeons can be expected to master this technique after just a few cases since, being skilled at ALND, they know how to find the nodes draining the breast and should therefore have little difficulty locating a blue sentinel node (radio-tracer mapping adds another level of difficulty), as long as patients are properly selected and the SLN resides within levels I and II of the axilla. Clearly a method is needed for plotting learning curves with the capacity to test and predict individual performance with reference to a standardized level of competence.

Cumulative sum (CUSUM) charting is one of a group of statistical process control methods used by engineers, particularly in manufacturing, to monitor quality of output and, with boundary limits set by the sequential probability ratio test (SPRT), to indicate when a process is out of control [26]. Statistical process control methods are now being used in medicine predominantly for quality control monitoring [27-29] but more recently, for learning curve analysis [30-34]. CUSUM plots are an excellent method for determining learning curves for any procedure with output variables that can be dichotomized and hold the promise of individualizing credentialing and competency certification requirements and ending what has been called the tyranny of mandatory case numbers.

CUSUM analysis has been applied to the learning curve for SLNB as a retrospective quality control tool [25] but not for prospective learning curve analysis. Other learning curve methodologies have also been applied for SLNB [35]. In this study, using methylene blue dye as the mapping agent, tabular CUSUM control charting is used to prospectively evaluate the learning curve of individual surgeons for SLNB and signal achievement of an acceptable, predetermined level of competence.

Methods

The study was approved by the Ethics Committee of the Ministry of Health of Jamaica. Informed consent was received from all participating patients. All patients of either gender presenting to the Cornwall Regional Hospital (CRH) with breast cancer after implementation of the study protocol were assessed for eligibility. Participants were prospectively selected for SLNB if they had an established diagnosis of adenocarcinoma of the breast, a Tis, T1 or T2 primary breast tumor (ie, not exceeding 5 cm in greatest dimension) and a clinically normal ipsilateral axilla. Completion ALND was performed on all participants up to and just beyond the end of the learning curves of both surgeons (13 cases total) as the authors felt that, this being the first such study in Jamaica, definitive treatment of the axilla during this phase should not differ from the pre-existing standard of care (a commitment also given to the Ethics Committee). Subsequent patients were to have immediate ALND only if the SLN was positive on intraoperative assessment or could not be identified, and delayed ALND if an initially negative SLN turned out to be positive on paraffin section.

After induction of anesthesia, 5 cc of 1% methylene blue for injection is infiltrated into the subareolar tissue (yields higher identification rate with blue dye than other sites [36-38]), except when there is a transverse biopsy scar across the upper outer quadrant or axillary tail of the breast, in which case the dye is injected into the parenchyma superolateral to the scar (the presence of such a scar reduces SLN identification rate after subareolar injection [36,37]). In either case, special care must be taken to avoid injection into the skin or submammary connective tissue and muscle. The breast is then massaged for 5 minutes.

The surgical site is prepared and the surgeon goes directly for the SLN via an axillary incision if breast conserving surgery is the definitive procedure. If mastectomy is the definitive procedure, the surgeon goes for the sentinel node after creating the superior flap. All blue nodes and any node receiving a blue lymphatic channel are sentinel nodes. After removal of sentinel nodes, adjacent tissue is palpated and any additional hard or large nodes are also removed. Total number of nodes removed should usually not exceed three, otherwise the benefits of the limited dissection required for SLNB could be compromised. The following variables are then recorded unto a pre-coded form: surgeons (surgeon and first assistant), mastectomy versus breast conserving surgery, site of injection, SLN identified or not, number of SLNs, Berg's level at which SLN found, and number of any non-SLN removed. The unfixed nodes are sent to the pathologist. The operation is then completed, including ALND (in the first 13 cases and if indicated in the others).

The technique for intraoperative processing of the sentinel node for touch imprint cytology differed between the 2 pathologists. One pathologist divides the nodes in halves longitudinally, whilst the other slices them into 2 to 3 mm transverse sections. The former stains cytology specimen separately by May Grunwald-Giemsa, Diff-Quik and haematoxylin eosin (H&E) in a shortened regimen and the latter uses only the H&E technique. Both pathologists used a similar processing technique and rapid H&E staining for frozen section. Although the protocol called for performance of touch imprint cytology and frozen section on all sentinel nodes, the latter procedure was not always possible, usually because of equipment failure.

The following variables are recorded by the pathologist on the original form: SLN cytology (positive or negative), SLN frozen section, SLN paraffin sections and ALND paraffin sections. All variables were entered into a database in STATA version 8 for analysis.

Results

Tables 1 and 2 show the results of the 24 cases performed by the authors. All patients were female. SLNs were identified in all of the first 16 consecutive cases and in 6 of the subsequent 8. In 68% (15/22), only one SLN was identified. Additional non-sentinel nodes were reaped in 27% (6/22). Only 1/29 SLN was identified at Berg's level II, the rest being found at level I. One surgeon (JE) failed to identify SLN in his 14th and 16th cases. Both had more than 3 nodes involved by metastatic disease in the ALND specimen. There were no surgical false negatives among the 13 patients having completion ALND. Of 7 positive paraffin-embedded SLN in this group, three (43%) were negative by touch-imprint cytology (and frozen section in one case). There were no other cytological false negatives among the subsequent 9/11 cases in which SLN were identified. In 57% (4/7) of cases with paraffin-positive SLN, the SLN was the only node involved by metastatic disease.

Table 1. Profile and results of SLNB and completion ALND.

Table 2. Profile and results of SLNB with ALND only if SLN +ve or not found.

Only one patient (case number 3) suffered a significant complication, with dehiscence and delayed healing of that part of a partial mastectomy wound which extended into the peri-areolar region into which methylene blue had been injected. The wound healed in time for the patient to start adjuvant chemotherapy one month after surgery.

The cumulative sum formula (Table 3) was applied to each surgeon's results and used to create their individual plots (Figure 1). A sequential probability ratio test (SPRT) for binary variables [26] was used to calculate upper and lower limit values, assuming a type 1 error (α) of 0.05, a type 2 error (β) of 0.2, an acceptable SLN identification failure rate of 15% and an unacceptable failure rate of 30% (Table 3). The plots of the two surgeons in Figure 1. are superimposed for 11 cases. Note that the lower SPRT limit line, based on parameters from Table 3., is intersected after 8 consecutive cases in which the sentinel node was identified, predicting that there is no statistically significant difference between the identification rate of the surgeons who achieved this number and the 85% identification rate recommended by the American Society of Breast Surgeons for the learning phase. An alternate limit line, based on a type 2 error of 0.1 rather than 0.2 (all other parameters are the same) is crossed after 12 consecutive cases. The upper limit line is omitted from Figure 1. as it has no relevance to the interpretation of this chart.

Table 3. CUSUM and SPRT calculations, according to Davies et al [26].

thumbnailFigure 1. CUSUM plots for two surgeons (superimposed for the first 11 cases). Primary SPRT limit line is crossed after 8 consecutive, positively identified SLN and alternate line is crossed after 12. Parameters for the primary line are from Table 3. and are similar for the alternate line except for a type 2 error of 0.1 instead of 0.2. That part of the plot beyond either lower SPRT limit line is statistically meaningless but is left in place to allow for drawing of other hypothetical limit lines. In practice, the plot may be restarted at 0 after the SPRT line is crossed, for the purpose of process monitoring.

Discussion

The unavailability of frozen section for the majority (19) of cases is not a major shortcoming as touch imprint cytology is as accurate for intraoperative lymph node assessment [39], although both methods are limited in accuracy compared to paraffin sections [40], as confirmed herein. Insistence on frozen section would also limit the portability of SLNB to less well equipped hospitals. Successful application of ambulatory SLNB [41] with examination of paraffin-embedded sections and delayed definitive breast surgery offers improved accuracy of SLN diagnosis as well as the possibility of performing this technique even in hospitals without a resident pathologist. The obvious disadvantage of this latter approach is that all patients end up with 2 operations instead of only the small minority with pathological false negative intraoperative node assessment who require delayed ALND.

The presence of metastatic disease in several axillary nodes of both cases in which no SLN was found implies that they were poorly selected to begin with and that failure to identify was probably due to failure of the SLN to take up the dye [42] rather than failure of technique. Routine preoperative sonographic assessment of axillary nodes has the potential to reduce SLN identification failure for this reason if SLNB is restricted to sonographically negative rather than clinically negative cases [43].

The case of wound dehiscence was likely due to injection of dye into or too close to the skin and can be avoided by careful injection into the central sub-areolar tissue.

There are several formulations of CUSUM charting applicable to learning curve analysis. The simple CUSUM [34], also called O-E (observed – expected) CUSUM chart, is based on the formula: Sn = Σ(Xo - Xi)

where Sn is the cumulative sum, Xo is the target competence level (expressed as a decimal fraction) and Xi = 1 for a successful outcome and 0 for a failure. Therefore for an individual successful attempt, the CUSUM decreases by Xo - 1 and for a failure, it increases by Xo. When the curve changes its gradient from upwards through horizontal to decreasing, the learning curve is considered complete [34]. This is useful for charting learning curves for procedures which take some time to master (that is, for procedures with a high failure rate early on). In charting procedures with a high success rate early on, as in this study, the simple CUSUM leads to the conclusion that there is no learning curve [34] as the plot starts in a negative direction (the direction of success) and maintains its gradient.

The tabular CUSUM (also called SPRT chart and log-likelihood CUSUM) is in effect a graphical representation of a hypothesis test comparing each sequential occurrence of a binary outcome variable to upper and lower limit values [26,27,31,32]. The test is effectively re-performed for each event in the sequence, thereby taking into account cumulative past performance, as reflected by the candidate's position on the plot just prior to the next event. In this formulation, the CUSUM decreases by s for a success and increases by 1 - s for a failure (see Table 3. for calculation of s). The null hypothesis for this test states that, for a given occurrence, the true failure rate is not different from the target failure rate. When the plot crosses the lower limit line, the null hypothesis cannot be rejected and this signals that the predetermined target level of competence has been achieved. If the plot crosses the upper limit line, it must either change gradient (as for the simple CUSUM) or return to a trailing lower limit line placed at a distance below the upper line equal to the distance from the X-axis to the original lower limit line, before the learning curve is considered complete [31]. In a recent variation of the tabular CUSUM, the plot is not allowed to rise above the X-axis and the learner is therefore punished less severely for an early sequence of failures [44]. Limit lines may be calculated using the method advocated by Davies et al [26], as was done in this study, or the log-likelihood method advocated by Wald [28].

For complex procedures, the score for each attempt is risk-adjusted by multivariable regression and then applied to an SPRT CUSUM chart [30,45,46]. Calculation of SPRT limits in these risk-adjusted CUSUM charts is more complex than in the preceding type of chart.

The output of formulas for the tabular CUSUM are subject to manipulation, and therefore the values for acceptable failure rate, unacceptable failure rate, type 1 error and type 2 error must be chosen carefully, although subjectivity cannot be completely avoided. Acceptable and unacceptable failure rates are usually set by consensus or convention. Acceptable failure rate should not be set so low that only a few gifted surgeons with perfect patient selection can achieve it. Unacceptable failure rate should be set at a level above which either the effectiveness (for procedures without serious consequences) is below average or the risk (for procedures with serious consequences) above average. Type 1 error should be set low (maximum 0.1) if we do not wish to falsely identify a competent surgeon as being incompetent [47] (that is, falsely assuming that there is a difference from the target value when none exists). Conversely, type 2 error should be set low if we worry about falsely identifying an incompetent surgeon as competent (that is, falsely assuming that no difference exists from the target value when one exists). In practice, type 2 error should not be set too low if the procedure is easy to learn and if the consequences of failure are not serious.

Table 4. indicates the different numbers of consecutively successful cases required to cross the lower SPRT limit line for different combinations of acceptable and unacceptable failure rates and type 1 and type 2 error. It also indicates the total number of cases required to cross the limit line after 3 failures (the effect of failures on the number of cases required to cross the limit line is independent of where they occur), the number allowed by the American Society of Breast Surgeons in their recommended 20 cases. For a technically more difficult operation or for procedures with more serious consequences for failure than those for failure to identify a SLN, it could be successfully argued that both β and p1 should be set lower than 0.2 and 0.3 respectively. Given that SLNB using methylene blue dye is an easy operation and that the consequence of failure to identify the SLN simply results in a possibly unnecessary ALND, which is still the standard of care, we do not believe that our choice of 0.2 for β is too high. Studies have reported SLN identification failure rates with blue dye of 0.25 [5] and 0.27,[48], and therefore, we also believe that our choice of unacceptable failure rate of 0.3 is reasonable. Conversely, although the literature suggests that SLN identification rate can be as high as 95% and even higher, it would be a mistake to set the acceptable failure rate for the learning curve at 0.05 since this assumes perfect selection of patients and perfect technique.

Table 4. Number of consecutive and total cases required to cross the lower limit line for different combinations of acceptable (p0) and unacceptable (p1) failure rates, type 1 error (α) and type 2 error (β).

The tabular CUSUM applied herein is excellent for plotting the learning curve of trainee surgeons being taught to perform SLNB. All that is required is a proxy measure for failure to identify the SLN in the presence of a mentor, such as failure to find the SLN within a specified time, say 15 minutes. Figure 2. (see also Table 4.) is an illustration of how the CUSUM plot behaves in the hypothetical scenario where the trainee surgeon fails to identify sentinel nodes in the 1st, 6th and 12th cases. Applying the parameters from Table 3, 22 cases would then be required to cross the lower limit line and signal the end of the learning curve, a number marginally higher than the 20 cases recommended by the American Society of Breast Surgeons for a similarly allowed failure rate of 3 cases. This latter observation provides further support for the reasonableness of our choice of parameters.

thumbnailFigure 2. Hypothetical CUSUM plot for surgeon/trainee failing to identify 1st, 6th and 12th SLN. Parameters are from Table 3. Plot crosses SPRT limit line after 22 cases.

Conclusion

Methylene blue dye is an accurate and cost-effective single agent for sentinel lymph node mapping in breast cancer. Sentinel node identification rate is a more reasonable target for assessment of learning curves of surgeons than is false negative rate. Application of a tabular CUSUM chart, with SPRT limit values based on a target identification rate of 85%, and a reasonable choice of other parameters, demonstrates that experienced breast surgeons have completed the SLNB learning curve after 8 consecutive successful attempts using methylene blue. This type of learning curve analysis can be readily applied to trainee surgeons by using a proxy measure for failure in the presence of a mentor, such as failure to identify the SLN within 15 minutes. Using the same parameters, a trainee surgeon allowed 3 failures requires 22 cases to complete the learning curve.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors participated in the acquisition of data and revision of the manuscript. JME and CSPV performed sentinel node biopsy whilst EK and GOB performed pathological assessment of the lymph nodes. JME conceived of the study, determined the design, performed the statistical analysis, interpreted the data and drafted the manuscript, with specific inputs from EK and GOB to the methods section with respect to their techniques for intraoperative pathological analysis of sentinel nodes. All authors read and gave final approval of the version submitted for publication.

Acknowledgements

Participation of two other consultant surgeons at CRH is acknowledged. Both performed an additional 8 cases between them but prospective data acquisition on those cases was inadequate to allow for inclusion in the final manuscript.

References

  1. Mansel RE, Fallowfield L, Kissin M, Goyal A, Newcombe RG, Dixon JM, Yiangou C, Horgan K, Bundred N, Monypenny I, et al.: Randomized multicenter trial of sentinel node biopsy versus standard axillary treatment in operable breast cancer: the ALMANAC Trial.

    J Natl Cancer Inst 2006, 98:599-609. PubMed Abstract | Publisher Full Text OpenURL

  2. Kim T, Giuliano AE, Lyman GH: Lymphatic mapping and sentinel lymph node biopsy in early-stage breast carcinoma: a metaanalysis.

    Cancer 2006, 106:4-16. PubMed Abstract | Publisher Full Text OpenURL

  3. Carmon M, Olsha O, Rivkin L, Spira RM, Golomb E: Intraoperative palpation for clinically suspicious axillary sentinel lymph nodes reduces the false-negative rate of sentinel lymph node biopsy in breast cancer.

    Breast J 2006, 12:199-201. PubMed Abstract | Publisher Full Text OpenURL

  4. Simmons RM: Review of sentinel lymph node credentialing: how many cases are enough?

    J Am Coll Surg 2001, 193:206-209. PubMed Abstract | Publisher Full Text OpenURL

  5. O'Hea BJ, Hill AD, El Shirbiny AM, Yeh SD, Rosen PP, Coit DG, Borgen PI, Cody HS III: Sentinel lymph node biopsy in breast cancer: initial experience at Memorial Sloan-Kettering Cancer Center.

    J Am Coll Surg 1998, 186:423-427. PubMed Abstract | Publisher Full Text OpenURL

  6. Cox C, White L, Allred N, Meyers M, Dickson D, Dupont E, Cantor A, Ly Q, Dessureault S, King J, et al.: Survival outcomes in node-negative breast cancer patients evaluated with complete axillary node dissection versus sentinel lymph node biopsy.

    Ann Surg Oncol 2006, 13:708-711. PubMed Abstract | Publisher Full Text OpenURL

  7. Kuijt GP, Poll-Franse LV, Voogd AC, Nieuwenhuijzen GA, Roumen RM: Survival after negative sentinel lymph node biopsy in breast cancer at least equivalent to after negative extensive axillary dissection.

    Eur J Surg Oncol 2006, 33(7):832-837. PubMed Abstract | Publisher Full Text OpenURL

  8. Naik AM, Fey J, Gemignani M, Heerdt A, Montgomery L, Petrek J, Port E, Sacchini V, Sclafani L, VanZee K, et al.: The risk of axillary relapse after sentinel lymph node biopsy for breast cancer is comparable with that of axillary lymph node dissection: a follow-up study of 4008 procedures.

    Ann Surg 2004, 240:462-468. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Gold HT, Do HT, Osborne MP: Cost-effectiveness of isosulfan blue vs. methylene blue dye in sentinel node biopsy.

    J Clin Oncol 2005, 23:6103. OpenURL

  10. Simmons R, Thevarajah S, Brennan MB, Christos P, Osborne M: Methylene blue dye as an alternative to isosulfan blue dye for sentinel lymph node localization.

    Ann Surg Oncol 2003, 10:242-247. PubMed Abstract | Publisher Full Text OpenURL

  11. Salhab M, Al Sarakbi W, Mokbel K: Skin and fat necrosis of the breast following methylene blue dye injection for sentinel node biopsy in a patient with breast cancer.

    Int Semin Surg Oncol 2005, 2:26. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  12. Blessing WD, Stolier AJ, Teng SC, Bolton JS, Fuhrman GM: A comparison of methylene blue and lymphazurin in breast cancer sentinel node mapping.

    Am J Surg 2002, 184:341-345. PubMed Abstract | Publisher Full Text OpenURL

  13. Eldrageely K, Vargas MP, Khalkhali I, Venegas R, Burla M, Gonzalez KD, Vargas HI: Sentinel lymph node mapping of breast cancer: a case-control study of methylene blue tracer compared to isosulfan blue.

    Am Surg 2004, 70:872-875. PubMed Abstract OpenURL

  14. Golshan M, Nakhlis F: Can methylene blue only be used in sentinel lymph node biopsy for breast cancer?

    Breast J 2006, 12:428-430. PubMed Abstract | Publisher Full Text OpenURL

  15. Nour A: Efficacy of methylene blue dye in localization of sentinel lymph node in breast cancer patients.

    Breast J 2004, 10:388-391. PubMed Abstract | Publisher Full Text OpenURL

  16. Varghese P, Mostafa A, Abdel-Rahman AT, Akberali S, Gattuso J, Canizales A, Wells CA, Carpenter R: Methylene blue dye versus combined dye-radioactive tracer technique for sentinel lymph node localisation in early breast cancer.

    Eur J Surg Oncol 2007, 33:147-152. PubMed Abstract | Publisher Full Text OpenURL

  17. Newman LA: Lymphatic mapping and sentinel lymph node biopsy in breast cancer patients: a comprehensive review of variations in performance and technique.

    J Am Coll Surg 2004, 199:804-816. PubMed Abstract | Publisher Full Text OpenURL

  18. Derossis AM, Fey J, Yeung H, Yeh SD, Heerdt AS, Petrek J, VanZee KJ, Montgomery LL, Borgen PI, Cody HS III: A trend analysis of the relative value of blue dye and isotope localization in 2,000 consecutive cases of sentinel node biopsy for breast cancer.

    J Am Coll Surg 2001, 193:473-478. PubMed Abstract | Publisher Full Text OpenURL

  19. McMasters KM, Tuttle TM, Carlson DJ, Brown CM, Noyes RD, Glaser RL, Vennekotter DJ, Turk PS, Tate PS, Sardi A, et al.: Sentinel lymph node biopsy for breast cancer: a suitable alternative to routine axillary dissection in multi-institutional practice when optimal technique is used.

    J Clin Oncol 2000, 18:2560-2566. PubMed Abstract | Publisher Full Text OpenURL

  20. Hung WK, Chan CM, Ying M, Chong SF, Mak KL, Yip AW: Randomized clinical trial comparing blue dye with combined dye and isotope for sentinel lymph node biopsy in breast cancer.

    Br J Surg 2005, 92:1494-1497. PubMed Abstract | Publisher Full Text OpenURL

  21. Morrow M, Rademaker AW, Bethke KP, Talamonti MS, Dawes LG, Clauson J, Hansen N: Learning sentinel node biopsy: results of a prospective randomized trial of two techniques.

    Surgery 1999, 126:714-720. PubMed Abstract | Publisher Full Text OpenURL

  22. Klausen TL, Chakera AH, Friis E, Rank F, Hesse B, Holm S: Radiation doses to staff involved in sentinel node operations for breast cancer.

    Clin Physiol Funct Imaging 2005, 25:196-202. PubMed Abstract | Publisher Full Text OpenURL

  23. Fisher B, Jeong JH, Anderson S, Bryant J, Fisher ER, Wolmark N: Twenty-five-year follow-up of a randomized trial comparing radical mastectomy, total mastectomy, and total mastectomy followed by irradiation.

    N Engl J Med 2002, 347:567-575. PubMed Abstract | Publisher Full Text OpenURL

  24. Consensus Statement on Guidelines for Performing Sentinel Lymph Node Dissection in Breast Cancer [http://www.breastsurgeons.org/slnd.shtml] webcite

  25. Lerch L, Donald JC, Olivotto IA, Lesperance M, van der WN, Rusnak C, Biberdorf D, Ross A, Hayashi A: Measuring surgeon performance of sentinel lymph node biopsy in breast cancer treatment by cumulative sum analysis.

    Am J Surg 2007, 193:556-559. PubMed Abstract | Publisher Full Text OpenURL

  26. Davies OL: Design and analysis of industrial experiments. London: Oliver and Boyd; 1956. OpenURL

  27. Biau DJ, Resche-Rigon M, Godiris-Petit G, Nizard RS, Porcher R: Quality control of surgical and interventional procedures: a review of the CUSUM.

    Qual Saf Health Care 2007, 16:203-207. PubMed Abstract | Publisher Full Text OpenURL

  28. Sibanda T, Sibanda N: The CUSUM chart method as a tool for continuous monitoring of clinical outcomes using routinely collected data.

    BMC Med Res Methodol 2007, 7:46. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  29. Williams SM, Parry BR, Schlup MM: Quality control: an application of the cusum.

    BMJ 1992, 304:1359-1361. PubMed Abstract | PubMed Central Full Text OpenURL

  30. Grunkemeier GL, Wu YX, Furnary AP: Cumulative sum techniques for assessing surgical results.

    Ann Thorac Surg 2003, 76:663-667. PubMed Abstract | Publisher Full Text OpenURL

  31. Kestin IG: A statistical approach to measuring the competence of anaesthetic trainees at practical procedures.

    Br J Anaesth 1995, 75:805-809. PubMed Abstract | Publisher Full Text OpenURL

  32. Oliveira Filho GR: The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method.

    Anesth Analg 2002, 95:411-6. PubMed Abstract | Publisher Full Text OpenURL

  33. Van Rij AM, McDonald JR, Pettigrew RA, Putterill MJ, Reddy CK, Wright JJ: Cusum as an aid to early assessment of the surgical trainee.

    Br J Surg 1995, 82:1500-1503. PubMed Abstract | Publisher Full Text OpenURL

  34. Young A, Miller JP, Azarow K: Establishing learning curves for surgical residents using Cumulative Summation (CUSUM) Analysis.

    Curr Surg 2005, 62:330-334. PubMed Abstract | Publisher Full Text OpenURL

  35. Clarke D, Newcombe RG, Mansel RE: The learning curve in sentinel node biopsy: the ALMANAC experience.

    Ann Surg Oncol 2004, 11:211S-215S. PubMed Abstract OpenURL

  36. D'Eredita' G, Ferrarese F, Cecere V, Massa ST, de Carne F, Fabiano G: Subareolar injection may be more accurate than other techniques for sentinel lymph node biopsy in breast cancer.

    Ann Surg Oncol 2003, 10:942-947. PubMed Abstract | Publisher Full Text OpenURL

  37. Kern KA: Sentinel lymph node mapping in breast cancer using subareolar injection of blue dye.

    J Am Coll Surg 1999, 189:539-545. PubMed Abstract | Publisher Full Text OpenURL

  38. Klimberg VS, Rubio IT, Henry R, Cowan C, Colvert M, Korourian S: Subareolar versus peritumoral injection for location of the sentinel lymph node.

    Ann Surg 1999, 229:860-864. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  39. Brogi E, Torres-Matundan E, Tan LK, Cody HS III: The results of frozen section, touch preparation, and cytological smear are comparable for intraoperative examination of sentinel lymph nodes: a study in 133 breast cancer patients.

    Ann Surg Oncol 2005, 12:173-180. PubMed Abstract | Publisher Full Text OpenURL

  40. McLaughlin SA, Ochoa-Frongia LM, Patil SM, Cody HS III, Sclafani LM: Influence of frozen-section analysis of sentinel lymph node and lumpectomy margin status on reoperation rates in patients undergoing breast-conservation therapy.

    J Am Coll Surg 2008, 206:76-82. PubMed Abstract | Publisher Full Text OpenURL

  41. Fenaroli P, Tondini C, Motta T, Virotta G, Personeni A: Axillary sentinel node biopsy under local anaesthesia in early breast cancer.

    Ann Oncol 2000, 11:1617-1618. PubMed Abstract | Publisher Full Text OpenURL

  42. de Kanter AY, Menke-Pluijmers MB, Henzen-Logmans SC, van Geel AN, van Eijck CJ, Wiggers T, Eggermont AM: Reasons for failure to identify positive sentinel nodes in breast cancer patients with significant nodal involvement.

    Eur J Surg Oncol 2006, 32:498-501. PubMed Abstract | Publisher Full Text OpenURL

  43. Mathijssen IM, Strijdhorst H, Kiestra SK, Wereldsma JC: Added value of ultrasound in screening the clinically negative axilla in breast cancer.

    J Surg Oncol 2006, 94:364-367. PubMed Abstract | Publisher Full Text OpenURL

  44. Biau DJ, Williams SM, Schlup MM, Nizard RS, Porcher R: Quantitative and individualized assessment of the learning curve using LC-CUSUM.

    Br J Surg 2008, 95:925-929. PubMed Abstract | Publisher Full Text OpenURL

  45. Tekkis PP, Senagore AJ, Delaney CP, Fazio VW: Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections.

    Ann Surg 2005, 242:83-91. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  46. Tekkis PP, Fazio VW, Lavery IC, Remzi FH, Senagore AJ, Wu JS, Strong SA, Poloneicki JD, Hull TL, Church JM: Evaluation of the learning curve in ileal pouch-anal anastomosis surgery.

    Ann Surg 2005, 241:262-268. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  47. Spiegelhalter D, Grigg O, Kinsman R, Treasure T: Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery.

    Int J Qual Health Care 2003, 15:7-13. PubMed Abstract | Publisher Full Text OpenURL

  48. Marrazzo A, Taormina P, Noto A, Cardinale G, Casa L, Mercadante S, Lo GD, David M: Localization of the sentinel lymph node in breast cancer: prospective comparison of vital staining and radioactive tracing methods.

    Chir Ital 2004, 56:621-627. PubMed Abstract OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2482/9/2/prepub