Usefulness of the endoscopic surgical skill qualification system in laparoscopic colorectal surgery: short-term outcomes: a single-center and retrospective analysis

Abstract

Background

The use of laparoscopic surgery has become widespread, and many surgeons are striving to acquire the necessary techniques for it. The Endoscopic Surgical Skill Qualification System (ESSQS), established by the Japan Society for Endoscopic Surgery, serves to maintain and improve the quality of laparoscopic surgery in Japan. In this study, we aimed to determine whether ESSQS certification is useful in maintaining and improving the quality of surgical techniques and in standardization of laparoscopic surgery in Japan.

Methods

This retrospective study used data from the Institute for Integrated Medical Sciences, Tokyo Women’s Medical University, Japan. From January 2016 to October 2017, 241 patients with colorectal cancer underwent laparoscopic surgery. Of them, 220 patients were selected and divided into two groups on the basis of surgery performed by an ESSQS-qualified surgeon (QS group) (n = 170) and a non-ESSQS-QS (NQS) (n = 50). We compared the short-term results in the two groups and examined those before and after propensity score matching (PSM).

Results

Mean operation time was longer in the NQS group than in the QS group. Furthermore, mean blood loss was significantly less in the QS group. These were similar before and after PSM. The rate of conversion to open surgery was significantly higher in the NQS group before PSM. However, the rate of postoperative complications was not different between the two groups.

Conclusions

A laparoscopic procedure performed by ESSQS-QS often leads to good short-term outcomes. Thus, the ESSQS system works and is potentially useful in maintaining and improving the quality of surgical techniques and in standardization of laparoscopic surgery in Japan.

Background

The use of laparoscopic surgery has become widespread because this technique can be easily adapted to various organs and disease treatments. In colorectal surgery, using a laparoscopic rather than open approach generally leads to faster recovery, reduced duration of postoperative ileus, lower wound infection rates, shorter hospital stay, reduced postoperative pain, and earlier tolerance of a regular diet [1, 2]. However, laparoscopic surgical techniques are difficult to master, and a laparoscopic approach is associated with an increased operation time compared with an open approach [1, 2]. In an attempt to standardize laparoscopic surgery in Japan, the Endoscopic Surgical Skill Qualification System (ESSQS), established by the Japan Society for Endoscopic Surgery (JSES), serves to maintain and improve the quality of surgical technique and to standardize laparoscopic surgery [3,4,5]. Applicants who want to have the privileges of endoscopic surgeons are required to submit certain documents, including a letter certifying 2 years of uninterrupted endoscopic surgical practice after completion of all formal training, a certificate of membership of the JSES, and the special board of the Japan Society of Surgery, certificates of attendance of meetings and seminars held under the auspices of the JSES, a bibliography showing papers presented at the meetings or papers published in the authorized journals of the JSES, in addition to a list of endoscopic surgeries the applicant has performed by himself or herself over the last 3 years, together with an unedited Video, showing the surgery carried out by his or her own effort, and suturing and knotting techniques the applicant performed by him or herself. They are all screened and evaluated very seriously by committee members elected from individual Committees in order to make a final decision. For video evaluation, two judges, elected from the individual society, review the video using a score sheet, with detailed checking points and mark allocation. Checking points are divided into 2 parts consisting of: “common criteria” for basic endoscopic techniques commonly used for all procedures, and “organ-specific criteria” for special endoscopic surgical techniques for individual organs. The allotted marks for each criterion are 60 and 40 points respectively. The evaluation is focused on surgical techniques and camera work and a total score of 70 points is designated as the pass mark. The number of certificate holders certified in the field of Gastroenterological Surgery during the period from 2003 to 2012 is around 1000, with an average success rate of around 50%. The main reason for the low success rate is attributable to their mainly immature techniques including careless handling of organs with inadequate instruments, or an inadequate operative field and a lack of communication among operators. [4]

This certification system is original and unmatched worldwide, and it is expected to be extremely useful for improving surgical outcomes and reducing complications. However, studies proving the usefulness of ESSQS have not been published since 2004. In this study, we aimed to determine whether ESSQS is useful in maintaining and improving the quality of surgical techniques and in the standardization of laparoscopic surgery in Japan.

Materials and methods

We focused on laparoscopic colorectal surgery and limited our study only to patients who underwent colorectal cancer surgery and in whom the pathology was diagnosed using postoperative pathological specimens, excluding those with autoimmune diseases, benign diseases, and malignant lymphomas. In this retrospective case-controlled study, we used data from the Institute for Integrated Medical Sciences, Tokyo Women’s Medical University, Japan.

From January 2016 to October 2017, 241 patients with colorectal cancer underwent laparoscopic surgery. Excluding patients with simultaneous resection of the other organs (n = 15), two or more colon resections in the same operation (n = 2), and robot-assisted surgery (n = 4), the remaining 220 patients were included. Patients were divided into two groups on the basis of surgery performed by an ESSQS-qualified surgeon (QS group) (n = 170) and a non-ESSQS-QS (NQS) (n = 50). The surgical team in the QS group generally included an ESSQS-qualified lead surgeon, a laparoscopic surgical assistant, or a camera operator. In the QS group, 118 surgeries were performed with QS; of them, 52 surgeries were performed with NQS in presence of a laparoscopic surgical assistant or camera operator with QS (Fig. 1). In the NQS group, ESSQS-QS did not participate in any of the surgeries.

Fig. 1

Two hundred forty-one patients with colorectal cancer underwent laparoscopic surgery. We excluded patients with the following: simultaneous resection of the other organs (n = 15), two or more colon resections (n = 2), and robot-assisted surgery (n = 4). We divided remaining patients into two groups: QS group (n = 170) and NQS group (n = 50). Surgical team in QS group included a lead surgeon, assistant, or camera operator. In the QS group, 118 surgeries were performed with QS, and there was either an assistant or camera operator in 52 surgeries. For the NQS group, no ESSQS-qualified surgeons participated

At our facility, we conduct group medical examination based on the organ, and there are 10 surgeons in the colorectal group. They all possess more than 5 years of surgical experience, and three of them are ESSQS qualified. In QS surgeon group, One surgeon with more than 15 years of experience, one with more than 20 years and one with more than 25 years. On the other hand, in another group, five surgeons have experience as a surgeon for more than 10 years, in addition, one more than 20 years and one had more than 25 years’ experience. Generally, laparoscopic procedures included three physicians from our team: lead surgeon, assistant, and camera operator. All surgical procedures and roles of participating physicians were decided at preoperative team staff conferences, and almost every surgery proceeded as planned. The extent of lymph node dissection was decided by the lead surgeon before the surgery. However, our result of this time derived the extent of dissection from the pathological result after the operation.

We retrospectively analyzed the following short-term outcomes after laparoscopic surgeries: operation time (min), blood loss (ml), conversion to open surgery, lymph node dissection level, number of lymph nodes harvested, postoperative complications, and postoperative stay in the hospital (day). Conversion to open surgery was intraoperatively judged by the lead surgeon. Patient management during the perioperative period was similar in all cases except for minor variations in perioperative antibiotics because of group medical examination. Postoperative complications were evaluated according to the Clavien–Dindo classification [6]. All enrolled patients gave their informed consent. This study was approved by the institutional review board of the Tokyo Women’s Medical University Hospital.

Statistical analysis

We used JMP Pro 11 software (SAS Institute, Cary, NC, USA) for all statistical analyses. All quantitative variables were reported as means. Continuous variables for the two groups were checked for normality of distribution using one-sample Kolmogorov–Smirnov test and compared using analysis of variance (Student’s t-test or Mann–Whitney U test). Binomial and categorical data were evaluated by cross-linked tables using Pearson’s v² or two-tailed Fisher’s exact tests. Univariate analysis (non-parametric Wilcoxon two-sample test for continuous variables and Χ² test for categorical variables) was performed for both groups. To identify independent risk factors for short-term outcomes using multivariate analysis, all significant variables evaluated on univariate analysis were integrated into multiple logistic regression and multiple regression analyses. P < 0.05 was considered significant (Table 1).

Table 1 Univariate analysis and multivariate analysis of bleeding, operation time, and conversion

Propensity score matching

We used PSM to minimize the differences in baseline characteristics between the QS and NQS groups. The following variables were included to establish the model: age, gender, body mass index (BMI), the American Society of Anesthesiologists (ASA) score, history of abdominal surgery, stage, anastomosis, tumor size, tumor location, operative procedure. After PS generation, patients in the QS and NQS groups underwent 1:1 nearest available matching of the logit of the propensity score with a caliper width of 0.20 of the standard deviation of the score. Patients who did not meet the matching criteria were excluded.

Results

Patient demographic characteristics

We were able to assign 220 included patients to either of the two groups (Fig. 1). Table 2 compares the characteristics of the patients in two groups. There was no difference between the QS and NQS groups regarding age (68.49 vs 66.30 years, P = 0.2273), gender (P = 0.4001), and BMI (22.21 vs 22.01 kg/m², P = 0.694). Preoperative physical status was scored using ASA classification, and all the patients were ASA class I, II, or III, with no difference between the groups (P = 0.292). To compare the possibility of adhesion during the surgery, surgical history of the abdomen was compared, but no significant differences were found (32.94% vs 42%, P = 0.2378); furthermore, there was no difference in the mean size of tumor in the two groups (35.51 vs 37.34 mm, P = 0.5781). Various surgical procedures were performed; laparoscopic-assisted ascending colon resection (LACAR) and laparoscopic-assisted Hartmann’s operation (LA Hartmann’s operation) were only performed in the QS group; however, there was no significant difference between these two surgical procedures (P = 0.830). Regarding the method of anastomosis, there was a significant difference (P = 0.0002) between the two groups; functional end-to-end anastomosis (FEEA) was more frequently used in the QS group (56.47% vs 36%, P = 0.0109), whereas handsewn anastomosis was more frequently performed in the NQS group (0.59% vs 12%, P = 0.001), and Albert-Lembert suture was performed in almost all the handsewn anastomoses. The 1:1 PS-matched cohort comprised 43 patients from the QS group and 43 from the NQS group. The differences in patient characteristics between the QS and NQS groups in the original analysis were alleviated after PSM (Table 2). No significant difference was observed in any item.

Table 2 Patient characteristics before and after PSM

Short-term outcome

Table 3 shows short-term outcomes in the two groups before and after PSM. Compared with the QS group, mean operation time was significantly longer in the NQS group (213.4 min vs 291.7 min, P = 0.0001, 221.6 min vs 304.6 min, P = 0.007). Blood loss was minimal in both groups; however, mean bleeding amount was significantly less in the QS group (25.52 ml vs 45.54 ml, P = 0.0488, 17.47 ml vs 48.6 ml, P = 0.0436). Lymph node dissection level was no significant differences were observed after PSM (P = 0.3833). Regarding the number of harvested lymph nodes, the number of exploited lymph nodes was higher in the QS group (20.19 vs 12.42, P = 0.0001, 18.74 vs 12.44, P = 0.003). Conversion to open surgery occurred in four cases, all in the NQS group (0% vs 8%, P = 0.0002) before PSM. However, after PSM, no significant differences were observed (0% vs 6.98%, P = 0.0779). Regarding complications, no significant difference was observed between the groups (25.29% vs 28%, P = 0.7011, 27.91% vs 25.58%, P = 0.8075); furthermore, the Clavien–Dindo classification showed no difference between the groups. One case in each group required surgery because of a major anastomotic leak. There was no difference between the groups regarding postoperative hospital stay (13.15 days vs 13.78 days, P = 0.6057, 12.56 days vs 13.63 days, P = 0.3618). On multivariate analysis, surgical time in the QS group was detected as a significant factor (P = 0.0001), including the gender and surgical method. No significant factor could be detected by multivariate analysis regarding bleeding volume. Regarding the rate of conversion to an open procedure, being in the NQS group became a factor with a significant difference (P = 0.0003).

Table 3 Operative and postoperative results before and after PSM

Discussion

Laparoscopic surgery is being performed worldwide at many facilities. While it has many positive aspects for patients, it is technically challenging for the surgeon and surgical team [1, 2]. There is a push to standardize laparoscopic surgery, and ESSQS serves to maintain and improve the quality of surgical technique and the standardization of laparoscopic surgery in Japan [3,4,5]. This system is unique to Japan and unmatched elsewhere in the world. There are few published articles related to ESSQS, so it is very difficult to find proof of its effectiveness in the literature [6,7,8,9,10,11]. Through our retrospective single-facility study, we showed the usefulness of ESSQS for the first time.

There were no differences regarding patient background in our study, but there was a difference in the proportion of intestinal anastomosis during surgery. At our facility, the choice of anastomosis during surgery is left to the lead surgeon. There are cases where the intestinal tract length is insufficient and stapled anastomosis is difficult, but there is a possibility that this is determined by a surgeon who is not proficient in handsewn anastomosis. The possibility of difference in the anastomosis method influencing the operation time and bleeding amount in this study cannot be denied. Regarding anastomotic leakage, Choy concluded that stapled anastomosis results in less leakage than handsewn anastomosis [12,13,14,15,16,17]. In addition, data on short surgical time is recognized [14, 18]. Regarding bleeding, we did not acknowledge the paper which recognizes a big difference in the range to be examined [15, 16].

The results of our study show that the surgical time and bleeding amount were significantly lower in the QS group. On comparing with the JCOG 0404 study on bleeding volume and surgery time, the QS group showed nearly comparable results, but the NQS group showed longer operation time and greater bleeding amount [19]. This indicates that ESSQS-QS may be able to control bleeding more accurately, perform the standardized procedure faster, and instruct other physicians in the technique. Regarding operation time, multivariate analysis showed ESSQS qualification to be a risk factor along with gender, tumor site, operation method, and anastomosis method. However, regarding the amount of bleeding, ESSQS qualification was not found to be a risk factor in multivariate analysis. Because laparoscopic surgery generally involves a small amount of bleeding, there is a possibility that it is difficult to detect as a significant difference. However, to eliminate these differences, we decided to further modify with PSM and compare the two groups. After PSM, a difference was observed in the amount of bleeding and operation time. However, in our study, it was difficult to compare assistants and cameras separately for surgical assistants. The camera handling by an unexperienced surgeon is one of the major factors in time loosing even when the lead surgeon is experienced in laparoscopic surgery. Also, the same can be said for the assistant. Of course, it could also cause bleeding.

Conversion to open surgery occurred in four cases in the NQS group because of adhesion. Although it is difficult to evaluate the rate of conversion to an open approach, the results of a multicenter randomized controlled trial showed that conversion to open surgery has increased in laparoscopic colorectal resection cases in patients with physical status ASA III and above, hemi-right or left colon resection, sigmoidectomy, low anterior resection, or abdominoperineal resection [19,20,21,22,23,24,25]. However, a recent study reported that there was no correlation between ASA and BMI regarding laparotomy conversion rate [26, 27]. Conversely, a study reported that the rate of conversion increased in cases with BMI ≥ 27.5 kg /m², with the rate of conversion being as high as ≥20%. It was also noted that many surgeons did not reach the learning curve for ESSQS qualification, so definite prediction it is difficult to judge as a factor [23]. In our study, the lead surgeon determined conversion to an open approach. There is a high possibility that surgery can be completed without laparotomy by more experienced surgeons; however, conversion is by no means a surgical error if it is necessary for patient safety. We believe that safely performing a surgery depends on surgeons’ skills as well. However, these results could not be confirmed by the modified PSM comparison because our study changed the number of patients who converted into laparotomy surgery, further accumulation of cases is necessary in the future.

Regarding lymph node dissection and the number of harvested lymph nodes, the QS group was more widely dissected and many lymph nodes could be collected. This results of the extent of dissection are indicated by postoperative pathological results. The extent of lymph node dissection was discussed before surgery, surgery was performed accordingly. However, in this study, the final lymph node dissection extent was defined by the presence of lymph nodes, with or without metastasis. This result also reflects that ESSQS-QS can perform more precise dissections and is also familiar with D3 cases. However, because troubleshooting such as response to bleeding may be more effective with ESSQS- QS, dissection can be more precise in the QS group. Also, with more accurate technique, more accurate dissection might have been possible in the QS group. The number of lymph node dissections in our study was not significantly different from those reported in other studies [28]. However, these results also showed no difference after PSM. Considering this, it is highly likely that the number of lymph node dissection levels do not lead to a difference in the two groups. To lead out these conclusions, further accumulation of cases and improvements in study methods are required.

There was no significant difference in postoperative complications and hospital stay between the QS and NQS groups, and in each group, surgery became necessary in only one case due to a major leakage. Both groups show a good postoperative course. Even with the JCOG0404 study, the rate of complications was reasonable [18]. There was no difference between the groups regarding postoperative hospital days. As postoperative management of patients at our facility is performed by a team, there was little difference between the groups regarding the timing of discharge and judgment of complications. Also, postoperative management is unified. Thus, there is a possibility that this result may have strong evidence.

Based on the abovementioned results, the ESSQS certification process for colorectal surgical technique is accurately performed by the association. In a study similar to ours, Nijhof et al. compared experts and residents for laparoscopic colorectal surgical skills and obtained results different from ours. This may indicate the difference between an expert surgeon and ESSQS- QS [29]. On the other hand, another evaluation of technique for certification is a surgeon meeting the predetermined criteria as evaluated by another, more experienced surgeon. Also, in this study, we compared, as a subsidiary, a group of interventions between ESSQS-QS who assisted the non-ESSQS-QS and non-ESSQS-QS. As seen in Tables 4 and 5, before PSM surgery time, laparotomy conversion rate, and lymph node dissection showed significantly better results for the interventions by ESSQS- QS. Also, after PSM showed significantly better results in operation time and harvested lymph nodes. This result is similar to those reported in the literature and is one of the indicators of the quality of technical certification [30].

Table 4 Patient characteristics in QSA and NQS groups before and after PSM

Table 5 Operative and postoperative results in QSA and NQS groups before and after PSM

This research has some limitations. We modified using PSM and compared to enhance the research; however, there are still some limitations. It is a retrospective study, and there are certain differences in the patient background. Furthermore, there are more cases in the QS group than in the NQS group, which may result in a difference in results. Moreover, it is thought that there is a difference in the skill level of the caster. ESSQS-QS has considerable laparoscopic surgery experience. However, surgeons performing the procedure in the NQS group may have little experience in laparoscopic surgery. This seems to be a strong factor in the results of our study. Also, our study includes data only from a single facility, and the number of cases is small. A multicenter study with a large sample size is needed to comprehensively evaluate this issue in the future.

Conclusion

Our results indicate that a laparoscopic colorectal surgery performed by ESSQS-QS leads to good short-term outcomes. ESSQS is potentially useful in maintaining and improving the quality of surgical techniques and in standardization of laparoscopic surgery in Japan.