- Study protocol
- Open Access
- Open Peer Review
Prospective multicentre cohort study of patient-reported outcomes and complications following major abdominal neoplastic surgery (PATRONUS) – study protocol for a CHIR-Net student-initiated German medical audit study (CHIR-Net SIGMA study)
BMC Surgery volume 18, Article number: 90 (2018)
One of the most important aspects of designing a clinical trial is selecting appropriate outcomes. Patient-reported outcomes (PROs) can provide a personal assessment of the burden and impact of a malignant disease and its treatment. PROs comprise a wide range of outcomes including basic clinical symptom scores and complex metrics such as health-related quality of life (HRQoL). There is limited data on how postoperative complications following cancer surgery affect symptoms and HRQoL. For this reason the primary aim of the PATRONUS study is to investigate how perioperative complications affect cancer-related symptoms and HRQoL in patients undergoing abdominal cancer surgery. The PATRONUS study is designed and will be initiated and conducted by medical students under the direct supervision of clinician scientists based on the concept of inquiry-based learning.
PATRONUS is a non-interventional prospective multicentre cohort study. Patients undergoing elective oncological abdominal surgery will be recruited at regional centres of the clinical network of the German Surgical Society (CHIR-Net) and associated hospitals.
A core set of 12 cancer associated symptoms will be assessed via the PRO version of the Common Terminology Criteria for Adverse Events. The cancer-specific HRQoL will be measured via the computerised adaptive testing version of the European Organisation for Research and Treatment of Cancer (EORTC) QLQ-C30. PROs will be measured eight times over a period of six months. The short-term clinical outcome measure is the rate of postoperative complications (grade II to V) within 30 days according to the Clavien-Dindo classification. The long-term clinical outcome is overall survival within six months postoperative.
PATRONUS will provide essential insights into the patients’ assessment of their well-being and quality of life in direct relation to clinical outcome parameters following abdominal cancer surgery. Furthermore, PATRONUS will investigate the feasibility of multicentre student-led clinical research.
German Clinical Trials Register: DRKS00013035 (registered on October 26, 2017).
Universal Trial Number (UTN): U1111–1202-8863.
Cancer is the second most common cause of death in Germany following cardiovascular diseases . Due to demographic changes, the incidence and prevalence of malignancies in Germany will rise sharply within the next years [2,3,4]. According to German national data, the most frequent lethal tumour diseases include solid neoplasms of the abdominal cavity including pancreatic, liver, gastric and colorectal cancers . For these tumours, surgery is the mainstay of curative as well as palliative treatment. At the same time, cancer patients will become older and comorbid [2, 6, 7]. Therefore patients, caregivers and specialists will face new challenges in the care of cancer patients. Accordingly the design and focus of clinical trials will need to adapt to this changing environment with an increasing need to integrate the patients’ perspective in clinical studies.
For this purpose, patient-reported outcomes (PROs) have been introduced next to survival and morbidity endpoints in oncological trials. PROs can be defined as ‘any outcome evaluated directly by the patient himself or herself and is based on the patient’s perception of a disease and its treatment(s)’  and are measured via validated PRO measures (PROMs). PROMs in oncological trials can be classified into two main groups: PROMs for the assessment of cancer- and treatment-related symptoms and PROMs to measure health-related quality of life (HRQoL) . Recently, two new PROMs have been proposed for each purpose: the EORTC has evaluated a digital, computer adaptive testing (CAT) version of their widely used cancer-specific HRQoL questionnaire C30 (CAT EORTC QLQ-C30) [10,11,12] and the National Cancer Institute (NCI) has validated a PROM version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) to measure cancer or treatment associated symptoms . In addition, the NCI has defined a core-set of 12 symptoms that should be reported in all cancer trials .
PROs can provide additional benefit in clinical trials as they might provide a personal assessment of the burden of a malignant disease and its treatment and might complement survival, morbidity and safety data, thus enabling a full risk-benefit assessment . Although PROs have been applied frequently in cancer trials, astonishingly little is known about the relationship between clinical endpoints and the well-being of cancer patients undergoing abdominal surgery. Arguably the most important clinical outcome in surgical oncology from a patient’s point of view is, apart from survival, the frequency and severity of complications. To this end the Clavien-Dindo classification which grades postoperative complications according to their sequelae has gained wide acceptance [15, 16]. Although it seems intuitive that complications adversely affect HRQoL and symptoms, the extent to which HRQoL and symptoms are affected is unknown. It is therefore also unclear whether complications considered more severe in the Clavien-Dindo classification system [15, 16], i.e. those with a higher severity grade, are related to reduced HRQoL or symptoms. Although several cross-sectional studies have evaluated HRQoL in patients who had undergone oncological abdominal surgery and found an association between postoperative complications and decreased long-term HRQoL [17,18,19], these results are questionable considering the design of these studies and their insufficient validity . Most of the few available prospective trials have been performed exclusively in colorectal cancer surgery and show heterogeneous results, with some demonstrating no , some short-term  and some also long-term effects of complications on certain subdomains of HRQoL [23, 24]. For other cancers of the gastrointestinal tract, including pancreatic  and oesophageal cancer , data are even more sparse. Furthermore, the majority of these studies exhibit severe methodological limitations including single-centre design, limited number of patients, inadequate follow-up, and high rate of missing data. Finally, all of these studies used a wide range of different PROMs and frequently no standardised morbidity assessment. Therefore, a prospective multicentre study using validated complication measurements and PROMs seems urgently warranted.
Student-led clinical research and learning-by-research
Although the principles of evidence-based medicine (EbM) are taught in most medical schools, the focus of most EbM curricula is on the application of EbM-principles in everyday clinical practice, but not on teaching scientific methodology or performing scientific work, i.e. generating new scientific evidence. Consequently, a future deficit in academic faculty seems likely in European countries [27,28,29].
Inquiry-based learning or learning-by-research are concepts that refer to a trend in higher education: to provide students with the opportunity to gain knowledge by conducting their own scientific inquiries or investigations. Although the underlying mechanisms still have to be revealed, projects to provide such research experiences are emerging and show that medical students can improve their clinical capabilities by contributing to student-initiated clinical trials [30,31,32]. Recently, a student-led initiative has successfully performed a number of large observational studies in a national cohort following gastrointestinal surgery demonstrating the feasibility of this concept [33, 34]. On an even larger scale the EuroSurg collaborative demonstrated the feasibility of this concept across 20 European countries . However, all of these studies were confined to specific subpopulations of patients, excluded PROMs and investigated specific rather than all postoperative complications. The study idea for the PATRONUS study was conceived by the Study network of the German Surgical Society (CHIR-Net; www.chir-net.de). CHIR-Net has succeeded in creating a German-wide research infrastructure comprising university and non-university centres. Since its foundation in 2006, CHIR-Net has recruited more than 11,800 patients in randomised-controlled surgical trials and consists of 16 regional centres and their associated partner hospitals . CHIR-Net has recently created a student-led clinical trial network (Student-initiated German Medical Audit, SIGMA; www.sigma.university)  which will run the PATRONUS study.
PATRONUS is a prospective multicentre single-arm observational cohort study across Germany.
Patient-reported outcome measures (PROMs)
a core set of 12 cancer associated symptoms  (fatigue, insomnia, pain, anorexia, dyspnoea, cognitive problems, anxiety, nausea, depression, neuropathy, constipation, diarrhoea) measured via the PRO-CTCAE .
Clinical outcome measures
Short-term clinical outcome measure is the rate of postoperative complications grade II (minor) and III-V (major) within 30 days according to the Clavien-Dindo classification .
Long-term clinical outcome is overall survival within 6 months postoperative.
The primary aim of the study is to evaluate associations between the clinical outcomes and the two PROMs in the short-term (within 30 days) and long-term (after 3 and 6 months) in order to find out whether and to what extend complications (none/grade I vs. minor (grade II) vs. major (grade III-V)) influence the two PROMS in 5 predefined surgical cancer subgroups (upper-GI, pancreatic, hepatobiliary, colorectal, other abdominal cancers).
Further objectives are:
To describe the absolute values of a.) the newly defined CAT EORTC QLQ-C30 and b.) the set of 12 cancer-specific symptoms  measured via the PRO-CTCAE  for oncologic patients undergoing surgery at predefined times from baseline (preoperative) until 6 months postoperative in the 5 surgical cancer subgroups outlined above.
Although both of the proposed PROMs (PRO-CTCAE  and CAT version of the EORTC QLQ-C30) used in this trial have been validated, they are new and have never been tested head-to-head. Therefore, the existence of possible overlapping domains in both PROMs will be analysed.
In order to find out if a student-led multicentre observational study using an electronic data capture system is feasible.
For the primary objective and further objective 1. and 2., the two PROMs (PRO-CTCAE and CAT version of the EORTC QLQ-C30) in the short-term (within 30 days) and long-term (after 3 and 6 months), as well as is the rate of postoperative complications grade II (minor) and III-V (major) within 30 days according to the Clavien-Dindo classification and the overall survival within 6 months postoperative will be assessed.
For further objective 3 the following endpoints will be assessed:
Rate of missing PRO data at 3 and 6 months
Rate of missing clinical data at 30 days
Number of participating trial sites including patients compared to initiated trial sites
Rate of included patients in comparison to screened patients
Further endpoints can be found in the description of the study visits.
Study duration and schedule
The duration of the study for each patient is 6 months including follow-up. Milestones are listed in Table 1. The duration of the overall study is expected to be 18 months. Figure 1 displays the patient flow during the study.
Study conduct and study centres
To enrol an adequate number of patients in the planned recruitment period, 30 hospitals including regional centres of the clinical trial network CHIR-Net (www.chir-net.de/regionalzentren-karte) as well as associated partner-hospitals will participate in the study.
A CHIR-Net SIGMA steering group for the PATRONUS study has been set up consisting of the authors of this publication and include the CHIR-Net coordination centre. This steering group has designed the study and is responsible for trial infrastructure, acquisition of centres, qualification of participating medical students and communication with centres and the public via digital tools (www.slack.com) and social media (www.facebook.com/sigmastudynetwork; https://twitter.com/sigmastudies).
At each trial site a so-called “mini-team” will be established consisting of an experienced clinical trialist (surgeon) and a group of at least two medical students. Furthermore, at each site a “local lead” will be appointed. The local lead is a medical student responsible for creating the mini-team, recruiting other students to the project, interacting with local surgeons and conducting the study. The local lead in conjunction with the associated surgeon is also responsible for gaining approval for the study from his/her local independent ethics committee according to the German Medical Association’s professional code (Berufsordnung der Bundesärztekammer).
All student participants will be trained prior to study initiation. To this end CHIR-Net SIGMA has developed an in-person and online clinical trials training programme (SIGMA clinical trial curriculum; SIGMA-CTC) which will be reported elsewhere.
No experimental or control intervention is tested as this is an observational, non-interventional prospective cohort study.
Every local team will recruit patients for the study independently. Inclusion criteria are: a.) patient’s age ≥ 18 years; b.) patient scheduled for elective abdominal surgery for confirmed or suspected malignancy; c.) patient’s ability to understand character of the study; d.) planned laparoscopic or open surgery or any variant (i.e. laparoscopic-assisted, laparoscopic-thoracoscopic), e.) written informed consent. Exclusion criteria are a.) language barrier that impedes follow-up or informed consent, b.) American Society of Anesthesiologists (ASA) grade ≥ 4.
All patients planned for an elective surgery for suspected or confirmed malignancy are asked for their participation in the trial if all inclusion criteria and none of the exclusion criteria are fulfilled. Screening lists are kept in order to analyse reasons for non-inclusion of patients and to calculate the case ascertainment rate.
Patient timelines and description of study visits
Patients will be screened preoperatively (visit 1) by a member of the mini-team. Patients will be enrolled if they fulfil the inclusion/exclusion criteria and after having given their written informed consent after detailed patient information. Informed consent is sought by a member of the mini-team, i.e. medical student or clinical trialist (surgeon). Baseline data and the first set of PROMs are collected during screening/baseline visit. Surgical data is collected during visit 2. Short-term clinical outcome parameters and PROMs are collected during visits 3–6 within 30 postoperative days or until discharge. Long-term clinical data and PROMs are collected at visit 7 and 8. Detailed information about the collected data during the patients’ visits is displayed in Table 2 (SPIRIT figure).
Visit 1 (preoperative, informed consent)
After informed consent, the following data items will be collected during visit 1: a.) demographic data; c.) baseline data d.) previous abdominal surgeries; e.) medical history; f.) HRQoL according to CAT EORTC QLQ-C30 [39, 40]; g.) PRO-CTCAE  of 12 core cancer-associated symptoms .
Visit 2 (surgery)
During surgery, the following parameters will be recorded: a.) duration of surgery; b.) estimated blood loss; c.) intraoperative blood transfusion; d.) surgery performed including completeness of macroscopic tumour resection; e.) category of surgery (upper-GI, pancreatic, hepatobiliary, colorectal, other); f.) degree of contamination according to the Centers for Disease Control and Prevention (CDC) definition .
Visit 3 (postoperative day 3–5)
This visit is performed to document short-term clinical outcome (complication rate). The following data items need to be documented: a.) survival; b.) discharge; c.) PRO-CTCAE symptoms; d.) reoperation(s); e.) complications according to Clavien-Dindo; f.) surgical site infections (SSI) including grading according to the CDC classification ; g.) weight.
Visit 4 (postoperative day 6–8)
Visit 4 has an equivalent content to visit 3, with the exception of the PRO-CTCAE symptoms, which are NOT documented during visit 4. If the patient is discharged before day 6–8, visit 4 is omitted.
Visit 5 (postoperative day 10–14)
Visit 5 has an equivalent content to visit 3. If the patient is discharged before day 10, visit 5 is omitted.
Visit 6 (postoperative day 30–35 or at discharge)
Visit 6 is performed once between postoperative day 30–35 or at discharge if the patient leaves before day 30. The following data items need to be documented: a.) survival; b.) PRO-CTCAE symptoms; c.) CAT EORTC QLQ-C30; d.) reoperation(s); e.) complication assessment according to the Clavien-Dindo classification; f.) SSI assessment according to the CDC classification; g.) weight.
Visit 6TEL (postoperative day 30–35)
Visit 6TEL is performed if the patient has been discharged before postoperative day 30–35. If the patient is still in hospital on day 30–35 visit 6TEL is omitted. The visit should be conducted between day 30–35. This visit can be performed in person (outpatient clinic) or, if the patient cannot be seen in person, on the phone. The following data items have to be collected: a.) survival; b.) PRO-CTCAE symptoms; c.) CAT EORTC QLQ-C30; d.) reoperation(s); e.) (re-)hospitalization; f.) complication assessment according to the Clavien-Dindo classification; g.) SSI assessment according to the CDC classification; h.) details of postoperative oncological treatment; i.) weight.
Visit 7/8 (postoperative month 3/6)
Visit 7 and 8 have equivalent contents. Visit 7 and 8 can be performed in person (in person follow-up) or as a telecommunication visit (e.g. phone). The following data items need to be recorded: a.) survival; b.) PRO-CTCAE; c.) CAT EORTC QLQ-C30; d.) weight; e.) reoperation(s); f.) (re-)hospitalization; g.) oncologic treatment; h.) complication(s) according to the Clavien-Dindo classification.
Event Visit1-x (anytime between visit 1–8)
Event visits are optional, i.e. they do not have to be performed but can be performed if necessary. The objective is to document survival, complications and/or PROs anytime during the study, i.e. between visit 1–8, if they are not covered by the other visits. The following data items should be collected: a.) date; b.) PRO-CTCAE; c.) CAT EORTC QLQ-C30; d.) survival; e.) reoperation(s); f.) hospitalization/readmission; g.) SSI assessment according to the CDC classification; h.) complication assessment according to the Clavien-Dindo classification; i.) oncological treatment; j.) weight.
As this is a non-interventional, observational study, no beneficial treatment effect is to be expected. Accordingly, no additional risk is expected for the individual participant. However, patients might benefit from more frequent and more thorough postoperative clinical visits by the local mini-teams. Furthermore, the study allows the patients to measure and feedback a number of PROMs which is not available for non-participating patients. During digital PROM evaluation patients have the opportunity to contact their local study team. Finally, the results of the study could benefit future patients by integrating and improving PROMs in the clinical treatment of cancer patients. Given the risk-benefit assessment no ancillary or post-trial care or compensation to those who suffer harm from the study is planned.
Ethical and legal aspects, informed consent
The PATRONUS study will be conducted in agreement with the Declaration of Helsinki in its current version. This study protocol has been written and the study will be conducted and analysed in accordance with relevant national and international rules and regulations including international conference of harmonization good clinical practice (ICH-GCP) guidelines.
All patients will be informed of the aims and conduct of the study to allow an individual risk-benefit assessment based on informed consent. It will be emphasised that the participation is voluntary and that the patient is allowed to refuse further participation in the study whenever he/she wants to. In case of withdrawal from the study the patient will be asked whether her/his previously collected data may be used for analysis or not. In the latter case, all pseudonymised data entered in the eCRF will be deleted.
It is the responsibility of the investigator/medical student to maintain patients’ confidentiality. During the study, patients will be identified solely by means of their individual identification code. Study specific documents and patient data will be stored in accordance with local data protection law/ ICH-GCP Guidelines at the local trial sites and will be handled in strict confidence and in line with the obligations of medical secrecy, the EU General Data Protection Regulation (Datenschutzgrundverordnung), the Federal Data Protection Act (Bundesdatenschutzgesetz) and the State Data Protection Act (Landesdatenschutzgesetz). Participating patients’ data will be recorded in pseudonymised form.
The trial may be prematurely closed by the coordinating investigators in consultation with the responsible statistician and the steering committee. Reasons that may necessitate termination of the study include a.) it appears that patients’ enrolment is unsatisfactory with respect to quality and/or quantity or data recording is severely inaccurate and/or incomplete; b.) External evidence demanding a termination of the trial. The independent ethics committee (IEC) must then be informed.
The results of the trial will be published in a peer-reviewed journal under the authorship of CHIR-Net SIGMA. All participating personel will be listed with their specific contribution. Results will be distributed to the public via www.sigma.university, www.facebook.com/sigmastudynetwork and https://twitter.com/sigmastudies.
An electronic case report form (eCRF) will be used for data collection. To assure a safe and secure environment for data acquired, the RedCap™ system (www.project-redcap.org) will be used for remote data entry . RedCap™ is validated and compliant with FDA 21 CRF part 11. Data transmission is encrypted with secure socket layer (SSL) technology. The database server is located in a secure data centre at the University of Heidelberg, Germany and is protected by a firewall. The system provides an infrastructure to support user roles and rights. Only authorised users are able to enter or edit data, the access is restricted to data of the patients in the respective centre. All changes to data are logged with a computerized timestamp in an audit trail. All clinical data will be pseudonymized. Backups are conducted regularly.
All protocol-required information collected during the study will be entered by an authorised member of the mini-team in the eCRF. For HRQoL and PRO-CTCAE results, patients may directly enter the data in the eCRF. Any outstanding entries must be completed immediately after the final examination. An explanation should be given for all missing data. The completed eCRF must be reviewed and signed by an authorised member of the mini-team.
In order to guarantee quality, validity and plausibility of data, a data validation plan is implemented which uses real-time edit-checks and validating programs, which will generate queries. The investigator, medical student or the designated representatives are obliged to clarify the edit-checks and queries.
All data will be integrated in a statistical analysis system. The data access is restricted to the data manager and the biometricians responsible for the trial. The data will be managed and analysed in accordance with the appropriate Standard Operating Procedures valid in the Institute of Medical Biometry and Informatics at the University of Heidelberg.
A study-specific data validation plan has been established ensuring that implausibility of data, missing data and imbalances between centers, e.g. reporting of postoperative complications are revealed. In this case, queries will be sent to the centres and need to be resolved by the mini-teams. In the PATRONUS study only a limited on-site monitoring will be performed. An external monitor will check, whether signed informed-consent forms are available for all patients.
Since this is an exploratory study, all analyses will be descriptive and p-values < 0.05 will be referred to as statistically significant in descriptive sense. The patient characteristics and outcomes will be described for the whole cohort and for the different subgroups divided according to tumour entity with appropriate descriptive statistics (mean, standard deviation, median, interquartile range, minimum, maximum in case of continuous data and scores, or absolute and relative frequencies in case of categorical data).
To analyse the association between perioperative complications (Clavien-Dindo grading) and the set of 12 PRO-CTCAE symptoms as well as the subscales of CAT EORTC QLQ-C30 in the short- and long-term, Spearman’s rank-correlation coefficients (Spearman’s rho) will be calculated and analysis of variance will be performed.
For the description of the absolute values of the CAT EORTC QLQ-C30 as well as the set of 12 cancer-specific symptoms measured via the PRO-CTCAE appropriate descriptive measures will be reported.
Possible overlapping between the two PROMs (PRO-CTCAE and CAT EORTC QLQ-C30) will be analysed calculating Spearman’s rhos between the respective scales.
The rates of missing PRO data, clinical data and the rate of included patients compared to screened patients will be calculated and reported with adequate descriptive measures. The number of participating trial sites including patients compared to initiated trial sites and the rate of included patients in comparison to screened patients per trial site will be calculated, as well. The achievement of the respective goal rates will be evaluated by binomial tests.
Further analysis includes correlations between ASA score, comorbidities, neoadjuvant therapy, socio-economic factors, smoking, alcohol consumption and other baseline factors and subscales of the two PROMs and complications. Survival analysis includes Kaplan-Meier graphs and log-rank-tests between different tumour entities. Cox regression analysis will be performed to evaluate possible relationships between survival and different baseline covariates.
Wherever appropriate, graphics will be created to illustrate the data and findings. Details of the statistical analysis will be described in the statistical analysis plan, which will be written prior to the database closure. For the statistical analysis, IBM SPSS Statistics Version 24 (or higher) and SAS (SAS Institute, Cary, NC, USA) version 9.4 (or higher) will be used. No interim analysis is planned.
Sample size calculation
Since this is an exploratory cohort study, no formal sample size calculation was done. Assuming 30 clinics to participate and a recruiting rate of about evaluable 30 patients per centre, we assume to have the data of about 900 patients to evaluate. This sample size is big enough to give answers with a good precision overall and in specific subgroups such as different cancer entities.
Due to the nature of the study (observational cohort study) no imputation of missing values will be provided. Appearance and frequency of missing data is examined in line with the objectives of the study.
Given the potential advantages of PROMs in clinical trials [8, 43] astonishingly little focus has been put on PROMs in surgical oncology. Here PROMs are frequently analysed inadequately (e.g. not addressing missing data) and are rarely the main focus of investigation. Consequently, very little is known about the relationship of clinical endpoints including postoperative surgical complications and PROMs in surgical oncology. In addition, previous studies investigating the relationship between PROMs and complications in abdominal cancer surgery have frequently used a cross-sectional design with inadequate validity [17,18,19] and results are thus questionable . Moreover, most studies have focused on colorectal cancer surgery only, have reported conflicting results and lacked standardized complication measurements.
Similar to our planned PATRONUS study Bosma et al. have used a prospective observational design to analyse patients undergoing colorectal surgery and found an association between the severity of complications (measured via Clavien-Dindo) and HRQoL within the first 6 weeks, but not after 12 months . However, this study had a single-centre design, used the short version of the WHO HRQoL assessment instrument , which covers no cancer-specific symptoms and is a generic, i.e. not cancer-specific HRQoL tool. In contrast, Di Cristofaro et al. reported no significant relationship between complications and global HRQoL (EORTC QLQ-C30, -CR29) in their prospective trial of 166 patients in 3 centres undergoing colorectal cancer surgery . The randomised-controlled CLASSIC trial (laparoscopic vs. open resection for colorectal cancer) reported yet another result by prospectively analysing the HRQoL (generic EQ5D and cancer-specific EORTC QLQ-C30/CR38) in 614 randomised patients . In contrast to the previous trials, significant long-term differences in QoL between patients with and without complications were found for Physical and Social Function, Role Functioning, and Body Image on EORTC QLQ-C30/QLQ-CR38 analysis and Mobility, Self-care, and Pain/Discomfort on EQ5D analysis. In line with these findings Anthony et al. reported an association with postoperative complications (no standardised evaluation) and postoperative HRQoL at 12 months using the Functional Assessment of Cancer Therapy (FACT-C) tool in 63 patients undergoing open colorectal cancer surgery . For other types of abdominal cancer entities, results are even rarer including the study by Heerkens et al. who found no statistically significant and clinically relevant differences in HRQoL (using the EORTC QLQ-C30, -PAN26 and RAND26 questionnaire) between patients with severe compared to no/mild complications following pancreatic surgery in their single centre study  and Rutegard et al. who has analysed the Swedish national cancer registry for patients undergoing oesophagectomy for cancer and reported significantly impaired HRQoL (EORTC QLQ-C30 and -OES18) at 6 months in patients who had experienced technical surgical complications .
In summary, studies investigating the relationship between postoperative complications and PROMs are sparse and many studies exhibit severe methodological shortcomings. In addition, studies have used a multitude of different PROMs impeding direct comparison of results. In the meantime, clear recommendations exist for oncological trials to focus on two PROMs, namely HRQoL (either generic, cancer-specific or cancer-type specific) and cancer specific symptoms [8, 14]. For the latter the NCI has recently published recommendations which cancer-specific symptoms should be evaluated in all cancer patients (core set of 12 symptoms) , but has not specified the tools that should be applied to measure these symptoms. The EORTC QLQ-C30 has become one of the most widely used tools to measure cancer-specific HRQoL over the last decades  and recently a computerised adaptive version has been developed but not yet tested in surgical oncology. Similarly, the PRO-CTCAE symptoms score might be a fitting candidate to assess the proposed core set of cancer symptoms but again its evaluation in surgical oncology is pending. Therefore, a prospective multicentre study using an accepted complication measurement (Clavien-Dindo classification) and the two new PROMs as planned in our PATRONUS study seems urgently warranted.
Furthermore, a direct comparison of the two tools in overlapping domains (cancer-symptoms) is pending given their so far limited application in oncology. Again this issue will be studied in our study.
Although PROMs have numerous potential advantages their true benefit has been limited and PROMs have ‘[…] rarely been informative from a licensure perspective’ . The reasons for this are methodological aspects of PROMs that are frequently not adequately addressed in clinical trials including a.) inadequate PROM development ; b.) inadequate psychometric reliability, validity and responsiveness [43, 45]; c.) lack of an a priori specification of the expected effect size, PRO domain under investigation and sample size calculation  and d.) missing data, adding to attrition bias and necessitating the a priori specification of imputation methods . While the first two aspects are not a concern for the two PROMs selected for our study, sample size calculation and missing data might be a concern, especially in surgical oncology with patients experiencing complications being less likely able to fill out PROMs. PATRONUS will create a sound database for sample size calculation for future clinical trials and will also offer a good estimate of the rate of missing data which can be expected in the context of surgical oncology and digital PROM assessment.
An important aspect of the PATRONUS study is the design and conduct by medical students. PATRONUS allows medical students to interact with concepts and methods of clinical research thereby potentially inspiring their orientation towards academic careers and work as clinician scientists [27, 28]. Although the conduct of multicentre clinical observational studies is relatively new, previous examples in the UK have shown the feasibility of this concept . However, PATRONUS will add some important aspects compared to previous studies as patients will need to undergo written informed consent, PRO evaluation is performed, the follow-up is significantly longer and the study design more complex.
The limitations of the PATRONUS study are numerous. First, it is a single-arm observational study and therefore cannot elucidate a causal relationship. It will, however, serve to generate hypotheses for future clinical research.
Second, data quality might be a concern. It is unclear if the assessment of postoperative complications performed by medical students is comparable to the assessment of trained doctors or study nurses. However, the SIGMA study group has implemented a number of measures to ensure high quality data assessment including a data validation plan (see methods section), centralized monitoring and training of participating study personnel in the SIGMA clinical trials curriculum prior to study initiation. Briefly, this curriculum includes a.) an obligatory e-learning session on the Clavien-Dindo classification; b.) lectures on the basics of evidence based medicine, levels of evidence, study types, statistical analysis plan, ethics, laws and regulatory obligations, Good Clinical Practice, and basics of data management; c.) workshops on acquiring informed consent from patients with actors and video-feedback, on how to improve patient recruitment, RedCap database training and bedside-teaching with Clavien-Dindo assessment. Within the PATRONUS study, only limited onsite monitoring will be done. An external monitor will check whether signed informed consent forms are available from all patients. However, no source data verification will be implemented. This is in contrast to the more enhanced data verification plans of other related study projects (e.g. EuroSurg Imagine trial) .
Third, as pointed out above the rate of SSIs according to CDC will be assessed as a secondary outcome parameter in our study. It is known from the analysis of RCTs, that there is an underreporting of SSIs if assessed as secondary endpoints compared to the assessment as primary endpoint . Nonetheless, as SSI are among the most frequent postoperative complications assessment seems necessary both from an education and clinical perspective.
Fourth, as this is the first student-led study in Germany and of the CHIR-Net SIGMA group, feasibility and recruitment is unclear. Finally, many aspects of the concept of student-led clinical research warrant further evaluation.
Ethical approval was granted by the independent ethics committee of the Medical Faculty of the University of Heidelberg on 11th September 2017 (version 1.1; reference S-466/2017) and patient recruitment started in February 2018.
(electronic) Case Report Form
American Society of Anesthesiologists
Computer adaptive testing
Centers for Disease Control and Prevention
- CHIR-Net :
Clinical trial network of the German Surgical Society
Common Terminology Criteria of Adverse Events
Deutsches Register Klinische Studien (German Clinical Trials Register)
European Organisation for Research and Treatment of Cancer
Health-related quality of life
U.S. National Cancer Institute
Patient Reported Outcome
Patient Reported Outcome Measure
Quality of Life Questionnaire
Serious Adverse Event
Student-Initiated German Medical Audit
SIGMA Clinical Trial Curriculum
Surgical Site Infection
Statistisches Bundesamt. Todesursachen in Deutschland. 2015. www.destatis.de/DE/Publikationen/Thematisch/Gesundheit/Todesursachen/Todesursachen.html.
Motel-Klingebiel A, Wurm S, Tesch-Römer C. Altern im Wandel: Befunde des Deutschen Alterssurveys. Kohlhammer Verlag; 2010.
Statistisches Bundesamt. Bevölkerung Deutschlands bis 2060. 12. koordinierte Bevölkerungsvorausberechnung. Wiesbaden; 2009.
Suzman R, Beard J. Global Health and aging. In: World Health Organization; 2011.
Robert-Koch Institut, Gesellschaft der epidemiologischen Krebsregister in Deutschland e. V. Krebs in Deutschland 2011/2012. E. 2015.
Extermann M, Aapro M, Bernabei R, Cohen HJ, Droz J-P, Lichtman S, et al. Use of comprehensive geriatric assessment in older cancer patients: recommendations from the task force on CGA of the International Society of Geriatric Oncology (SIOG). Crit Rev Oncol Hematol. 2005;55:241–52.
Scotté F, Bossi P, Carola E, Cudennec T, Dielenseger P, et al. Addressing the quality of life needs of older patients with cancer: a SIOG consensus paper and practical guide. Ann Oncol. 2018;29(8):1718–26. https://doi.org/10.1093/annonc/mdy228.
EMEA. The use of patient-reported outcome (PRO) measures in oncology studies. In: Appendix 2 to the guideline on the evaluation of anticancer medicinal products in man; 2016.
Deshpande PR, Rajan S, Sudeepthi BL, Abdul Nazir CP. Patient-reported outcomes: a new era in clinical research. Perspect Clin Res. 2011;2:137–44.
Gamper E-M, Petersen MA, Aaronson N, Costantini A, Giesinger JM, Holzner B, et al. Development of an item bank for the EORTC role functioning computer adaptive test (EORTC RF-CAT). Health Qual Life Outcomes. 2016;14:72.
Gamper E-M, Groenvold M, Petersen MA, Young T, Costantini A, Aaronson N, et al. The EORTC emotional functioning computerized adaptive test: phases I-III of a cross-cultural item bank development. Psychooncology. 2014;23:397–403.
Petersen MA, Aaronson NK, Chie W-C, Conroy T, Costantini A, Hammerlid E, et al. Development of an item bank for computerized adaptive test (CAT) measurement of pain. Qual Life Res. 2016;25:1–11.
Basch E, et al. Development of the National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Natl Cancer Inst. 2014;106(9):dju244.
Reeve BB, Mitchell SA, Dueck AC, Basch E, Cella D, Reilly CM, et al. Recommended patient-reported core set of symptoms to measure in adult cancer treatment trials. J Natl Cancer Inst. 2014;106.
Clavien PA, Barkun J, de Oliveira ML, Vauthey JN, Dindo D, Schulick RD, et al. The Clavien-Dindo classification of surgical complications: five-year experience. Ann Surg. 2009;250:187–96.
Dindo D, Demartines N, Clavien P-A. Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg. 2004;240:205–13.
Hornbrook MC, Wendel CS, Coons SJ, Grant M, Herrinton LJ, Mohler MJ, et al. Complications among colorectal cancer survivors: SF-6D preference-weighted quality of life scores. Med Care. 2011;49:321–6.
Pucciarelli S, Del Bianco P, Efficace F, Toppan P, Serpentini S, Friso ML, et al. Health-related quality of life, faecal continence and bowel function in rectal cancer patients after chemoradiotherapy followed by radical surgery. Support Care Cancer. 2010;18:601–8.
Bloemen JG, Visschers RGJ, Truin W, Beets GL, Konsten JLM. Long-term quality of life in patients with rectal cancer: association with severe postoperative complications and presence of a stoma. Dis Colon Rectum. 2009;52:1251–8.
Hamming JF, De Vries J. Measuring quality of life. Br J Surg. 2007;94:923–4.
Di Cristofaro L, Ruffolo C, Pinto E, Massa M, Antoniutti M, Cagol M, et al. Complications after surgery for colorectal cancer affect quality of life and surgeon-patient relationship. Color Dis. 2014;16:O407–19.
Bosma E, Pullens MJJ, de Vries J, Roukema JA. The impact of complications on quality of life following colorectal surgery: a prospective cohort study to evaluate the Clavien-Dindo classification system. Color Dis. 2016;18:594–602.
Brown SR, Mathew R, Keding A, Marshall HC, Brown JM, Jayne DG. The impact of postoperative complications on long-term quality of life after curative colorectal cancer surgery. Ann Surg. 2014;259:916–23.
Anthony T, Long J, Hynan LS, Sarosi GA, Nwariaku F, Huth J, et al. Surgical complications exert a lasting effect on disease-specific health-related quality of life for patients with colorectal cancer. Surgery. 2003;134:119–25.
Heerkens HD, et al. Long-term health-related quality of life after pancreatic resection for malignancy in patients with and without severe postoperative complications. HPB (Oxford). 2018;20(2):188–95.
Rutegård M, Lagergren J, Rouvelas I, Lindblad M, Blazeby JM, Lagergren P. Population-based study of surgical factors in relation to health-related quality of life after oesophageal cancer resection. Br J Surg. 2008;95:592–601.
Reinders JJ, Kropmans TJB, Cohen-Schotanus J. Extracurricular research experience of medical students and their scientific output after graduation. Med Educ. 2005;39:237.
Segal S, Lloyd T, Houts PS, Stillman PL, Jungas RL, Greer RB. The association between students’ research involvement in medical school and their postgraduate medical activities. Acad Med. 1990;65:530–3.
Adler G, Vd Knesebeck JH. Shortage and need of physicians in Germany? Questions addressed to health services research. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2011;54:228–37.
Chapman SJ, Glasbey JCD, Khatri C, Kelly M, Nepogodiev D, Bhangu A, et al. Promoting research and audit at medical school: evaluating the educational impact of participation in a student-led national collaborative study. BMC Med Educ. 2015;15:47.
Wickramasinghe DP, Perera CS, Senarathna S, Samarasekera DN. Patterns and trends of medical student research. BMC Med Educ. 2013;13:175.
Nikkar-Esfahani A, Jamjoom AAB, Fitzgerald JEF. Extracurricular participation in research and audit by medical students: opportunities, obstacles, motivation and outcomes. Med Teach. 2012;34:e317–24.
STARSurg Collaborative. Multicentre prospective cohort study of body mass index and postoperative complications following gastrointestinal surgery. Br J Surg. 2016;103:1157–72.
Stars C. Safety of nonsteroidal anti-inflammatory drugs in major gastrointestinal surgery: a prospective. Multicenter Cohort Study World J Surg. 2017;41:47–55.
EuroSurg Imagine Trial. EuroSurg. 2017. http://eurosurg.org/imagine-hub/.
Neudecker J, Tenckhoff S, Mihaljevic AL. Patient-oriented multicentre research in surgery: the Surgical Trial Network (CHIR-Net). Z Evid Fortbild Qual Gesundhwes. 2015;109:211–7.
Frey P, Friedrich M, Rädeker L, Fink F, Leuk A, Tenckhoff S, et al. Encouraging student-driven clinical research in Germany: the CHIR-net SIGMA network. Innovative surgical science. Accepted for publication 6th Nov. 2017.
Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;e7586:346.
EORTC. Questionnaires at EORTC. http://qol.eortc.org/questionnaire/eortc-qlq-c30/. Accessed 22 Nov 2015.
EORTC. Computerized adaptive testing version of the QLQ-C30. http://qol.eortc.org/cat/. Accessed 7 July 2017.
Mangram AJ, Horan TC, Pearson ML, Silver LC, Jarvis WR. Guideline for prevention of surgical site infection, 1999. Centers for Disease Control and Prevention (CDC) hospital infection control practices advisory committee. Am J Infect Control. 1999;27:97–132 quiz 133–4; discussion 96.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81.
FDA. Guidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. 2009.
Development of the World Health Organization WHOQOL-BREF quality of life assessment. The WHOQOL group. Psychol Med. 1998;28:551–8.
Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2:i–iv 1–74.
Basch E, Abernethy AP, Mullins CD, Reeve BB, Smith ML, Coons SJ, et al. Recommendations for incorporating patient-reported outcomes into clinical comparative effectiveness research in adult oncology. J Clin Oncol. 2012;30:4249–55.
Chapman SJ, EuroSurg Collaborative. Ileus management international (IMAGINE): protocol for a multicentre, observational study of ileus after colorectal surgery. Color Dis. 2018;20:O17–25.
Matthews JH, Bhanderi S, Chapman SJ, Nepogodiev D, Pinkney T, Bhangu A. Underreporting of secondary endpoints in randomized trials: cross-sectional. Observational Study Ann Surg. 2016;264:982–6.
We would like to thank Morten Aagaard Petersen, M.Sc. and the team at the Research Unit, Department of Palliative Medicine, Bispebjerg Hospital, University of Copenhagen for their kind support of our project and their willingness to share their knowledge on and their infrastructure for the CAT EORTC QLQ-C30 with us.
We acknowledge financial support by Deutsche Forschungsgemeinschaft within the funding programme Open Access Publishing, by the Baden-Württemberg Ministry of Science, Research and the Arts and by Ruprecht-Karls-Universität Heidelberg.
This publication is based on the current protocol version 1.1 of the PATRONUS study (approved by the Heidelberg ethics committee on 11th September 2017)
Availability of data and materials
Data sharing is not applicable to this article as no datasets were generated or analysed. The pseudonymised data of the PATRONUS study will be available to the participating clinical trials sites for further analyses given that the planned post-hoc analyses are performed in accordance with data protection laws and ICH-GCP guidelines. Anonymized data of the PATRONUS study may be available to other researchers given that their planned analyses are performed in accordance with data protection laws and ICH-GCP guidelines. The SIGMA PATRONUS steering group will decide individually on all planned post-hoc analyses.
Ethics approval and consent to participate
Ethical approval was granted by the independent ethics committee of the Medical Faculty of the University of Heidelberg on 11 September 2017 (version 1.1; reference S-466/2017) including the patient information material and informed consent form. The ethic approval of other participating centres is currently sought. All protocol amendments must be reported to and approved by the participating independent ethics committees.
Consent for publication
Patients must give their written informed consent prior to inclusion into the study. The informed consent form for the trial was approved by the independent ethics committee of the Medical Faculty of the University of Heidelberg on 11 September 2017 (see above). All authors have read the manuscript and gave their consent for publication.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Patient-reported outcome measures
- Quality of life
- Postoperative complications
- General surgery
- Digestive system surgical procedures