The One-stop trial: Does electronic referral and booking by the general practitioner (GPs) to outpatient day case surgery reduce waiting time and costs? A randomized controlled trial protocol
- Knut Magne Augestad†1, 2Email author,
- Arthur Revhaug2, 3,
- Barthold Vonen2, 3,
- Roar Johnsen4 and
- Rolv-Ole Lindsetmo†2, 3, 5
© Augestad et al; licensee BioMed Central Ltd. 2008
Received: 25 June 2008
Accepted: 11 August 2008
Published: 11 August 2008
Waiting time and costs from referral to day case outpatient surgery are at an unacceptably high level. The waiting time in Norway averages 240 days for common surgical conditions. Furthermore, in North Norway the population is scattered throughout a large geographic area, making the cost of travel to a specialist examination before surgery considerable. Electronic standardised referrals and booking of day case outpatient surgery by GPs are possible through the National Health Network, which links all health care providers in an electronic network. New ways of using this network might reduce the waiting time and cost of outpatient day case surgery.
Materials and Methods
In a randomised controlled trial, selected patients (inguinal hernia, gallstone disease and pilonidal sinus) referred to the university hospital are either randomised to direct electronic referral and booking for outpatient surgery (one stop), or to the traditional patient pathway where all patients are seen at the outpatient clinic several weeks ahead of surgery.
Consultants in gastrointestinal surgery designed standardised referral forms and guidelines. New software has been designed making it possible to implement referral forms, guidelines and patient information in the GP's electronic health record. For "one-stop" referral, GPs must provide mandatory information about the specific condition. Referrals were linked to a booking system, enabling the GPs to book the hospital, day and time for outpatient surgery. The primary endpoints are waiting time and costs. The sample size calculation was based on waiting time. A reduction in waiting time of 60 days (effect size), 25%, is significant, resulting in a sample size of 120 patients in total.
Poor communication between primary and secondary care often results in inefficiencies and unsatisfactory outcomes. We hypothesised that standardised referrals would improve the quality of information, making it feasible to use a one-stop approach for all patients undergoing surgery on an outpatient basis for inguinal hernia, pilonidal sinus and gallstones.
In this study we wanted to investigate the waiting time and cost-effectiveness of direct electronic referral and booking of outpatient surgery compared to the traditional patient pathway, where the patient is seen at the outpatient clinic prior to surgery.
This trial has been registered at ClinicalTrials.gov. The trial registration number is: NCT00692497
The shift from inpatient to outpatient care is drawing attention to the role of the outpatient clinic and day case surgery. An increased focus on cost benefit and waiting time for examination and treatment of surgical patients has made it necessary to develop new strategies for referral routines and the patient flow between primary and secondary care. One-stop day case surgery, i.e. day case surgery based upon standardised referrals, may be a solution for selected surgical patients [1, 2].
In Norway, all patients with an inguinal hernia, gallstones, or pilonidal sinus are primarily examined by a general practitioner (GP). The GP performs a regular clinical examination, and they refer the patient to examination at the surgical outpatient clinic, at the same time forwarding supplemental clinical information about the patient (i.e. age, sex, social status, other diseases and clinical conditions, medication). The referrals are not standardised. Within three weeks, a hospital doctor must read the referral and draw up a treatment or investigation plan. A time schedule for the outpatient clinic examination is proposed on the basis of the information in the referral and the availability of appointments for examinations. All patients are then examined by a surgeon at the outpatient clinic, who in turn refers the patient to outpatient surgery. This in-hospital referral must be read and prioritised by a senior hospital surgeon within two weeks before a final schedule for an operation for the patient is decided.
Waiting time reported by the Norwegian Directorate for Health and Social Affairs for surgical outpatient examination and surgery in Norway, February 2008 .
The newly established Norwegian National Health Network  has given us the potential to improve the communication between levels of the health care providers. The National Health Network is intended to support exchange of information and enable affiliated organisations to offer professional support, medical services and administrative services in the network. From a single connection point, users should be able to communicate with all the other participants connected to the network.
The main objectives of the present study were to assess whether standardised electronic referrals based on guidelines and booking of outpatient surgery by the GPs would decrease waiting time and increase the cost-effectiveness of day case outpatient surgery for patients with inguinal hernia, pilonidal sinus and gallstone disease.
Methods and Design
In the county of Troms there are 31 community GP practices with 140 GPs. All these GP practices are connected to the Norwegian National Health Network. Approximately 80% of these GPs are using the electronic health record ProfdocWinmed. Guidelines and referral forms will be implemented in this electronic health record during a three-month period for all GPs who agree to participate in the trial.
Department of Digestive Surgery at a University Hospital
The University Hospital is located at three different geographical sites, with one large teaching university clinic and two local hospitals. The Department of Digestive Surgery is divided into clinics located at the different hospitals. All these clinics perform the outpatient surgical procedures included in the trial (Pilonidal sinus: Bascom plasty. Inguinal hernia: Lichtenstein repair. Gallstone disease: laparoscopic cholecystectomy)
Patients are eligible if they have been diagnosed by their GP for an inguinal hernia, sinus pilonoidalis or gallstone disease requiring surgical treatment. Patients with medical conditions making them unfit for outpatient surgery who are admitted to the surgical department prior to surgery are not eligible. In 2007, 366 patients were surgically treated at the Day Case Surgical Department for these three conditions. Patients will be included after giving written informed consent.
The one-stop strategy is a set of interventions directed at GPs referring patients to the University Hospital. The interventions include: Guidelines for referral, standardised electronic referrals, booking for outpatient surgery and a patient information form.
Guidelines for referral: Guidelines for inguinal hernia, sinus pilonoidalis and gallstone disease were developed (Figure 3). All surgeons performing the surgical procedures reviewed the giudelines, and after a three-month period consensus was reached. The guidelines consisted of signs and symptoms for the condition, indications and contraindications for surgery, necessary blood samples and radiological examinations prior to surgery (for gallstone disease). Photographs of the condition were included in the guidelines for sinus pilonoidalis and inguinal hernia. These guidelines were implemented in the GPs electronic health record.
Standardised referral forms: Standardised referral forms were developed by specialists in gastrointestinal surgery in cooperation with GPs (Figure 2). These referral forms consisted of three parts: information needed for anaesthesia (mandatory), information needed for surgeons (mandatory) and additional information provided by the GPs. These referral forms were implemented in the GPs' electronic health records (Profdoc Winmed).
Booking of time, date and hospital for surgery: The booking system is integrated in the electronic health record (Profdoc Winmed); booking is done at the same time as referral. Patients can choose the optimal time and hospital for surgery. The system is managed by the Day Case Surgical Department. Available times and locations for surgery during a 6-month period are presented. Surgical capacity that has not been booked within two weeks of the relevant date is withdrawn and offered to patients who are not participating in the trial.
Patient information form: A patient information form (printable, integrated in the electronic health record) was prepared by a specialist in gastrointestinal surgery. The form included information about the place and time for surgery, information about the surgical procedure, and advice for the patient following surgery. Information about possible complications of surgery was also provided.
The control group consists of patients randomised to use the regular patient pathway prior to day case outpatient surgery. All these patients are referred to the surgical outpatient clinic. At the outpatient clinic patients are examined by a surgeon, who determines whether surgery is indicated. If so, patients are referred to outpatient surgery and the surgical procedure is performed several weeks after the examination.
We wish to test the efficacy of the one-stop strategy in decreasing waiting time and increasing the cost-effectiveness of selected day case surgical outpatient procedures. We hypothesise that patients exposed to the one-stop strategy (intervention) will have decreased waiting time and increase the cost-effectiveness for the hospital, compared to patients who use the regular patient pathway, i.e. examination at the surgical outpatient clinic prior to outpatient surgery.
Waiting time for outpatient surgery
This time interval will be calculated retrospectively and compared between the two groups. The waiting time specified by health authorities is unreliable (Table 1); waiting time must therefore be calculated separately for each individual using dates from the electronic health record. This will consist of the following dates: the date the referral is noted in the hospital electronic health record, the date of outpatient examination (for the control group) and the date of outpatient surgery.
We will use a cost-minimisation analysis in this study, since this health care intervention has a similar medical outcome for both groups, i.e. surgical outpatient treatment . The analysis will have a public health provider perspective. This includes travel costs, since the public health service pays for these costs in Norway. Direct health care costs that are the same in both alternatives will be excluded. The costs for the GPs providing this service will include investment, support, and time costs. Costs of traditional referral will include hospital administration, examination at the Surgical Outpatient Department (surgeon time, nurse time), surgical treatment at the Department of Day Case Surgery (surgeon time, anaesthetist time, and nurse time) unused surgical capacity due to incorrect referral, and patient travel costs. All costs will be estimated separately and compared between the two groups.
We will then conduct a threshold analysis. This analysis calculates the number of patients needed to break even, i.e. where the cost of providing a one-stop service equals the cost of traditional referrals.
This value is given by:
Total cost of one-stop service = Total cost of traditional referral
FOS + xVOS = FTR + xVTR
X = (FOS + FTR)/(VOS - VTR)
X = number of consultations; F = fixed costs; V = variable costs; OS = one-stop; TR = traditional referral;
All GPs participating will be posted a questionnaire when all patients have been included. This questionnaire will primarily be designed to evaluate the GPs. satisfaction with the new software, focusing on areas such as user friendliness and time consumption.
Identify patients who meet the inclusion criteria according to guidelines provided in the electronic health record.
Obtain written informed consent from all eligible patients.
Call the randomisation centre at the University Hospital. The patient is then registered in the study database and thereby automatically randomised to either the one-stop approach or the traditional patient pathway.
If the patient is randomised to the intervention group, the standardised referral forms provided by the electronic health record must be used. If the patient is randomised to the control group, the traditional referral forms (also provided y the electronic health record) with no mandatory information regarding the specific disease must be used.
If randomised to the intervention group: book place, time and date of surgery
Print the information form about the surgical procedure and where and when to meet for surgery and give to the patient.
To calculate the sample size needed, we identified all patients who had undergone the specified surgical procedures within three months of normal surgical activity (September, October and November 2007). Of these 33 patients, 22 patients could be included in a one-stop protocol. The rest of the patients were not eligible due to different patient pathways.
Mean waiting time for examination and surgical treatment for selected day case prcedures at a University Hospital during a three-month period of normal activity.
GP referral to examination at the surgical outpatient clinic (days)
Internal hospital referral to day case surgery (days)
Total waiting time (days)
Waiting timea (mean)
Based upon calculations in Table 2, we assume that there is no significant difference in waiting time between the three groups. Alpha and beta were set at 0.05 and 0.2 respectively. We estimate that a significant decrease in mean waiting time for surgery would be 60 days. The standard deviation is estimated as 120 days. We assume an exclusion rate of 20%, so that a sample size of 60 patients in each group is required.
Patients will be randomised at the time of referral by the GP. The randomization service is telephone-based and managed by the University Hospital. Patients are stratified into three groups according to their diagnosis.
To avoid bias, surgeons and administrative personnel are blinded to patients' status in the trial. Referrals of pilonidal sinus, gallstone disease and inguinal hernia to the surgical outpatient clinic will be examined by the principal investigator. The examining and operating surgeon at the surgical department will be blinded to all data concerning the one-stop trial. Patients enrolled in the trial will be mixed with patients referred to the surgical outpatient department by GPs not participating in the trial.
Data are collected in the intervention group and control group in identical ways. Outpatient surgery is performed on a weekly basis, therefore hospital charts will be reviewed weekly. The study has been approved by the Norwegian Data Inspectorate. All data will be handled with strict confidentiality, and study reports or presentations will maintain the anonymity of patients, surgeons, GPs and hospitals. Data collection will be complete by the end of 2009.
Treatment arms will be compared with respect to potential covariates using continuous and categorical variables. This will include variables related to patients (sex, age, type of disease, date of referral, date of outpatient examination, date of outpatient surgery), cost (patient sick leave, GP examination, hospital administration, surgical outpatient examination, surgical outpatient treatment, unused surgical capacity due to incorrect referral, patient travel cost). The results will be presented as intention-to-treat analyses and treatment analyses.
The results will be expressed as an odds ratio (for binary outcomes), hazard ratio (time to event outcomes) or mean difference (for continuous outcomes) with corresponding standard errors, 95% confidence intervals and associated p-values. For all two-sided tests we use alpha = 0.05 level of significance.
The Regional Committee for Medical Research Ethics, North Norway approved this protocol (P REK NORD 122/2006). Patients must provide written informed consent before entering the trial.
The one-stop trial will assess the one-stop strategy, which is designed to decrease waiting time and improve cost-effectiveness for surgical outpatient treatment.
In a Spanish study the delay from referral until surgery was reduced by 60% and the number of trips for appointments was reduced by 66.6% . Because of its feasibility, acceptability, and cost-efficiency, the direct referral system has the potential to improve relations between primary and specialised care and enhance the quality of care by shortening the delay to treatment. In a study from 2004, patients were sent an appointment for "one-stop" inguinal hernia treatment . It was concluded that patients with unilateral primary inguinal hernias can be seen, assessed and treated on the same day. One-stop inguinal hernia surgery reduces the number of patient visits to the hospital and could be expanded to incorporate many more hernia repairs and other day case procedures.
Other surgical conditions have also been shown to be suitable for improved referral routines, communication and patient logistics between the primary and secondary interface. Better communication between referral centres and GPs combined with continuing medical education programmes may be useful tools to improve appropriate management for surgical patients with faecal incontinence . One-stop clinics have been reported to improve examination and treatment of patients with head and neck lumps [9, 10]. Rectal bleeding clinics can facilitate early diagnosis of colorectal malignancy and can also provide a "one-stop shop" for treating benign anorectal conditions [11–14]. A recent study  is presenting the "Lower Gastrointestinal Electronic Referral Protocol" which was developed to be used alongside the national Choose and Book programme . A dedicated referral protocol addressing all colorectal symptoms would significantly reduce delays in patient pathways with 'straight to test' in secondary care .
A general-practice-led model of integrated care can significantly reduce outpatient attendance while improving patient experience for patients with menorrhagia [17, 18]. For patients with lower urinary tract symptoms and hematuria, a guideline-based open-access investigation service streamlined the process of outpatient referral and resulting in a decrease in waiting time and fewer outpatient investigations . For patients with breast lumps, a one-stop clinic approach and referral guidelines have been shown to be feasible [20–22].
After the introduction of the Norwegian Health Care network, all referrals and discharge letters from hospitals in North Norway are sent electronically between primary and secondary care. Despite this improvement, poor communication often results in inefficiencies and unsatisfactory outcomes. Studies show that both referral and discharge letters were missing vital medical information, referral letters to such an extent that it might represent a health hazard to older patients . Furthermore, poor communication results in unnecessary consultations, as well as delay in diagnosis and treatment [24–26].
This study is defined as a complex intervention, i.e. an intervention that includes several components (guidelines, electronic standardised referral and booking for outpatient surgery) . This trial is directed at health professional behaviour with a strategy for implementing guidelines and computerised decision support. According to Campbell et al., it is useful to consider the process of development and evaluation of such interventions as having several distinct phases (theory, modelling, exploratory trial, definitive randomised controlled trial and long-term implementation). In this trial we will follow these phases, where this study protocol describes these phases and how we will conduct the definitive randomised trial.
An important decision in trials of complex interventions is whether health outcome needs to be assessed. In this "one-stop trial", all patients are receiving the same treatment (day case surgery) in both trial arms. In our opinion it is therefore sufficient to investigate the possible change of health care behaviour, decreased waiting time and increased cost benefit induced by the intervention.
In this trial we chose a RCT design involving nonpharmacologic treatment based upon the CONSORT guidelines . We found that a cluster randomised trial was not feasible, to avoid bias among the clusters and difficulties in estimating within and between cluster components of variance. A cluster randomised trial would also increase the sample size [28–30]. The primary consequence of adopting a cluster randomised design is that it is not as statistically efficient and has a lower statistical power than a randomised trial of equivalent size .
A trial has reported a negative outcome of implementing referral guidelines among GPs for patients with lower bowel symptoms. In this study GPs were offered an electronic interactive referral pro forma. This interactive electronic referral was not integrated in the electronic health record . However, in the present one-stop trial guidelines, electronic referral and booking will be fully integrated in the GP's electronic health records. This will decrease workload and probably increase enthusiasm among the GPs participating in the project.
Funding: This trial has been funded by the North Norwegian Regional Hospital Trust.
The authors acknowledge Well Diagnostics and Profdoc for the design and implementation of the software in the GPs electronic health record. The authors acknowledge all medical doctors at the Department of Gastrointestinal Surgery, University Hospital of North-Norway for the review of the elctronic referral handbook.
- Cerdan Carbonero MT, Sanz Lopez R, Martinez Ramos C: Improving communication between levels of health care: direct referral of patients to a one-stop service for major outpatient surgery. Aten Primaria. 2005, 35 (6): 283-287. 10.1157/13073412.View ArticlePubMed
- Putnis S, Merville-Tugg R, Atkinson S: 'One-stop' inguinal hernia surgery--day-case referral, diagnosis and treatment. Ann R Coll Surg Engl. 2004, 86 (6): 425-427. 10.1308/147870804506.PubMed CentralView ArticlePubMed
- Norwegian Directorate for Health and Social Affairs; Free Hospital Choice Norway . [http://www.frittsykehusvalg.no/sidemaler/VisStatiskInformasjon____2156.aspx]
- Health NM: Te@mwork 2007, Electronic Cooperation in the Health and Social Sector, National strategy 2004 – 2007 for Norway. [http://www.shdir.no/vp/multimedia/archive/00010/IS-1267_E_10176a.pdf]
- Cobelt G: Health economics: An introduction to economic evaluation. 2002, London , Office of Health Economics, 131-1
- Moher D, Schulz KF, Altman DG: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357 (9263): 1191-1194. 10.1016/S0140-6736(00)04337-3.View ArticlePubMed
- Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P: Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008, 148 (4): 295-309.View ArticlePubMed
- Thekkinkattil DK, Lim M, Finan PJ, Sagar PM, Burke D: Awareness of investigations and treatment of faecal incontinence among the general practitioners: a postal questionnaire survey. Colorectal Dis. 2007
- Speirs A, Rajalakshmi R, Violaris N, Howlet D: The benefits of ultrasound clinics alongside head and neck one-stop clinics. Clin Otolaryngol. 2007, 32 (2): 144-10.1111/j.1365-2273.2007.01377.x.View ArticlePubMed
- Witcher TP, Williams MD, Howlett DC: "One-stop" clinics in the investigation and diagnosis of head and neck lumps. Br J Oral Maxillofac Surg. 2007, 45 (1): 19-22. 10.1016/j.bjoms.2006.03.018.View ArticlePubMed
- Smith RA, Oshin O, McCallum J, Randles J, Kennedy S, Delamere S, Rooney PS, Carter PS: Outcomes in 2748 patients referred to a colorectal two-week rule clinic. Colorectal Dis. 2007, 9 (4): 340-343. 10.1111/j.1463-1318.2006.01048.x.View ArticlePubMed
- Lee JS, Rieger NA, Stephens JH, Hewett PJ, Rodda DJ, Lawrence MJ: Six-year prospective analysis of the rectal bleeding clinic at the Queen Elizabeth Hospital, Adelaide, South Australia. ANZ J Surg. 2007, 77 (7): 553-556. 10.1111/j.1445-2197.2007.04150.x.View ArticlePubMed
- Agaba AE, Berry N, Agaba PO, Charaklias N, Wong LS: One stop rectal bleeding clinic: the coventry experience. Int Surg. 2006, 91 (5): 288-290.PubMed
- Davies E, van der Molen B, Cranston A: Using clinical audit, qualitative data from patients and feedback from general practitioners to decrease delay in the referral of suspected colorectal cancer. J Eval Clin Pract. 2007, 13 (2): 310-317. 10.1111/j.1365-2753.2006.00820.x.View ArticlePubMed
- John SK, George S, Howell RD, Primrose JN, Fozard JB: Validation of the lower gastrointestinal electronic referral protocol. Br J Surg. 2008, 95 (4): 506-514. 10.1002/bjs.5908.View ArticlePubMed
- Dennison J, Eisen S, Towers M, Ingham Clark C: An effective electronic surgical referral system. Ann R Coll Surg Engl. 2006, 88 (6): 554-556. 10.1308/003588406X130642.PubMed CentralView ArticlePubMed
- Julian S, Naftalin NJ, Clark M, Szczepura A, Rashid A, Baker R, Taub N, Habiba M: An integrated care pathway for menorrhagia across the primary-secondary interface: patients' experience, clinical outcomes, and service utilisation. Qual Saf Health Care. 2007, 16 (2): 110-115. 10.1136/qshc.2005.016782.PubMed CentralView ArticlePubMed
- Lotfallah H, Farag K, Hassan I, Watson R: One-stop hysteroscopy clinic for postmenopausal bleeding. J Reprod Med. 2005, 50 (2): 101-107.PubMed
- Thomas RE, Grimshaw JM, Mollison J, McClinton S, McIntosh E, Deans H, Repper J: Cluster randomized trial of a guideline-based open access urological investigation service. Fam Pract. 2003, 20 (6): 646-654. 10.1093/fampra/cmg605.View ArticlePubMed
- Dey P, Bundred N, Gibbs A, Hopwood P, Baildam A, Boggis C, James M, Knox F, Leidecker V, Woodman C: Costs and benefits of a one stop clinic compared with a dedicated breast clinic: randomised controlled trial. Bmj. 2002, 324 (7336): 507-10.1136/bmj.324.7336.507.PubMed CentralView ArticlePubMed
- Patel RS, Smith DC, Reid I: One stop breast clinics--victims of their own success? A prospective audit of referrals to a specialist breast clinic. Eur J Surg Oncol. 2000, 26 (5): 452-454. 10.1053/ejso.1999.0920.View ArticlePubMed
- Patkar V, Hurt C, Steele R, Love S, Purushotham A, Williams M, Thomson R, Fox J: Evidence-based guidelines and decision support services: A discussion and evaluation in triple assessment of suspected breast cancer. Br J Cancer. 2006, 95 (11): 1490-1496. 10.1038/sj.bjc.6603470.PubMed CentralView ArticlePubMed
- Garasen H, Johnsen R: The quality of communication about older patients between hospital physicians and general practitioners: a panel study assessment. BMC Health Serv Res. 2007, 7: 133-10.1186/1472-6963-7-133.PubMed CentralView ArticlePubMed
- Epstein RM: Communication between primary care physicians and consultants. Arch Fam Med. 1995, 4 (5): 403-409. 10.1001/archfami.4.5.403.View ArticlePubMed
- Molloy E, O'Hare JA: Unravelling referrals to medical outpatients. Ir Med J. 2003, 96 (5): 145-146.PubMed
- Gandhi TK, Sittig DF, Franklin M, Sussman AJ, Fairchild DG, Bates DW: Communication breakdown in the outpatient referral process. J Gen Intern Med. 2000, 15 (9): 626-631. 10.1046/j.1525-1497.2000.91119.x.PubMed CentralView ArticlePubMed
- Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. Bmj. 2000, 321 (7262): 694-696. 10.1136/bmj.321.7262.694.PubMed CentralView ArticlePubMed
- Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG, Donner A: Methods in health service research. Evaluation of health interventions at area and organisation level. Bmj. 1999, 319 (7206): 376-379.PubMed CentralView ArticlePubMed
- Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG: Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999, 3 (5): iii-92.PubMed
- Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. Bmj. 2004, 328 (7441): 702-708. 10.1136/bmj.328.7441.702.PubMed CentralView ArticlePubMed
- Newton J, Eccles M, Hutchinson A: Communication between general practitioners and consultants: what should their letters contain?. Bmj. 1992, 304 (6830): 821-824.PubMed CentralView ArticlePubMed
- Jiwa M, Skinner P, Coker AO, Shaw L, Campbell MJ, Thompson J: Implementing referral guidelines: lessons from a negative outcome cluster randomised factorial trial in general practice. BMC Fam Pract. 2006, 7: 65-10.1186/1471-2296-7-65.PubMed CentralView ArticlePubMed
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2482/8/14/prepub