Research Article|Articles in Press

Validation of the Spanish electronic version of the BREAST-Q questionnaire

Published:April 20, 2023DOI:



      Patient-reported outcome measures (PROMs) have gained considerable interest in health care moving beyond traditional outcome measures of morbidity and mortality. In breast cancer surgery, women's’ perceptions of appearance, function and quality of life have become increasingly important. The BREAST-Q questionnaire is a validated PROM for use in cosmetic and reconstructive breast surgery in clinical practice. The objective of this study was to validate the Spanish electronic version of the BREAST-Q questionnaire, to verify the measurement equivalence of digital and paper versions and to identify the possible disadvantages and advantages of implementing this new tool.


      The study population included 113 patients undergoing breast cancer survey at a single hospital in Barcelona (Spain) who were able to complete both the electronic and paper versions of the preoperative module of the BREAST-Q questionnaire.


      The intraclass correlation coefficient (ICC) in the four domains of the questionnaire between the two versions of the questionnaire was >0.9, with a weighted kappa of >0.74 at item level. The reliability of the internal consistency was also excellent, with Cronbach's alpha coefficient of >0.70 in all domains. Age was a limiting factor for the delivery of the electronic version of BREAST-Q, with 69 years of age as the cut-off point to obtain reliable results.


      The interchangeability of the electronic and paper versions of the BREAST-Q questionnaire facilitates implementation of this instrument in routine surgical oncological practice.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to European Journal of Surgical Oncology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Sung H.
        • Ferlay J.
        • Siegel R.L.
        • Laversanne M.
        • Soerjomataram I.
        • Jemal A.
        • et al.
        Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.
        CA A Cancer J Clin. 2021; 71: 209-249
        • World Health Organization
        Breast cancer. 26 March 2021.
        (Available at)
        • Spanish Society of Medical Oncology (Sociedad Española de Oncologia Médica SEOM)
        Las cifras del cáncer en España 2020.
        (Available at)
        • Lopes J.V.
        • Bergerot C.D.
        • Barbosa L.R.
        • Calux N.M.C.T.
        • Elias S.
        • Ashing K.T.
        • et al.
        Impact of breast cancer and quality of life of women survivors.
        Rev Bras Enferm. 2018; 71: 2916-2921
        • Mols F.
        • Vingerhoets A.J.
        • Coebergh J.W.
        • van de Poll-Franse L.V.
        Quality of life among long-term breast cancer survivors: a systematic review.
        Eur J Cancer. 2005; 41: 2613-2619
        • Lantz P.M.
        • Janz N.K.
        • Fagerlin A.
        • Schwartz K.
        • Liu L.
        • Lakhani I.
        • et al.
        Satisfaction with surgery outcomes and the decision process in a population-based sample of women with breast cancer.
        Health Serv Res. 2005; 40: 745-767
        • Paraskevi T.
        Quality of life outcomes in patients with breast cancer.
        Onco Rev. 2012; 6: e2
        • Lagendijk M.
        • van Egdom L.S.E.
        • Richel C.
        • van Leeuwen N.
        • Verhoef C.
        • Lingsma H.F.
        • et al.
        Patient reported outcome measures in breast cancer patients.
        Eur J Surg Oncol. 2018; 44: 963-968
        • Marzban S.
        • Shokravi S.
        • Abaei S.
        • Fattahi P.
        • Karami M.
        • Tajari F.
        Patient-reported outcome measures of breast cancer surgery: evidence review and tool adaptation.
        Cureus. 2022; 14e27800
        • Kanatas A.
        • Velikova G.
        • Roe B.
        • Horgan K.
        • Ghazali N.
        • Shaw R.J.
        • et al.
        Patient-reported outcomes in breast oncology: a review of validated outcome instruments.
        Tumori. 2012; 98: 678-688
        • Pusic A.L.
        • Klassen A.F.
        • Scott A.M.
        • Klok J.A.
        • Cordeiro P.G.
        • Cano S.J.
        Development of a new patient-reported outcome measure for breast surgery: the BREAST-Q.
        Plast Reconstr Surg. 2009; 124: 345-353
        • Ghilli M.
        • Mariniello M.D.
        • Camilleri V.
        • Murante A.M.
        • Ferrè F.
        • Colizzi L.
        • et al.
        PROMs in post-mastectomy care: patient self-reports (BREAST-Q™) as a powerful instrument to personalize medical services.
        Eur J Surg Oncol. 2020; 46: 1034-1140
        • Cohen W.A.
        • Mundy L.R.
        • Ballard T.N.
        • Klassen A.
        • Cano S.J.
        • Browne J.
        • et al.
        The BREAST-Q in surgical research: a review of the literature 2009-2015.
        J Plast Reconstr Aesthetic Surg. 2016; 69: 149-162
        • Seth I.
        • Seth N.
        • Bulloch G.
        • Rozen W.M.
        • Hunter-Smith D.J.
        Systematic review of BREAST-Q: a tool to evaluate post-mastectomy breast reconstruction.
        Breast Cancer. 2021; 13: 711-724
        • Lee L.J.
        • Milburn C.
        • Macarios D.
        Patient-reported outcomes assessed using the Breast-Q instrument in women undergoing breast reconstruction post-mastectomy: a systematic literature review.
        Value Health. 2014; 17: A649-A650
        • Toyserkani N.M.
        • Jørgensen M.G.
        • Tabatabaeifar S.
        • Damsgaard T.
        • Sørensen J.A.
        Autologous versus implant-based breast reconstruction: a systematic review and meta-analysis of Breast-Q patient-reported outcomes.
        J Plast Reconstr Aesthetic Surg. 2020; 73: 278-285
        • Wang A.T.
        • Panayi A.C.
        • Fischer S.
        • Diehm Y.F.
        • Tapking C.
        • Hundeshagen G.
        • et al.
        Patient-reported outcomes after reduction mammoplasty using Breast-Q: a systematic review and meta-analysis.
        Aesthetic Surg J. 2022; (Nov 22:sjac293)
        • Martínez P.
        • Jimeno J.
        • Hernanz F.
        • Muñoz P.
        Spanish version of the BREAST-Q® 2.0 questionnaire --breast reduction module-: linguistic, cross-cultural adaptation and validation.
        Cir Esp. 2022 Oct 17; (22)00391-X: S2173-S5077
        • Sabatino M.J.
        • Gans C.V.
        • Zynda A.J.
        • Chung J.S.
        • Miller S.M.
        • Wilson P.L.
        • et al.
        An electronic patient-reported outcomes measurement system in paediatric orthopaedics.
        J Child Orthop. 2019; 13: 431-437
        • Langella F.
        • Barletta P.
        • Baroncini A.
        • Agarossi M.
        • Scaramuzzo L.
        • Luca A.
        • et al.
        The use of electronic PROMs provides same outcomes as paper version in a spine surgery registry. Results from a prospective cohort study.
        Eur Spine J. 2021; 30: 2645-2653
        • Yu J.Y.
        • Goldberg T.
        • Lao N.
        • Feldman B.M.
        • Goh Y.I.
        Electronic forms for patient reported outcome measures (PROMs) are an effective, time-efficient, and cost-minimizing alternative to paper forms.
        Pediatr Rheumatol Online J. 2021; 19: 67
        • Atisha D.M.
        • Rushing C.N.
        • Samsa G.P.
        • Locklear T.D.
        • Cox C.E.
        • Shelley Hwang E.
        • et al.
        A national snapshot of satisfaction with breast cancer procedures.
        Ann Surg Oncol. 2015; 22: 361-369
        • Fuzesi S.
        • Cano S.J.
        • Klassen A.F.
        • Atisha D.
        • Pusic A.L.
        Validation of the electronic version of the BREAST-Q in the army of women study.
        Breast. 2017; 33: 44-49
        • Gwaltney C.J.
        • Shields A.L.
        • Shiffman S.
        Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review.
        Value Health. 2008; 11: 322-333
        • Marx R.G.
        • Menezes A.
        • Horovitz L.
        • Jones E.C.
        • Warren R.F.
        A comparison of two time intervals for test-retest reliability of health status instruments.
        J Clin Epidemiol. 2003; 56: 730-735
        • Builes Ramírez S.
        • Acea Nebril B.
        • García Novoa A.
        • Cereijo C.
        • Bouzón A.
        • Mosquera Oses J.
        Evaluation of the preoperative perception of quality of life and satisfaction of women with breast cancer using the BREAST-Q™ questionnaire.
        Cir Esp. 2020; 98: 212-218
        • Tsang-Wright F.
        • Tasoulis M.K.
        • Roche N.
        • MacNeill F.
        Breast cancer surgery after the COVID-19 pandemic.
        Future Oncol. 2020; 16: 2687-2690