Submitted:
05 December 2025
Posted:
09 December 2025
You are already at the latest version
Abstract
Keywords:
Introduction
Method
Results
Discussion
Conclusions
References
- Ardisson Cirino Campos, F. A., Sánchez García, J. C., Biasotto Feitosa, F., De Oliveira Reis, I., Caritá, E. C., Moll, M. F., & Arena Ventura, C. A. (2025). Fundamentos teóricos e bioéticos para o desenvolvimento do aplicativo de projeto de reabilitação psicossocial. Saúde Em Redes, 11(1), 4430. [CrossRef]
- Berg, M., Aarts, J., & Van Der Lei, J. (2003). ICT in Health Care: Sociotechnical Approaches.
- Bezerra, E. A. do A. C., Ferreira, A. A., Bezerra, S. A. C., Portela, L. da C., & Bezerra Júnior, S. A. C. (2023). Desenvolvimento de um protótipo móvel para auxiliar enfermeiros: Diagnóstico de enfermagem em saúde mental. Revista Contemporânea, 3(8), 11228–11246. [CrossRef]
- Biagianti, B., Hidalgo-Mazzei, D., & Meyer, N. (2017). Developing digital interventions for people living with serious mental illness: perspectives from three mHealth studies. Evid Based Mental Health, 20(4), 1–5. http://ebmh.bmj.com/.
- Birrell, L., Furneaux-Bate, A., Debenham, J., Spallek, S., Newton, N., & Chapman, C. (2022). Development of a Peer Support Mobile App and Web-Based Lesson for Adolescent Mental Health (Mind Your Mate): User-Centered Design Approach. JMIR Formative Research, 6(5). [CrossRef]
- Burchert, S., Alkneme, M. S., Bird, M., Carswell, K., Cuijpers, P., Hansen, P., Heim, E., Shehadeh, M. H., Sijbrandij, M., Van’t Hof, E., & Knaevelsrud, C. (2019). User-centered app adaptation of a low-intensity e-mental health intervention for Syrian refugees. Frontiers in Psychiatry, 9(663), 1–18. [CrossRef]
- Burn, A.-M., Ford, T. J., Stochl, J., Jones, P. B., Perez, J., & Anderson, J. K. (2022). Developing a Web-Based App to Assess Mental Health Difficulties in Secondary School Pupils: Qualitative User-Centered Design Study. JMIR Formative Research, 6(1), e30565. [CrossRef]
- Campos, F. A. A. C. (2025). Avaliação do conteúdo, aparência e heurísticas de usabilidade do webapp “App Reabilita Psicossocial”: Estudo Metodológico. Em Prelo.
- Campos, F. A. A. C., Feitosa, F. B., Moll, M. F., Reis, I. de O., García, J. C. S., & Ventura, C. A. A. (2025). Requirements for the Development of an App for a Psychosocial Rehabilitation Project: An Integrative Review. Int. J. Environ. Res. Public Health.
- Campos, F. A. A. C., García, J. C. S., Feitosa, F. B., Moll, M. F., Rodriguez, T. D. M., & Ventura, C. A. A. (2025). Construction and validation of the content and appearance of the application prototype of a Psychosocial Rehabilitation Project. Enfermería Global, 24(1).
- Campos, F. A. A. C., & Halax Orfão, N. (2022). Planejamento de Plantão de Enfermagem para Caps AD III: Um Relato de Experiência. Saúde Em Redes, 8(sup2), 59–67. [CrossRef]
- Castro, R. A. S. de. (2021). Desenvolvimento de protótipo de tecnologia digital para apoio aos profissionais de enfermagem frente ao estresse ocupacional: proposta de intervenção. Escola de Enfermagem de Ribeirão Preto.
- Castro Rocha, L., C Andrade, R. M., & Libório Sampaio, A. (2014). Heurísticas para avaliar a usabilidade de aplicações móveis: estudo de caso para aulas de campo em Geologia. In Nuevas Ideas en Informática Educativa TISE.
- Chow, P. I. (2020). Developing Mental or Behavioral Health Mobile Apps for Pilot Studies by Leveraging Survey Platforms: A Do-it-Yourself Process. JMIR MHealth and UHealth, 8(4), 1–24. [CrossRef]
- Cirino Campos, F. A. A., García, J. C. S., Feitosa, F. B., Caritá, E. C., & Ventura, C. A. A. (2025). Requisitos para a criação de um protótipo da webapp “App Projeto de Reabilitação Psicossocial” estudo de grupo focal. Revista Portuguesa de Enfermagem de Saúde Mental (RPESM), 1(33), 91–117.
- Cirino Campos, F. A. A., Sánches García, J. C., Galdino da Silva, G. L., Araújo, J. A. L., Farfán Ulloa, I., Caritá, E. C., Feitosa, F. B., Moll, M. F., Rodriguez, T. D. M., & Ventura, C. A. A. (2025). Development of the Psychosocial Rehabilitation Web Application (Psychosocial Rehab App). Nursing Reports, 15(7), 228. [CrossRef]
- Connolly, S. L., Kuhn, E., Possemato, K., & Torous, J. (2021). Digital Clinics and Mobile Technology Implementation for Mental Health Care. Current Psychiatry Reports, 23(7), 38. [CrossRef]
- Costa, B. C. (2023). Aconchego: Construção e validação de aplicativo para apoio à saúde Mental [Dissertação]. Universidade Federal do Ceará.
- Cunha, L. P. C., Reis, P. L. C. dos, Casarin, R. G., Caritá, E. C., & Silva, S. S. (2023). Desenvolvimento de aplicativo móvel como estratégia de educação para o matriciamento em saúde mental. Debates Em Educação Científica e Tecnológica (DECT), 13(x), 165–185. http://ojs.ifes.edu.br/index.php/dect/about.
- Damschroder, L. J., Reardon, C. M., Opra Widerquist, M. A., & Lowery, J. (2022). Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum. Implementation Science, 17(1), 7. [CrossRef]
- D’Lima, D., Soukup, T., & Hull, L. (2022). Evaluating the Application of the RE-AIM Planning and Evaluation Framework: An Updated Systematic Review and Exploration of Pragmatic Application. Frontiers in Public Health, 9. [CrossRef]
- Eis, S., Solà-Morales, O., Duarte-Díaz, A., Vidal-Alaball, J., Perestelo-Pérez, L., Robles, N., & Carrion, C. (2022). Mobile Applications in Mood Disorders and Mental Health: Systematic Search in Apple App Store and Google Play Store and Review of the Literature. International Journal of Environmental Research and Public Health, 19(4), 1–15. [CrossRef]
- Gal, G., Shadmi, E., Hoter-Ishay, G., Gelkopf, M., & Roe, D. (2022). Comparing outcome measures of persons with severe mental illness in vocational rehabilitation programs: a dual perspective of consumers and providers. International Journal for Quality in Health Care, 34(Supplement_1), ii105–ii111. [CrossRef]
- Gelkopf, M., Pagorek-Eshel, S., Trauer, T., & Roe, D. (2015). Routine outcome measurement in mental health service consumers: Who should provide support for the self-assessments? Evaluation and Program Planning, 50, 43–46. [CrossRef]
- Giovanelli, A., Sanchez Karver, T., Roundfield, K. D., Woodruff, S., Wierzba, C., Wolny, J., & Kaufman, M. R. (2023). The Appa Health App for Youth Mental Health: Development and Usability Study. JMIR Formative Research, 7, e49998. [CrossRef]
- Glasgow, R. E., Harden, S. M., Gaglio, B., Rabin, B., Smith, M. L., Porter, G. C., Ory, M. G., & Estabrooks, P. A. (2019). RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review. Frontiers in Public Health, 7. [CrossRef]
- González-Pérez, A., Matey-Sanz, M., Granell, C., Díaz-Sanahuja, L., Bretón-López, J., & Casteleyn, S. (2023a). AwarNS: A framework for developing context-aware reactive mobile applications for health and mental health. Journal of Biomedical Informatics, 141(104359), 1–20. [CrossRef]
- González-Pérez, A., Matey-Sanz, M., Granell, C., Díaz-Sanahuja, L., Bretón-López, J., & Casteleyn, S. (2023b). AwarNS: A framework for developing context-aware reactive mobile applications for health and mental health. Journal of Biomedical Informatics, 141, 104359. [CrossRef]
- Guimarães, J., & Saeki, T. (2001). Janelas do Santa Tereza: estudo do processo de reabilitação psicossocial do Hospital Psiquiátrico de Ribeirão Preto (SP). História, Ciências, Saúde-Manguinhos, 8(2), 357–374. [CrossRef]
- Hanssen, E., Balvert, S., Oorschot, M., Borkelmans, K., van Os, J., Delespaul, P., & Fett, A.-K. (2020). An ecological momentary intervention incorporating personalised feedback to improve symptoms and social functioning in schizophrenia spectrum disorders. Psychiatry Research, 284(12695), 1–8. [CrossRef]
- Hwang, W. J., Ha, J. S., & Kim, M. J. (2021). Research trends on mobile mental health application for general population: A scoping review. International Journal of Environmental Research and Public Health, 18(5), 1–20. [CrossRef]
- King, D. R., Emerson, M. R., Tartaglia, J., Nanda, G., & Tatro, N. A. (2023). Methods for Navigating the Mobile Mental Health App Landscape for Clinical Use. Current Treatment Options in Psychiatry, 1–15. [CrossRef]
- Lagan, S., Emerson, M. R., King, D., Matwin, S., Chan, S. R., Proctor, S., Tartaglia, J., Fortuna, K. L., Aquino, P., Walker, R., Dirst, M., Benson, N., Myrick, K. J., Tatro, N., Gratzer, D., & Torous, J. (2021). Mental Health App Evaluation: Updating the American Psychiatric Association’s Framework Through a Stakeholder-Engaged Workshop. Psychiatric Services, 72(9), 1095–1098. [CrossRef]
- Lemon, C., Huckvale, K., Carswell, K., & Torous, J. (2020). A Narrative Review of Methods for Applying User Experience in the Design and Assessment of Mental Health Smartphone Interventions. International Journal of Technology Assessment in Health Care, 36(1), 64–70. [CrossRef]
- Liew, M. S., Zhang, J., See, J., & Ong, Y. L. (2019). Usability Challenges for Health and Wellness Mobile Apps: Mixed-Methods Study Among mHealth Experts and Consumers. JMIR MHealth and UHealth, 7(1), e12160. [CrossRef]
- Lin, X., Martinengo, L., Jabir, A. I., Ho, A. H. Y., Car, J., Atun, R., & Tudor Car, L. (2023). Scope, Characteristics, Behavior Change Techniques, and Quality of Conversational Agents for Mental Health and Well-Being: Systematic Assessment of Apps. Journal of Medical Internet Research, 25(e45984), e45984. [CrossRef]
- Lipschitz, J. M., Boxtel, R. Van, Torous, J., Firth, J., Lebovitz, J. G., Burdick, K. E., & Hogan, T. P. (2022). Digital Mental Health Interventions for Depression: Scoping Review of User Engagement. Journal of Medical Internet Research, 24(10), 1–19. [CrossRef]
- Lopes, R. P., Barroso, B., Deusdado, L., Novo, A., Guimarães, M., Teixeira, J. P., & Leitão, P. (2021). Digital Technologies for Innovative Mental Health Rehabilitation. Electronics, 10(18), 2260. [CrossRef]
- Malterud, K. (2001). Qualitative research: standards, challenges, and guidelines. The Lancet, 358(9280), 483–488. [CrossRef]
- Martinez-Martin, N., Greely, H. T., & Cho, M. K. (2021). Ethical development of digital phenotyping tools for mental health applications: Delphi study. JMIR MHealth and UHealth, 9(7). [CrossRef]
- Martorella, G., Boitor, M., Berube, M., Fredericks, S., Le May, S., & Gélinas, C. (2017). Tailored Web-Based Interventions for Pain: Systematic Review and Meta-Analysis. Journal of Medical Internet Research, 19(11), e385. [CrossRef]
- Measuring Psychosocial Rehabilitation Outcomes The Research Committee of the International Association of Psychosocial Rehabilitation Services. (n.d.). www.tecathsri.org.
- Merchant, R., Torous, J., Rodriguez-Villa, E., & Naslund, J. A. (2020). Digital technology for management of severe mental disorders in low-income and middle-income countries. In Current Opinion in Psychiatry (Vol. 33, Issue 5, pp. 501–507). Lippincott Williams and Wilkins. [CrossRef]
- Miralles, I., & Granell, C. (2019). Considerations for designing context-aware mobile apps for mental health interventions. International Journal of Environmental Research and Public Health, 16(7), 1–21. [CrossRef]
- Mussi, R. F. de F., Flores, F. F., & Almeida, C. B. de. (2021). Pressupostos para a elaboração de relato de experiência como conhecimento científico. Práxis Educacional, 17(48), 1–18. [CrossRef]
- Neary, M., & Schueller, S. M. (2018). State of the Field of Mental Health Apps. Cognitive and Behavioral Practice, 25(4), 531–537. [CrossRef]
- Nicolaidou, I., Aristeidis, L., & Lambrinos, L. (2022). A gamified app for supporting undergraduate students’ mental health: A feasibility and usability study. Digital Health, 8, 20552076221109060. [CrossRef]
- Nordgreen, T., Rabbi, F., Torresen, J., Skar, Y. S., Guribye, F., Inal, Y., Flobakk, E., Wake, J. D., Mukhiya, S. K., Aminifar, A., Myklebost, S., Lundervold, A. J., Kenter, R., Hammar, Å., Nordby, E., Kahlon, S., Tveit Sekse, R. J., Griffin, K. F., Jakobsen, P., … Lamo, Y. (2021). Challenges and possible solutions in cross-disciplinary and cross-sectorial research teams within the domain of e-mental health. Journal of Enabling Technologies, 15(4), 241–251. [CrossRef]
- Ogrinc, G., Davies, L., Goodman, D., Batalden, P., Davidoff, F., & Stevens, D. (2015). SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): revised publication guidelines from a detailed consensus process. American Journal of Medical Quality : The Official Journal of the American College of Medical Quality, 30(6), 543–549. [CrossRef]
- Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., Rycroft-Malone, J., Meissner, P., Murray, E., Patel, A., Sheikh, A., & Taylor, S. J. C. (2017). Standards for Reporting Implementation Studies (StaRI) Statement. BMJ, i6795. [CrossRef]
- Pokhrel, P., Karmacharya, R., Taylor Salisbury, T., Carswell, K., Kohrt, B. A., Jordans, M. J. D., Lempp, H., Thornicroft, G., & Luitel, N. P. (2021). Perception of healthcare workers on mobile app-based clinical guideline for the detection and treatment of mental health problems in primary care: a qualitative study in Nepal. BMC Medical Informatics and Decision Making, 21(1), 1–12. [CrossRef]
- Proctor, E. K., Bunger, A. C., Lengnick-Hall, R., Gerke, D. R., Martin, J. K., Phillips, R. J., & Swanson, J. C. (2023). Ten years of implementation outcomes research: a scoping review. Implementation Science, 18(1), 31. [CrossRef]
- Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health, 38(2), 65–76. [CrossRef]
- Queiroz, G. (2022). Second Mind: Considerações Ético--Legais sobre a Digitalização em Saúde Mental no Contexto Português. Revista Portuguesa de Psiquiatria e Saúde Mental, 8(3), 96–104. [CrossRef]
- Rosenfeld, E. A., Lyman, C., & Roberts, J. E. (2022). Development of an mHealth App–Based Intervention for Depressive Rumination (RuminAid): Mixed Methods Focus Group Evaluation. JMIR Formative Research, 6(12), 1–27. [CrossRef]
- Schlieter, H., Marsch, L. A., Whitehouse, D., Otto, L., Londral, A. R., Teepe, G. W., Benedict, M., Ollier, J., Ulmer, T., Gasser, N., Ultsch, S., Wollschlaeger, B., & Kowatsch, T. (2022). Scale-up of Digital Innovations in Health Care: Expert Commentary on Enablers and Barriers. Journal of Medical Internet Research, 24(3), e24582. [CrossRef]
- Silberman, J., Wicks, P., Patel, S., Sarlati, S., Park, S., Korolev, I. O., Carl, J. R., Owusu, J. T., Mishra, V., Kaur, M., Willey, V. J., Sucala, M. L., Campellone, T. R., Geoghegan, C., Rodriguez-Chavez, I. R., Vandendriessche, B., Park, S., Mishra, V., Rodriguez-Chavez, I. R., & Goldsack, J. C. (2023). Rigorous and rapid evidence assessment in digital health with the evidence DEFINED framework. Npj Digital Medicine, 6(1), 101. [CrossRef]
- Sturm, R., Pollard, C., & Craig, J. (2017). Managing Web-Based Applications. In Application Performance Management (APM) in the Digital Enterprise (pp. 83–93). Elsevier. [CrossRef]
- Taylor, K. V, Garchitorena, L., Scaramutti-Gladfelter, C., Wyrick, M., Grill, K. B., & Seixas, A. A. (2024). A Digital Mental Health Solution to Improve Social, Emotional, and Learning Skills for Youth: Protocol for an Efficacy and Usability Study. JMIR Research Protocols, 13, e59372. [CrossRef]
- Torous, J. B., Chan, S. R., Yee-Marie Tan Gipson, S., Kim, J. W., Nguyen, T. Q., Luo, J., & Wang, P. (2018). A hierarchical framework for evaluation and informed decision making regarding smartphone apps for clinical care. Psychiatric Services, 69(5), 498–500. [CrossRef]
- Torous, J., & Roberts, L. W. (2017). The Ethical Use of Mobile Health Technology in Clinical Psychiatry. Journal of Nervous and Mental Disease, 205(1), 4–8. [CrossRef]
- Torous, J., & Vaidyam, A. (2020). Multiple uses of app instead of using multiple apps- A case for rethinking the digital health technology toolbox. Epidemiology and Psychiatric Sciences, 29(e100), 1–2. [CrossRef]
- Vial, S., Boudhraâ, S., Dumont, M., Tremblay, M., & Riendeau, S. (2023). Developing A Mobile App With a Human-Centered Design Lens to Improve Access to Mental Health Care (Mentallys Project): Protocol for an Initial Co-Design Process. JMIR Research Protocols, 12, e47220. [CrossRef]
- Viana, L. S., Oliveira, E. N., Vasconcelos, M. I. O., Fernandes, C. A. R., Dutra, M. C. X., & Almeida, P. C. de. (2023). Desenvolvimento e validação de um jogo educativo sobre uso abusivo de drogas e o risco de suicídio. SMAD, Revista Eletrônica Saúde Mental Álcool e Drogas (Edição Em Português), 19(2), 16–25. [CrossRef]
- Williams, J. E., & Pykett, J. (2022). Mental health monitoring apps for depression and anxiety in children and young people: A scoping review and critical ecological analysis. In Social Science and Medicine (Vol. 297, Issue 114802, pp. 1–15). Elsevier Ltd. [CrossRef]
| Structure | What We Did in the “Psychosocial Rehab App” | Recommendations |
|---|---|---|
| Planning | -We developed the research project and submitted it to the Ethics Committee, focusing on the methodological planning of the study. | -Consider the time required for each stage, available financial resources, human resources, and research field/participant availability. -Use a SWOT matrix to identify strengths, weaknesses, opportunities, and threats (Campos & Halax Orfão, 2022). -Leave at least three months of buffer time for unforeseen events. -Partner with technology professionals, ensuring alignment of interests and engagement with the project. |
| Requirements Gathering for Prototyping | -Narrative review on psychosocial rehabilitation, psychosocial rehabilitation projects, and bioethics of mental health apps (Ardisson Cirino Campos et al., 2025). -Integrative review for prototyping requirements (Campos, Feitosa, et al., 2025). -Focus groups with mental health professionals, including multidisciplinary teams (Cirino Campos, García, et al., 2025). |
- Narrative or exploratory reviews are sufficient; exhaustive literature review is not necessary (Ardisson Cirino Campos et al., 2025). - Use flexible methodologies in focus groups (roundtable, brainstorming, chats, video calls, etc.). - Prioritize experienced professionals and specialists with theoretical and practical knowledge. - Requirements should include features, elements, and resources that solve clinical problems or optimize mental health processes or health practice. |
| Prototyping | -Initial prototype developed in Marvel conducted by mental health professional based in requirements of prototyping (Campos, García, et al., 2025). | -Start with manual sketches, flowcharts, or simple drawings. -Mental health professionals should lead the process, using tools like Marvel, InVision, or Figma, etc. -Value clinical experience, creativity, and participatory design methods. -Maintain a flexible, artistic, and collaborative process, ready for adjustments based on evidence (Campos, García, et al., 2025; Lemon et al., 2020; J. Torous & Vaidyam, 2020; Vial et al., 2023). |
| Prototype | -Content validation of the prototype with mental health professionals (Campos, García, et al., 2025). -Subsequent reconfiguration/adaptation in Figma by a UX designer, with active participation of mental health professional (Cirino Campos, Sánches García, et al., 2025). |
-Always validate with the target audience and, if possible, with a designer to improve aesthetics and functionality. -Base all modifications on professional contributions. -Prioritize simplicity, functionality, and clarity(Biagianti et al., 2017; J. Torous & Vaidyam, 2020). |
| Development with Alpha Testing | -The technology team developed the “Psychosocial Rehab App” using Flutter and Dart, with data stored in Firebase Cloud (Cirino Campos, Sánches García, et al., 2025). -Initial alpha testing conducted by mental health professional, identifying technical failures, interface defects, broken screens, navigation errors, and textual inconsistencies. -Creation of tutorial videos and user terms. |
- Carefully select the platform (web, Android, iOS, or multiplatform). -Preserve source code in secure repositories. -Prioritize essential features while maintaining usability and smooth performance. -Mental health professionals should actively participate, aligning development with clinical practice, leadership, and collaborative teamwork. |
| Beta Validation | -Technical evaluation of the app by technology professionals and mental health professionals to identify technical, usability, and clinical alignment issues (Campos, 2025). -Resubmission for content and appearance validation with mental health/technology professionals. |
-Conduct content, appearance, and overall quality validations using consolidated methodologies (MARS, usability taxonomies). -Test with end-users, including mental health professionals, patients, and technology staff. -Be ready to implement feedback and iterate the prototype (Viana et al., 2023). |
| Implementation | -Implementation in the Brazilian psychosocial care network using the Implementation Outcomes Framework (IOF), considering acceptability, adoption, appropriateness, feasibility, fidelity, cost, penetration, and sustainability (E. Proctor et al., 2011; E. K. Proctor et al., 2023). -Assessment in real-world mental health environments with NoMAD, uMARS, and psychosocial rehabilitation indicators (Gal et al., 2022; Gelkopf et al., 2015; Measuring Psychosocial Rehabilitation Outcomes The Research Committee of the International Association of Psychosocial Rehabilitation Services, n.d.). |
-Involve more than 100 mental health professionals to strengthen evidence of implementation (Silberman et al., 2023). |
| Gold Validation | -Conduct at least two randomized controlled trials to evaluate efficacy and effectiveness (Silberman et al., 2023). -Use the DEFINED evidence scale (0–4), with trials representing the highest level of evidence (Silberman et al., 2023). |
-Structure evidence according to international standards, ensuring scientific robustness and clinical applicability. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
