Qualitative indicators to evaluate the relevance and social impact of public university research in northwestern Mexico
DOI:
https://doi.org/10.33830/ijrse.v7i1.1749Keywords:
Higher education, Public higher education, Relevance of research, Qualitative Researches, Social impactAbstract
Research’s relevance and social impact are essential criteria to evaluate if the research produced in universities fits society's wants and needs. There is a growing interest in these two elements that have increased publications that explore the most effective ways to evaluate research projects from this standpoint. There are various papers addressing evaluation from a statistical and bibliometric perspective. This paper delves into the experience of creating an evaluation for social relevance and social impact in research through a series of qualitative indicators brought about by consulting researchers themselves. The procedure was conducting six focus groups with 39 Autonomous University of Baja California researchers, organized by different fields of knowledge. The information submitted for analysis from the participants' discussions delved into their experience in both categories. The results point to 5 indicators linked to the relevance, 8 to the impact, 3 to the research ethics, and eight as proposals for the institution. They pointed out the need for a flexible evaluation to discern the differences between academic disciplines. Likewise, they stress the need to further cooperation between researchers and the social and industry sector to counteract the Mexican government's current scientific investment reduction. Finally, they underline the importance of university spaces for disseminating and divulging research results and products.
References
Barnett, M. L., Henriques, I., & Husted, B. W. (2020). Beyond Good Intentions: Designing CSR Initiatives for Greater Social Impact. Journal of Management, 46(6), 937–964. https://doi.org/10.1177/0149206319900539
Chen, E., Leos, C., Kowitt, S. D., & Moracco, K. E. (2020). Enhancing community-based participatory research through human-centered design strategies. Health promotion practice, 21(1), 37-48. https://doi.org/10.1177/1524839919850557
Calvard, T., Cherlin, E., Brewster, A., & Curry, L. (2023). Building perspective-taking as an organizational capability: A change intervention in a health care setting. Journal of Management Inquiry, 32(1), 35-49. https://doi.org/10.1177/1056492621103901
Darwin-Holmes, A. G. (2020). Researcher Positionality – A Consideration of Its Influence and Place in Qualitative Research - A New Researcher Guide. Shanlax. International Journal of Education. 8(4), 1-10. https://doi.org/10.34293/education.v8i4.3232
Estrada-Jaramillo, A., Michael, M., & Farrimond, H. (2022). Absence, multiplicity and the boundaries of research? Reflections on online asynchronous focus groups. Qualitative Research, 0(0). https://doi.org/10.1177/14687941221110169
Farinola, A. (2023). Hermeneutical postphenomenology: Computational tools and the lure of objectivity. Digital Scholarship in the Humanities, fqac074, https://doi.org/10.1093/llc/fqac074
Flick, U. (2018). Designing Qualitative Research. Sage.
González, E., Reyes, E., Ramírez, A., Santillán, E. y Herrera, K. (2020). Pertinencia e impacto de la investigación científica. Aportes para orientar la política institucional de la UABC. Universidad Autónoma de Baja California.
Gumport, P. (2019). Academic fault Lines. The Rise of Industry Logic in Public Higher Education. Jhon Hopkins University Press.
Halliday, M., Mill, D., Johnson, J., & Lee, K. (2021). Let's talk virtual! Online focus group facilitation for the modern researcher. Research in Social and Administrative Pharmacy, 17(12), 2145-2150. https://doi.org/10.1016/j.sapharm.2021.02.003
Hovey, R. B., Vigouroux, M., Noushi, N., Pavate, V., & Amja, K. (2022). Applied Philosophical Hermeneutic Research: the unmethod. International Journal of Qualitative Methods, 21. https://doi.org/10.1177/16094069221101237
James, P. (2019). The Social Imaginary in Theory and Practice. In C. Hudson & E. K. Wilson (Eds.) Revisiting the Global Imaginary. Theories, ideologies, Subjetivities: Essays in Honor of Manfred Steger (pp. 33-47). Palgrave Macmillan.
Jung, H. (2019). It does not make sense, but it does: Interactional dynamics in focus group interaction. In K. Roulston. Interactional Studies of Qualitative Research Interviews. John Benjamins Publishing Company.
Kuckartz, U. (2019). Qualitative Text Analysis: A Systematic Approach. In G. Kaiser & N. Presmeg (Eds.). Compendium for Early Career Researchers in Mathematics Education (pp. 181-198). Springer.
Kusmawan, U. (2024). Beyond Traditional Practicums: Exploring the Potential of Scalable Practicum in Science Courses. Studies in Learning and Teaching, 5(3), 622-637. https://doi.org/10.46627/silet.v5i3.505
Kusmawan, U. (2024). Transforming digital learning and assessment strategies in higher education. Multidisciplinary Reviews, 8(1), 2025016. https://doi.org/10.31893/multirev.2025016
Mills, N, Courtney, M, Dede, C, Dressen, A, Gant, R. (2020). Culture and vision in virtual reality narratives. Foreign Language Annals. 53, 733–760. https://doi.org/10.1111/flan.12494
Rioufreyt, T. (2019). L’outil et la méthode. Des fonctionnalités techniques des CAQDAS à leurs usages méthodologiques. Introduction. BMS: Bulletin of Sociological Methodology / Bulletin de Méthodologie Sociologique, 143, 7–27. https://www.jstor.org/stable/26747970
Rosenthal, M. (2016). Qualitative research methods: Why, when, and how to conduct interviews and focus groups in pharmacy research. Currents in Pharmacy Teaching and Learning, 8(4), 509-516. https://doi.org/10.1016/j.cptl.2016.03.021
Stefani, U., Schiavone, F., Laperche, B. & Burger-Helmchen, T. (2020). New tools and practices for financing novelty: a research agenda. European Journal of Innovation Management, 23(2), 314-328. https://doi.org/10.1108/EJIM-08-2019-0228
Strauss, A. & Corbin, J. (2014). Basics of qualitative research. Techniques and procedures for developing grounded theory. Sage.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Emilia Cristina González-Machado, Ernesto Israel Santillán-Anguiano
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Content Licensing, Copyright, and Permissions
1. License
International Journal of Research in STEM Education has CC-BY NC or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly work for non-commercial purposes. The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial 4.0 International License.
Creative Commons License
2. Author’s Warranties
The author warrants that the article is original, written by the stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).
3. User Rights
The International Journal of Research in STEM Education's objective is to disseminate articles published as free as possible. Under the Creative Commons license, this journal permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and this journal on distributing works in the journal.
4. Rights of Authors
Authors retain the following rights:
Copyright, and proprietary rights relating to the article, such as patent rights,
The right to use the substance of the article in future own works, including lectures and books, The right to reproduce the article for own purposes, The right to self-archive the article, the right to enter into separate, additional contractual arrangements for the non-exclusive distribution of the article's published version (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal (International Journal of Research in STEM Education).
The author has a non-exclusive publishing contract with a publisher, and the work is published with a more restrictive license, the author retains all the rights to publish the work elsewhere, including commercially, because she/he is not subject to the conditions of her / his own license, regardless of the type of CC license chosen.
5. Co-Authorship
If the article was jointly prepared by other authors, the signatory of this form warrants that he/she has been authorized by all co-authors to sign this agreement on their behalf and agrees to inform his/her co-authors of the terms of this agreement.
6. Termination
This agreement can be terminated by the author or International Journal of Research in STEM Education at two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of the International Journal of Research in STEM Education.
7. Royalties
This agreement entitles the author to no royalties or other fees. To such extent as legally permissible, the author waives his or her right to collect royalties relative to the article in respect of any use of the article by This agreement can be terminated by the author or International Journal of Research in STEM Education upon two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of the International Journal of Research in STEM Education or its sublicensee.
8. Miscellaneous
International Journal of Research in STEM Education will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed and the International Journal of Research in STEM Education or its sublicensee has become obligated to have the article published. International Journal of Research in STEM Education may conform the article to a style of punctuation, spelling, capitalization, referencing, and usage that it deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible, and such access will be free of charge for the readers.
