Effectiveness of Automation in Evaluating Test Results Using EvalBee as an Alternative Optical Mark Recognition (OMR): A Quantitative-Evaluative Approach from a Philippine Public School
DOI:
https://doi.org/10.31098/ijtaese.v3i2.661Keywords:
alternative optical mark recognition, integrating automation, student test evaluation, automated checking, automated item analysisAbstract
Abstract
Within this study, the authors want to address the problem of overworking of teachers in Philippine schools due to their excessive clerical responsibility, which could lead to teacher attrition. The authors propose to automate the process, particularly the evaluation of student test results since it could improve human well-being by reducing the burden of manual labor. Automation using OMR has not been widely applied in Philippine schools due to cost issues. The authors want to observe whether an alternative OMR - EvalBee - can meet the evaluation standard even though it is free of charge. The study employed a quantitative-evaluative research method. Validated questionnaires on paper and a Google Form survey were used to collect relevant data in a secondary public school in the City Schools Division of Cabuyao – Southville1 Integrated National High School. Statistical tools such as the mean, standard deviation, t-test, and Cohen's d were used in this research to determine the effectiveness of using alternative OMR in evaluating examinations. This study shows that alternative OMR is efficient, accurate, and reliable, despite the fact that it is free, and recommends it be used as part of the teachers' standard method of test evaluation.
References
Department of Education. (2015). D. O. 8, s. 2015 Policy Guidelines on Classroom Assessment for the K to 12 Basic Education Program
Orobor, I. (2015). A Novel Framework for Student Result Computation as a Cloud Computing Service. American Journal of Systems and Software. 1. 13-19. 10.12691/ajss-3-1-2.
Jacobson, D. (2016). Causes and Effects of Teacher Burnout. Walden University Scholar Works. Walden Dissertations and Doctoral Studies Collection
Technopedia, Inc. (2020). Automation. Techopedia - Janalta Interactive Inc. https://www.techopedia.com/definition/3 2099/automation
Department of Education. (2016). D.O. 55, s. 2016. Policy Guidelines on the National Assessment of Student Learning for the K to 12 Basic Education Program.
Fabella, J.P. (2016). Santa Rosa City obtains Optical Mark Reader (OMR) Scanners. DepEdCalabarzon.
https://depedcalabarzon.ph/2016/08/santa-rosa-city-obtains-optical-mark-reader- omr-scanners/
Virtus, L. M. (2019). Performance Mapping of Optical Mark Recognition (OMR) Machines in The Division of Batangas City: Basis for Program Enhancement. International Journal of Advanced Research and Publications Volume 3 - Issue 9, September 2019 Edition ISSN:2456-9992
Catalan, J. A. (2017). A framework for automated multiple-choice exam scoring with digital image and assorted processing using readily available software. Manila: De La Salle University.
Patel, N.V and Prajapati, G.I. (2015). Various Techniques for Assessment of OMR Sheets through Ordinary 2D Scanner: A Survey. International Journal of Engineering Research & Technology (IJERT) Vol. 4 Issue. ISSN (Online): 2278-0181
Tavana, A., Abbasi, M., and Yousefi, A. (2016). Optimizing the correction of MCQ test answer sheets using digital image processing. 2016 Eighth International Conference on Information and Knowledge Technology (IKT), Hamedan, pp. 139-143. https://doi: 10.1109/IKT.2016.7777754.
Kakade, N. and Jaiswal, R. C. (2017). OMR Sheet Evaluation Using Image Processing. JETER (ISSN-2349-5162) VOLUME 4, ISSUE 12
Karunanayake, N., (2015), OMR Sheet Evaluation by Web Camera Using Template Matching Approach. International Journal for Research in Emerging Science and Technology. VOLUME-2, ISSUE-8. E- ISSN: 2349-7610
Statista. (2021). Number of smartphone users in the Philippines from 2015 to 2019 with a forecast until2025. https://www.statista.com/statistics/46718 6/forecast-of-smartphone-users-in-the- Philippines/
Ekodroid Labs. (2021) EvalBee - (Free OMR Answer sheet scanner). https://play.google.com/store/apps/details?id=com.ekodroid.omrevaluator&hl=en& gl=US
Spencer, Thompson. (2016). Worker Cooperatives in the Theory of the Firm: Marx and Veblen on Technological Determinism, Journal of Economic Issues, 50:4, 913-939, DOI:10.1080/00213624.2016.1249743
Matthewman, Steve. (2011). Theorizing Technology. Palgrave Macmillan. ISBN 978-0-230-34395-5 (eBook)
Shields, M.A. (2012). Review of Technology and Social Theory. Technology and Culture 53(4), 918-920. doi:10.1353/tech.2012.0130.
McLennan, S. (2015). Techno-optimism or Information Imperialism: Paradoxes in Online Networking, Social Media and Development. Information Technology for Development. 22. 10.1080/02681102.2015.1044490.
Vydra S., and Klievink B. (2019). Techno- optimism and policy-pessimism in the public sector big data debate. Government Information Quarterly, Volume 36, Issue 4, IS SN 0740-624X
Nurwahida, F. T., Jayasuriya, D. P., Xiang, L. W. and Mazharet, S. F. (2017). Clerical Work for School Teachers: A Burden or A Responsibility? Journal of Humanities, Language, Culture and Business (HLCB)Vol. 1: no. 3 (2017) page 26-36 | www.icohlcb.com | eISSN : 01268147 Cabigas, L. (2019). Who Let the Teachers Out:
Exploring the Main Factors which Contribute to Teacher Attrition in Philippine Schools. Monash University https://www.academia.edu/
Jacobson, D. (2016). Causes and Effects of Teacher Burnout. Walden University Scholar Works. Walden Dissertations and Doctoral Studies Collection https://scholarworks.waldenu.edu/cgi/vie wcontent.cgi?article=3938&context=diss ertations.
Oke, A.O., Ajagbe, M.A., Ogbari, M.E. & Adeyeye, J.O. (2015). Teacher Retention and Attrition: A Review of the Literature. Mediterranean Journal of Social Sciences Vol 7 No 2 S1 March 2016. ISSN 2039- 2117
David, C., Albert, J. R. and Vizmanos, J. F. (2019). Pressures on public school teachers and implications on quality. Policy Notes. Philippine Institute of Development studies. ISSN 2508-0865 (electronic) No. 2019-01
Philippine Institute for Developmental Studies. (2015). Teachers and Our State of Education. https://pids.gov.ph/pids-in- the-news/1359
Department of Education. (2018). Statement on DepEd’s review of teachers’ workload. https://www.deped.gov.ph/2018/09/04/st statement-on-depends-review-of-teachers- workload/
De Witte, L. (2019). Global Challenges in Assistive Technology. Special Issue: AAATE 2019 Conference – Global Challenges in Assistive Technology: Research, Policy & Practice. Supplement Issue of Technology and Disability (Volume 31, issue s1). ISSN 1055- 4181/19
Li, M. and Wong, K. (2018). Rain Classroom: Bridging the Gap Between Teachers and Learners. International Journal of Mobile and Blended Learning (ISSN: 1941- 8647).
Capunitan P.M., Alinsod A.A., and Palanas D.M. (2019). Digital assessment: empowering 21st century teachers in analyzing student’s performance in Calamba City. JPAIR Institutional Research Vol. 13 No. 1 (2019)
Department of Education. (2012). D.O. 40, s. 2012. DepEd Child Protection Policy.
Department of Education. (2016). D.O. 55, s. 2016. Policy Guidelines on the National Assessment of Student Learning for the K to 12 Basic Education Program.
Patoule, S., Pawar, A., Patel, A., Panchal, A., and Joshi, R. (2016). Automatic system for grading multiple-choice questions and feedback analysis. International Journal of Research and Applications, Special Issue 39, pp. 16-19, Mar. e-ISSN: 2320-8163
Downloads
Published
Issue
Section
License
Copyright (c) 2021 Ronnel Cuerdo, Michael Jomar B. Ison, Christian Diols T. Oñate
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Content Licensing, Copyright, and Permissions
1. License
International Journal of Theory and Application in Elementary and Secondary School Education has CC-BY NC or an equivalent license as the optimal license for the publication, distribution, use, and reuse of scholarly work for non-commercial purpose. The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on Creative Commons Attribution-NonCommercial 4.0 International License
Creative Commons License
2. Author’s Warranties
The author warrants that the article is original, written by stated author(s), has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author(s).
3. User Rights
International Journal of Theory and Application in Elementary and Secondary School Education objective is to disseminate articles published are as free as possible. Under the Creative Commons license, this journal permits users to copy, distribute, display, and perform the work for non-commercial purposes only. Users will also need to attribute authors and this journal on distributing works in the journal.
4. Rights of Authors
Authors retain the following rights:
Copyright, and proprietary rights relating to the article, such as patent rights,
The right to use the substance of the article in future own works, including lectures and books, The right to reproduce the article for own purposes, The right to self-archive the article, the right to enter into separate, additional contractual arrangements for the non-exclusive distribution of the article's published version (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal (International Journal of Theory and Application in Elementary and Secondary School Education).
The author has a non-exclusive publishing contract with a publisher and the work is published with a more restrictive license, the author retains all the rights to publish the work elsewhere, including commercially, because she/he is not subject to the conditions of her / his own license, regardless of the type of CC license chosen.
5. Co-Authorship
If the article was jointly prepared by other authors, the signatory of this form warrants that he/she has been authorized by all co-authors to sign this agreement on their behalf, and agrees to inform his/her co-authors of the terms of this agreement.
6. Termination
This agreement can be terminated by the author or International Journal of Theory and Application in Elementary and Secondary School Education upon two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of International Journal of Theory and Application in Elementary and Secondary School Education.ÂÂ
7. Royalties
This agreement entitles the author to no royalties or other fees. To such extent as legally permissible, the author waives his or her right to collect royalties relative to the article in respect of any use of the article by This agreement can be terminated by the author or International Journal of Theory and Application in Elementary and Secondary School Education upon two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of International Journal of Theory and Application in Elementary and Secondary School Education or its sublicensee.
8. Miscellaneous
International Journal of Theory and Application in Elementary and Secondary School Education will publish the article (or have it published) in the journal if the article’s editorial process is successfully completed and International Journal of Theory and Application in Elementary and Secondary School Education or its sublicensee has become obligated to have the article published. International Journal of Theory and Application in Elementary and Secondary School Education may conform the article to a style of punctuation, spelling, capitalization, referencing and usage that it deems appropriate. The author acknowledges that the article may be published so that it will be publicly accessible and such access will be free of charge for the readers
