The Games Design Accesbility For Gamer With Neurological Disorder

Melyani Melyani; Anjas Ramadhani; Ajat Sudrajat; Mia Rosmiati; Faif Yusuf; Faizal Roni; Cahyani Budihartanti; Muji Endah Palupi

doi:10.51903/jtie.v3i2.177

Melyani Melyani Universitas Bina Sarana Informatika
Anjas Ramadhani Universitas Bina Sarana Informatika
Ajat Sudrajat Universitas BIna Sarana Informatika
Mia Rosmiati Universitas BIna Sarana Informatika
Faif Yusuf Universitas BIna Sarana Informatika
Faizal Roni Universitas BIna Sarana Informatika
Cahyani Budihartanti Universitas Nusa Mandiri
Muji Endah Palupi Universitas BIna Sarana Informatika

DOI: https://doi.org/10.51903/jtie.v3i2.177

Keywords: game accessibility, motor disability, hand motion, xgboost

Abstract

Computer games have emerged in the past decade as potential media beyond entertainment. Despite its popularity, game accessibility remains a major concern of various researchers. Children population with motor disabilities is a potential target for developing entertainment or therapeutic support games due to their interest to play. This paper presents: (1) a framework for mobile games for children with motor disability using simple hand postures and (2) xgboost decision tree as a hand posture recognizer (98.48 percent training accuracy and 96.76 percent testing accuracy) as a prototype of hand posture-based commands as assistive technology to interact with games.

References

Cambridge English Dictionary. Game. Cambridge English Dictionary Online, accessed July 27, 2018. https://dictionary.cambridge.org/dictionary/english/computer-game

Collins English Dictionary. Computer Game. Collins English Dictionary, accessed July 27, 2018. https://www.collinsdictionary.com/dictionary/english/computer-game

Wen, T., Wang, L., Gu, J., & Huang, B. (2009, June). A 3-D acceleration-based control algorithm for interactive gaming using a head-worn wireless device. In Bioinformatics and Biomedical Engineering, 2009. ICBBE 2009. 3rd International Conference on (pp. 1-3). IEEE.

Kementrian Kesehatan RI, “Situasi Penyandang Disabilitas,” Bul. Jendela Data Inf. Kesehat., vol. Semester 2, no. 1, pp. 1–5, 2014.

Song, Y., Luo, Y., & Lin, J. (2011, November). Detection of movements of head and mouth to provide computer access for disabled. In 2011 Conference on Technologies and Applications of Artificial Intelligence (pp. 223-226). IEEE.

Alhargan, A., Cooke, N., & Binjammaz, T. (2017, October). Affect recognition in an interactive gaming environment using eye tracking. In Affective Computing and Intelligent Interaction (ACII), 2017 Seventh International Conference on (pp. 285-291). IEEE.

K. Bierre, M. Hinn, T. Martin, and M. McIntosh, “Accessibility in Games: Motivations and Approaches,” … Pap. Int. Game …, 2004.

B. Yuan, E. Folmer, and F. C. Harris, “Game accessibility: A survey,” Univers. Access Inf. Soc., vol. 10, no. 1, pp. 81–100, 2011.

Palisano, R. J. (2006). A collaborative model of service delivery for children with movement disorders: a framework for evidence-based decision making. Physical Therapy, 86(9), 1295-1305.

Kumar, D., & Sharma, A. (2016, September). Electrooculogram-based virtual reality game control using blink detection and gaze calibration. In Advances in Computing, Communications and Informatics (ICACCI), 2016 International Conference on (pp. 2358-2362). IEEE.

Lu, F., Okabe, T., Sugano, Y., & Sato, Y. (2014). Learning gaze biases with head motion for head pose-free gaze estimation. Image and Vision Computing, 32(3), 169-179.

A. Gardner, J. Kanno, C. A. Duncan, and R. Selmic. 'Measuring distance between unordered sets of different sizes,' in 2014 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), June 2014, pp. 137-143.

A. Gardner, C. A. Duncan, J. Kanno, and R. Selmic. '3D hand posture recognition from small unlabeled point sets,' in 2014 IEEE International Conference on Systems, Man and Cybernetics (SMC), Oct 2014, pp. 164-169.

Vickers, S., Istance, H., & Heron, M. J. (2013, April). Accessible gaming for people with physical and cognitive disabilities: a framework for dynamic adaptation. In CHI'13 Extended Abstracts on Human Factors in Computing Systems (pp. 19-24). ACM.

Chen, T., & Guestrin, C. (2016, August). Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785-794). ACM.

V. Ghini, S. Ferretti, and F. Panzieri, “Mobile Games Through the Nets: A Cross-layer Architecture for Seamless Playing,” Proc. 3rd Int. ICST Conf. Simul. Tools Tech., p. 7:1--7:8, 2010.

M. Furini, “An architecture to easily produce adventure and movie games for the mobile scenario,” Comput. Entertain., vol. 6, no. 2, p. 19:1--19:16, 2008.

Y. Francillette et al., “Development of an Exergame on Mobile Phones to Increase Physical Activity for Adults with Severe Mental Illness,” Proc. 11th PErvasive Technol. Relat. to Assist. Environ. Conf. - PETRA ’18, pp. 241–248, 2018.

K. M. Gerling, R. L. Mandryk, M. V. Birk, M. Miller, and R. Orji, “The effects of embodied persuasive games on player attitudes toward people using wheelchairs,” Proc. 32nd Annu. ACM Conf. Hum. factors Comput. Syst. - CHI ’14, pp. 3413–3422, 2014.

E. Mena and C. Bobed, “Mobile Agents for Mobile Games,” Proc. 2nd Work. Mob. Gaming - MobiGames ’15, pp. 37–42, 2015.

C. Wiberg, “Game-Inspired Architecture and Architecture-Inspired Games,” pp. 68–70.

G. W. Tigwell, R. Menzies, and D. R. Flatla, “Designing for Situational Visual Impairments,” Proc. 2018 Des. Interact. Syst. Conf. 2018 - DIS ’18, pp. 387–399, 2018.

A. Akkawi, S. Schaller, O. Wellnitz, and L. Wolf, “A mobile gaming platform for the IMS,” Proc. ACM SIGCOMM 2004 Work. NetGames ’04 Netw. Syst. Support games - SIGCOMM 2004 Work., p. 77, 2004.

S. Harper, C. Goble, and R. Stevens, “Prototype mobility tools for visually impaired surfers,” Proc. twelfth ACM Conf. Hypertext Hypermedia HYPERTEXT 01, vol. 筑波大学, p. 33, 2001.

P. Service and L. Search, “No Title.”

R. Hamzah and M. I. M. Fadzil, “Voice4Blind: The talking braille keyboard to assist the visual impaired users in text messaging,” Proc. - 2016 4th Int. Conf. User Sci. Eng. i-USEr 2016, pp. 265–270, 2017.

B. Lamont, “Deafblind UK expands operations in Northern Ireland to further reduce isolation and enhance the lives of older deafblind people,” Work. with Older People, vol. 17, no. 4, pp. 164–169, 2013.

D. Doughty and K. Doughty, “Journal of assistive technologies.,” J. Assist. Technol., vol. 7, no. 4, pp. 228–234, 2013.

G. Papanastasiou, A. Drigas, C. Skianis, M. Lytras, and E. Papanastasiou, “Patient-centric ICTs based healthcare for students with learning, physical and/or sensory disabilities,” Telemat. Informatics, vol. 35, no. 4, pp. 654–664, 2018.

O. Lahav, “Virtual reality as orientation and mobility aid for blind people,” J. Assist. Technol., vol. 8, no. 2, pp. 95–107, 2014.

J. Meurer, M. Stein, D. Randall, and V. Wulf, “Designing for way-finding as practices – A study of elderly people’s mobility,” Int. J. Hum. Comput. Stud., vol. 115, pp. 40–51, 2018.

S. Holt and N. Yuill, “Tablets for two: How dual tablets can facilitate other-awareness and communication in learning disabled children with autism,” Int. J. Child-Computer Interact., vol. 11, pp. 72–82, 2017.

Á. Fernández-López, M. J. Rodríguez-Fórtiz, M. L. Rodríguez-Almendros, and M. J. Martínez-Segura, “Mobile learning technology based on iOS devices to support students with special education needs,” Comput. Educ., vol. 61, no. 1, pp. 77–90, 2013.

B. J. Westphal, H. Lee, N.-M. Cheung, C. G. Teo, and W. K. Leong, “Experience of designing and deploying a tablet game for people with dementia,” Proc. 29th Aust. Conf. Comput. Interact. - OZCHI ’17, pp. 31–40, 2017.

B. Leporini and M. Hersh, “Games for the rehabilitation of disabled people,” Proc. 4th Work. ICTs Improv. Patients Rehabil. Res. Tech. - REHAB ’16, pp. 109–112, 2016.

“P335-Gotfrid,” pp. 335–336.

R. M. Bottino, L. Freina, M. Ott, and F. Costa, “Cloud-mobile Assistive Technologies for People with Intellectual Impairments,” Proc. 5th Int. Conf. Digit. Heal. 2015 - DH ’15, pp. 103–104, 2015.

A. G. Szykman, J. P. Gois, and A. L. Brandão, “A Perspective of Games for People with Physical Disabilities,” Proc. Annu. Meet. Aust. Spec. Interes. Gr. Comput. Hum. Interact. - OzCHI ’15, pp. 274–283, 2015.

L. Salvador-Ullauri, A. Jaramillo-Alcázar, and S. Luján-Mora, “A Serious Game Accessible to People with Visual Impairments,” Proc. 2017 9th Int. Conf. Educ. Technol. Comput. - ICETC 2017, vol. 2016, pp. 84–88, 2017.

A. Jaramillo-Alca and S. Luja N-Mora, “Mobile Serious Games: An Accessibility Assessment for People with Visual Impairments,” ACM Ref., vol. 6, pp. 1–6, 2017.

D. Miller, A. Parecki, and S. A. Douglas, “Finger dance: a sound game for blind people,” Proc. 9th Int. ACM SIGACCESS Conf. Comput. Access., pp. 253–254, 2007.

S. B. Fajardo-Flores, L. S. Gaytán-Lugo, P. C. Santana-Mancilla, and M. A. Rodríguez-Ortiz, “Mobile Accessibility for People with Combined Visual and Motor Impairment,” Proc. 8th Lat. Am. Conf. Human-Computer Interact. - CLIHC ’17, pp. 1–4, 2017.

A. Jaramillo-Alcazar, S. Lujan-Mora, and L. Salvador-Ullauri, “Accessibility Assessment of Mobile Serious Games for People with Cognitive Impairments,” 2017 Int. Conf. Inf. Syst. Comput. Sci., pp. 323–328, 2017.

J. M. López, N. M. Medina, and R. P. de Lope, “Interaction in video games for people with impaired visual function,” Proc. XVII Int. Conf. Hum. Comput. Interact. - Interacción ’16, pp. 1–2, 2016.

B. Gallagher and H. Petrie, “Initial results from a critical review of research on technology for older and disabled people,” Proc. 15th Int. ACM SIGACCESS Conf. Comput. Access. - ASSETS ’13, pp. 1–2, 2013.

M. Poyade, G. Morris, I. Taylor, and V. Portela, “Using mobile virtual reality to empower people with hidden disabilities to overcome their barriers,” Proc. 19th ACM Int. Conf. Multimodal Interact. - ICMI 2017, pp. 504–505, 2017.

M. I. H. R’ios, S. S. Silva, E. I. R. D’iaz, and N. T. Monterrosa, “YAMI: Auxiliary Complement to Enable Visually Impaired People to Use Mobile Devices,” Proc. 8th Lat. Am. Conf. Human-Computer Interact., p. 24:1--24:4, 2017.

A. M. Cook and J. M. Polgar, “Technologies that Assist People Who Have Disabilities,” Assist. Technol., pp. 16–39, 2015.

J. Colman, J. Briggs, A. Good, and L. Turner, “Investigating multi-player online video games for brain-injured people,” J. Assist. Technol., vol. 8, no. 3, pp. 124–137, 2014.

L. Chmiliar and C. Anton, “The iPad as a mobile assistive technology device,” J. Assist. Technol., vol. 9, no. 3, pp. 127–135, 2015.

L. Rello, G. Kanvinde, and R. Baeza-Yates, “A mobile application for displaying more accessible ebooks for people with dyslexia,” Procedia Comput. Sci., vol. 14, no. Dsai, pp. 226–233, 2012.

N. Al-Mouh and H. S. Al-Khalifa, “The accessibility and usage of smartphones by Arab-speaking visually impaired people,” Int. J. Pervasive Comput. Commun., vol. 11, no. 4, pp. 418–435, 2015.

S. L. Maatta and L. J. Bonnici, “An evaluation of the functionality and accessibility of e-readers for individuals with print disabilities,” Electron. Libr., vol. 32, no. 4, pp. 493–507, 2014.

E. E. Abdallah and E. Fayyoumi, “Assistive Technology for Deaf People Based on Android Platform,” Procedia Comput. Sci., vol. 94, no. Fnc, pp. 295–301, 2016.

H. Ahn et al., “DOWELL : Dwell-time Based Smartphone Control Solution for People with Upper Limb Disabilities,” CHI EA ’15 Proc. 33rd Annu. ACM Conf. Ext. Abstr. Hum. Factors Comput. Syst., pp. 887–892, 2015.

E. P. S. Nunes, A. R. Luz, E. M. Lemos, C. Maciel, A. M. Anjos, and L. C. L. F. Borges, “Mobile Serious Game Proposal for Environmental Awareness of Children,” 2016.

V. Real and C. Science, “State of the Art of Accessible Development for Smart Devices.”

A. Lopez-Basterretxea, A. Mendez-Zorrilla, B. Garcia-Zapirain, A. Madariaga-Ortuzar, and I. Lazcano-Quintana, “Serious games to promote independent living for intellectually disabled people: Starting with shopping,” Proc. CGAMES 2014 USA - 19th Int. Conf. Comput.