Application of a Question Answering System in the Ontology-Based Health Domain and Question Templates to Improve the Quality of Answers

Efwandha Yudhono; Shaufiah  Shaufiah; Indra Lukmana Sardi

doi:10.37899/journallamultiapp.v5i5.1600

Efwandha Yudhono School of Computing, Telkom University, Bandung, Indonesia
Shaufiah Shaufiah School of Computing, Telkom University, Bandung, Indonesia
Indra Lukmana Sardi School of Computing, Telkom University, Bandung, Indonesia

DOI: https://doi.org/10.37899/journallamultiapp.v5i5.1600

Keywords: Question Answering System (QAS), Ontology, SPARQL, Resource Description, Framework (RDF), Question Template

Abstract

Developing an effective Question Answering System (QAS) to address a wide range of health-related inquiries presents a significant challenge. This study introduces an innovative approach using an ontology-based QAS within the health domain, leveraging the Resource Description Framework (RDF) and SPARQL query language. By utilizing ontology, the system can more accurately map health concepts, improving the relevance and precision of its responses. Additionally, the incorporation of structured Question Templates enhances the system’s ability to understand and respond to diverse user queries. The system's performance was evaluated using Black Box Testing, which demonstrated that it consistently provides accurate and relevant answers. The system achieved a Mean Average Precision (MAP) of 79.6%, indicating its potential to effectively address a broad spectrum of health issues.

References

Abdiansah, A., & Hartati, S. (2015). Analisis Ekstraksi Pengetahuan Eksternal untuk Question Answering System. Seminar Nasional Aplikasi Teknologi Informasi (SNATI).

Altman, M., Huang, T. T. K., & Breland, J. Y. (2018). Design Thinking in Health Care. Preventing Chronic Disease, 15, 180128. https://doi.org/10.5888/pcd15.180128

Arenas, M., Gottlob, G., & Pieris, A. (2014). Expressive Languages for Querying The Semantic Web. Proceedings of the 33rd ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, 14–26. https://doi.org/10.1145/2594538.2594555

Arlinta, C. B. (2019). The Implementation of ATDD and BDD from Testing Perspectives. Journal of Physics: Conference Series, 1175. https://doi.org/10.1088/1742-6596/1175/1/012112

Asiaee, A. H., Minning, T., Doshi, P., & Tarleton, R. L. (2015). A Framework for Ontology-Based Question Answering with Application to Parasite Immunology. Journal of Biomedical Semantics, 6, 1–25.

Beitzel, S. M., Jensen, E. C., & Frieder, O. (2009). MAP. In Encyclopedia of Database Systems (pp. 1691–1692). Springer US. https://doi.org/10.1007/978-0-387-39940-9_492

Crook, P. A., Marin, A., Agarwal, V., Anderson, S., Jang, O., Lanewala, A., Tangirala, K., & Zitouni, I. (2018). Conversational Semantic Search. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, 763–766. https://doi.org/10.1145/3159652.3160590

Faria, D., Pesquita, C., Santos, E., Palmonari, M., Cruz, I. F., & Couto, F. M. (2013). The Agreementmakerlight Ontology Matching System. Conferences: Confederated International Conferences: CoopIS September 9-13, 2013. Proceedings, 527–541.

Gilani, S., Quinn, C., & McArthur, J. J. (2020). A Review of Ontologies Within The Domain of Smart and Ongoing Commissioning. Building and Environment, 182, 107099. https://doi.org/10.1016/j.buildenv.2020.107099

Jones, D., Bench-Capon, T., & Visser, P. (1998). Methodologies for Ontology Development. na.

Juliane, C., Armant, A. A., Sastramihardja, H. S., & Supriana, I. (2018). Question-answer Pair Templates Based on Bloom’s Revised Taxonomy. IOP Conference Series: Materials Science and Engineering, 434. https://doi.org/10.1088/1757-899X/434/1/012281

Lima, R., da Cruz, A. M. R., & Ribeiro, J. (2020, June). Artificial intelligence applied to software testing: A literature review. In 2020 15th Iberian Conference on Information Systems and Technologies (CISTI) (pp. 1-6). IEEE. https://doi.org/10.23919/CISTI49556.2020.9141124

Liu, Y., Yi, X., Chen, R., & Song, Y. (2016, July). A survey on frameworks and methods of question answering. In 2016 3rd International Conference on Information Science and Control Engineering (ICISCE) (pp. 115-119). IEEE.

Murnane, T., Reed, K., & Hall, R. (2006, April). Tailoring of black-box testing methods. In Australian Software Engineering Conference (ASWEC'06) (pp. 8-pp). IEEE. https://doi.org/10.1109/ASWEC.2006.49

Nguyen, T. T. S., Ho, D. H. T., & Nguyen, N. T. A. (2023). An Ontology-Based Question Answering System for University Admissions Advising. Intelligent Automation & Soft Computing, 36(1).

Nimmagadda, S. L., Nimmagadda, S. K., & Dreher, H. (2008, February). Ontology based data warehouse modeling and managing ecology of human body for disease and drug prescription management. In 2008 2nd IEEE International Conference on Digital Ecosystems and Technologies (pp. 212-220). IEEE. https://doi.org/10.1109/DEST.2008.4635209

Paulheim, H., & Hertling, S. (2013, October). WeSeE-Match results for OAEI 2013. In OM (pp. 197-202).

Petrosoniak, A., Hicks, C., Barratt, L., Gascon, D., Kokoski, C., Campbell, D., White, K., Bandiera, G., Lum-Kwong, M. M., Nemoy, L., & Brydges, R. (2020). Design Thinking–Informed Simulation. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare, 15(3), 205–213. https://doi.org/10.1097/SIH.0000000000000408

Purohit, S., Van, N., & Chin, G. (2021, December). Semantic property graph for scalable knowledge graph analytics. In 2021 IEEE International Conference on Big Data (Big Data) (pp. 2672-2677). IEEE.

Sampada, K. S., & Kavya, N. P. (2016, October). Efficient keyword query routing in Linked Data. In 2016 International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS) (pp. 345-349). IEEE. https://doi.org/10.1109/CSITSS.2016.7779383

Samreen, S., Mirza, J. S., & Rasheed, A. (2013). RDF and OWL Ontology Building of Web Applications. Research Journal of Information Technology, 5(4), 109–117. https://doi.org/10.19026/rjit.5.5795

Sauwa, F., Suryani, A., & Suharto, T. (2014). Analisa Keterhubungan Ontology Pada Web Semantik Menggunakan Terminological-Based Ontology Matching. EProceedings of Engineering, 1(1).

Slifmani, T. (2015). A study Investigating Typical Concepts and Guidelines for Ontology Building. Journal of Emerging Trends in Computing and Information Science, 5(2), 886–893.

Soares, M. A. C., & Parreiras, F. S. (2020). A Literature Review on Question Answering Techniques, Paradigms and Systems. Journal of King Saud University-Computer and Information Sciences, 32(6), 635–646.

Syarief, M., Agustiono, W., Muntasa, A., & Yusuf, M. (2020). A Conceptual Model of Indonesian Question Answering System Based on Semantic Web. Journal of Physics: Conference Series, 1569(2). https://doi.org/10.1088/1742-6596/1569/2/022089

Taye, M. M. (2010). Understanding Semantic Web and Ontologies: Theory and Applications. Journal of Computing, 2(6).

Tian, S., Jin, Q., Yeganova, L., Lai, P.-T., Zhu, Q., Chen, X., Yang, Y., Chen, Q., Kim, W., Comeau, D. C., Islamaj, R., Kapoor, A., Gao, X., & Lu, Z. (2023). Opportunities and Challenges for ChatGPT and large Language Models in Biomedicine and Health. Briefings in Bioinformatics, 25(1). https://doi.org/10.1093/bib/bbad493

Umar, M. A. (2019). Comprehensive Study of Software Testing: Categories, Levels, Techniques, and Types. International Journal of Advance Research, Ideas and Innovations in Technology, 5(6), 32–40.

Wang, D. S. (2010, June). A domain-specific question answering system based on ontology and question templates. In 2010 11th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (pp. 151-156). IEEE. https://doi.org/10.1109/SNPD.2010.31

Wolcott, M. D., McLaughlin, J. E., Hubbard, D. K., Rider, T. R., & Umstead, K. (2021). Twelve Tips to Stimulate Creative Problem-Solving with Design Thinking. Medical Teacher, 43(5), 501–508. https://doi.org/10.1080/0142159X.2020.1807483

Yunmar, R. A., & Wisesa, I. W. W. (2020). Pengembangan Mobile Based Question Answering System dengan Basis Pengetahuan Ontologi. Jurnal Teknologi Informasi Dan Ilmu Komputer, 7(4), 693–700. https://doi.org/10.25126/jtiik.2020742255

Zhang, H., Guo, Y., Li, Q., George, T. J., Shenkman, E., Modave, F., & Bian, J. (2018). An Ontology-Guided Semantic Data Integration Framework to Support Integrative Data Analysis of Cancer Survival. BMC Medical Informatics and Decision Making, 18(S2), 41. https://doi.org/10.1186/s12911-018-0636-4.