Visualizing Semantic Structure of a Clinical Text Document
Article Main Content
The increasing use of Electronic Health Records (EHRs) in healthcare delivery settings has led to increase availability of electronic clinical data. They generate a lot of patients’ clinical data each day, requiring physicians to review them to find clinically relevant information of different patients during care episodes. The availability of electronically collected healthcare data has created the need of computational tools to analyze them. One of the types of data which doctors have access to is clinical notes that resides in electronic health records. These notes are useful as they provide comprehensive information about patients’ health histories with many practical uses. For example, doctors always review these notes during care episodes to appraise themselves about the health history of a patient. These reviews are currently manual where a doctor reads a patient’s chart while looking for specific clinical information. Without the proper support, this manual process leads to information overload and increases physician cognitive workload. Current electronic health records (EHRs) do not provide support to help physicians reduce cognitive workload when completing clinical tasks. This is especially true for long clinical documents which require quick review at the point of care. The growing amount of clinical documentation available in EHRs has arose the need of tools that support synthesize of information in EHRs. The use of visual analytics to explore healthcare data is one such research direction to address this problem. However, existing visualization techniques are mainly based on structured electronic health record and rarely support therapeutic activities. Therefore, visualization of unstructured clinical records to support clinical practice is required. In this paper we propose a unique approach for graphically representing and visualizing the semantic structure of a clinical text document to aid doctors in reviewing electronic clinical notes. A user evaluation demonstrates that the proposed method for visualizing and navigating a document’s semantic structure facilitates a user’s document information exploration.
References
-
Wang, Y., Tafti, A.P., Sohn, S., & Zhang, R. (2019). Applications of Natural Language Processing in Clinical Research and Practice. NAACL-HLT.
Google Scholar
1
-
Meystre, S., Savova, G., Kipper-schuler, K., & Hurdle, J. (2008). Extracting information from textual documents in the electronic health record: a review of recent research. Yearbook of medical informatics, 128-44 .
Google Scholar
2
-
Laxmisan, A., McCoy, A. B., Wright, A., & Sittig, D. F. (2012). Clinical Summarization Capabilities of Commercially-available and Internally-developed Electronic Health Records. Applied Clinical Informatics, 3(1), pp. 80?93. http://doi.org/10.4338/ACI-2011-11-RA-0066.
Google Scholar
3
-
Katal, A., Wazid, M., & Goudar, R.H. (2013). Big data: Issues, challenges, tools and Good practices. 2013 Sixth International Conference on Contemporary Computing (IC3), 404-409.
Google Scholar
4
-
Jonnalagadda, S. R., Del Fiol, G., Medlin, R., Weir, C., Fiszman, M., Mostafa, J., & Liu, H. (2013). Automatically extracting sentences from Medline citations to support clinicians' information needs. Journal of the American Medical Informatics Association: JAMIA, 20(5), 995?1000. https://doi.org/10.1136/amiajnl-2012-001347.
Google Scholar
5
-
Taylor, C., 2020. Structured Vs. Unstructured Data. [online] Datamation.com. Available at: <https://www.datamation.com/big-data/structured-vs-unstructured-data.html> [Accessed 2 August 2020].
Google Scholar
6
-
Sun, W., Cai, Z., Li, Y., Liu, F., Fang, S., & Wang, G. (2018). Data Processing and Text Mining Technologies on Electronic Medical Records: A Review. Journal of Healthcare Engineering, 2018.
Google Scholar
7
-
Huang, K., Altosaar, J., & Ranganath, R. (2019). ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission. ArXiv, abs/1904.05342.
Google Scholar
8
-
Barbulescu, M., Grigoriu, R., Halcu, I., Neculoiu, G., Sandulescu, V. C., Marinescu, M., & Marinescu, V. (2013). Integrating of structured, semi-structured and unstructured data in natural and build environmental engineering. In 2013 11th RoEduNet International Conference (pp. 1?4). IEEE. doi:10.1109/RoEduNet.2013.6511738.
Google Scholar
9
-
Farri, O., Pieczkiewicz, D.S., Rahman, A., Pakhomov, S.V., Adam, T., & Melton, G.B. (2012). A Qualitative Analysis of EHR Clinical Document Synthesis by Clinicians. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2012, 1211-20.
Google Scholar
10
-
Farri, O., Monsen, K.A., Pakhomov, S.V., Pieczkiewicz, D.S., Speedie, S.M., & Melton, G.B. (2013). Effects of time constraints on clinician-computer interaction: A study on information synthesis from EHR clinical notes. Journal of biomedical informatics, 46 6, 1136-44.
Google Scholar
11
-
Pollack, A.H., & Pratt, W. (2020). Association of Health Record Visualizations With Physicians? Cognitive Load When Prioritizing Hospitalized Patients. JAMA Network Open, 3.
Google Scholar
12
-
Farri, O. (2012). Understanding Clinician Information Demands and Synthesis of Clinical Documents in Electronic Health Record Systems.
Google Scholar
13
-
Bui, A.A., Aberle, D., & Kangarloo, H. (2007). TimeLine: Visualizing Integrated Patient Records. IEEE Transactions on Information Technology in Biomedicine, 11, 462-473.
Google Scholar
14
-
Farri, O., Rahman, A., Monsen, K. A., Zhang, R., Pakhomov, S. V., Pieczkiewicz, D. S., ? Melton, G. B. (2012). Impact of of a Prototype Visualization Tool for New Information in EHR Clinical Documents. Applied Clinical Informatics, 3(4), 404?418. http://doi.org/10.4338/ACI-2012-05-RA-0017.
Google Scholar
15
-
Ruan, W., Appasani, N., Kim, K., Vincelli, J., Kim, H., & Lee, W. (2018). Pictorial Visualization of EMR Summary Interface and Medical Information Extraction of Clinical Notes. 2018 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), 1-6.
Google Scholar
16
-
Deng, Y., & Denecke, K. (2014). Visualizing Unstructured Patient Data for Assessing Diagnostic and Therapeutic History. Studies in health technology and informatics, 205, 1158-1162.
Google Scholar
17
-
Ledesma, A., Bidargaddi, N., Strobel, J.E., Schrader, G., Nieminen, H., Korhonen, I., & Ermes, M. (2019). Health timeline: an insight-based study of a timeline visualization of clinical data. BMC Medical Informatics and Decision Making, 19(170).
Google Scholar
18
-
Bui, A., Aberle, D.R., Kangarloo, H., (2007). TimeLine: Visualizing Integrated Patient Records. IEEE Transactions on Information Technology in Biomedicine 11(4), pp.462-473.
Google Scholar
19
-
Interactive Visualization and Exploration of Patient Progression in a Hospital Setting.
Google Scholar
20
-
Dornan, L., Pinyopornpanish, K., Jiraporncharoen, W., Hashmi, A.H., Dejkriengkraikul, N., & Angkurawaranon, C. (2019). Utilisation of Electronic Health Records for Public Health in Asia: A Review of Success Factors and Potential Challenges. BioMed Research International, 2019.
Google Scholar
21
-
Boonstra, A., Versluis, A., & Vos, J.F. (2014). Implementing electronic health records in hospitals: a systematic literature review. BMC Health Services Research, 14.
Google Scholar
22
-
Wolfe, L., Chisolm, M.S., & Bohsali, F. (2018). Clinically Excellent Use of the Electronic Health Record: Review. JMIR Human Factors, 5.
Google Scholar
23
-
Pivovarov, R., & Elhadad, N. (2015). Automated methods for the summarization of electronic health records. Journal of the American Medical Informatics Association: JAMIA, 22(5), 938?947. https://doi.org/10.1093/jamia/ocv032.
Google Scholar
24
-
Schopf, T.R., Nedreb?, B., Hufthammer, K.O., Daphu, I.K., & L?rum, H. (2019). How well is the electronic health record supporting the clinical tasks of hospital physicians? A survey of physicians at three Norwegian hospitals. BMC Health Services Research, 19.
Google Scholar
25
-
Menachemi, N., & Collum, T.H. (2011). Benefits and drawbacks of electronic health record systems. Risk Management and Healthcare Policy, 4, 47 - 55.
Google Scholar
26
-
Bates, D.W., Teich, J.M., Lee, J., Seger, D.L., Kuperman, G.J., Ma'Luf, N., Boyle, D., & Leape, L. (1999). Research Paper: The Impact of Computerized Physician Order Entry on Medication Error Prevention. Journal of the American Medical Informatics Association : JAMIA, 6 4, 313-21.
Google Scholar
27
-
Bates, D.W., Leape, L., Cullen, D.J., Laird, N., Petersen, L.A., Teich, J.M., Burdick, E., Hickey, M., Kleefield, S., Shea, B., Vliet, M.V., & Seger, D.L. (1998). Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA, 280 15, 1311-6.
Google Scholar
28
-
HealthIT. ?Improved Diagnostics & Patient Outcomes.? HealthIT.gov. http://www.healthit.gov/providers-professionals/improved-diagnostics-patient-outcomes. Updated June 2019. Accessed May 2020.
Google Scholar
29
-
Landi, I., Glicksberg, B., Lee, H., Cherng, S.T., Landi, G., Danieletto, M., Dudley, J., Furlanello, C., & Miotto, R. (2020). Deep representation learning of electronic health records to unlock patient stratification at scale. NPJ Digital Medicine, 3.
Google Scholar
30
-
Koopman, R.J., Steege, L.M., Moore, J.L., Clarke, M.A., Canfield, S.M., Kim, M.S., & Belden, J.L. (2015). Physician Information Needs and Electronic Health Records (EHRs): Time to Reengineer the Clinic Note. Journal of the American Board of Family Medicine : JABFM, 28 3, 316-23.
Google Scholar
31
-
Mujjiga, S., Krishna, V., Chakravarthi, K., & Vijayananda, J. (2019). Identifying Semantics in Clinical Reports Using Neural Machine Translation. AAAI.
Google Scholar
32
-
Reis, J.C., Bonacin, R., & Perciani, E.M. (2016). Intention-Based Information Retrieval of Electronic Health Records. 2016 IEEE 25th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE), 217-222.
Google Scholar
33
-
Hultman, G.M., Marquard, J.L., Lindemann, E., Arsoniadis, E.G., Pakhomov, S.V., & Melton, G.B. (2019). Challenges and Opportunities to Improve the Clinician Experience Reviewing Electronic Progress Notes. Applied clinical informatics, 10 3, 446-453.
Google Scholar
34
-
Reichert, D., Kaufman, D., Bloxham, B., Chase, H., & Elhadad, N. (2010). Cognitive analysis of the summarization of longitudinal patient records. AMIA ... Annual Symposium proceedings. AMIA Symposium, 2010, 667?671.
Google Scholar
35
-
Nordo, A.H., Levaux, H.P., Becnel, L.B., G?lvez, J., Rao, P.K., Stem, K., Prakash, E., & Kush, R.D. (2019). Use of EHRs data for clinical research: Historical progress and current applications. Learning Health Systems, 3.
Google Scholar
36
-
Juhn, Y.J., & Liu, H. (2019). Natural language processing to advance EHR-based clinical research in Allergy, Asthma, and Immunology. The Journal of allergy and clinical immunology.
Google Scholar
37
-
Meystre, S.M., Lovis, C., B?rkle, T., Tognola, G., Budrionis, A., & Lehmann, C.U. (2017). Clinical Data Reuse or Secondary Use: Current Status and Potential Future Progress. Yearbook of medical informatics, 26 1, 38-52.
Google Scholar
38
-
Beresniak, A., Schmidt, A., Proeve, J., Bola?os, E., Patel, N., Ammour, N., Sundgren, M., Ericson, M., Karakoyun, T., Coorevits, P.L., Kalra, D., Moor, G.J., & Dupont, D. (2016). Cost-benefit assessment of using electronic health records data for clinical research versus current practices: Contribution of the Electronic Health Records for Clinical Research (EHR4CR) European Project. Contemporary clinical trials, 46, 85-91.
Google Scholar
39
-
Arbabi, A., Adams, D.R., Fidler, S., & Brudno, M. (2019). Identifying Clinical Terms in Medical Text Using Ontology-Guided Machine Learning. JMIR Medical Informatics, 7.
Google Scholar
40
-
Hultman, G.M., Marquard, J.L., Lindemann, E., Arsoniadis, E.G., Pakhomov, S.V., & Melton, G.B. (2019). Challenges and Opportunities to Improve the Clinician Experience Reviewing Electronic Progress Notes. Applied clinical informatics, 10 3, 446-453.
Google Scholar
41
-
Su, Y., Chao, C., Hung, L., Sung, S., & Lee, P. (2020). A Natural Language Processing Approach to Automated Highlighting of New Information in Clinical Notes. Applied Sciences, 10, 2824.
Google Scholar
42
-
Clarke, M.A., Belden, J.L., Koopman, R.J., Steege, L.M., Moore, J.L., Canfield, S.M., & Kim, M.S. (2013). Information needs and information-seeking behaviour analysis of primary care physicians and nurses: a literature review. Health information and libraries journal, 30(3), 178-190.
Google Scholar
43
-
McEnery, K. W. 2018. Reference Guide in Information
Google Scholar
44
-
Technology for the Practicing Radiologist. American College of Radiology.
Google Scholar
45
-
Ajami S, Bagheri-Tadi T. Barriers for adopting electronic health records (EHRs) by physicians. Acta Informatica Medica 2013;21:129. pmid:24058254
Google Scholar
46
-
View ArticlePubMed/NCBIGoogle Scholar.
Google Scholar
47
-
Roman, L.C., Ancker, J., Johnson, S., & Senathirajah, Y. (2017). Navigation in the electronic health record: A review of the safety and usability literature. Journal of biomedical informatics, 67, 69-79.
Google Scholar
48
-
Reisman, M. (2017). EHRs: The Challenge of Making Electronic Data Usable and Interoperable. P & T : a peer-reviewed journal for formulary management, 42 9, 572-575.
Google Scholar
49
-
Jensen, P., Jensen, L. & Brunak, S. Mining electronic health records: towards better research applications and clinical care. Nat Rev Genet 13, 395?405 (2012). https://doi.org/10.1038/nrg3208.
Google Scholar
50
-
Ben-Assuli, O., Ziv, A., Sagi, D., Leshno, M., & Ironi, A. (2014). Improving Diagnostic Accuracy Using EHR in Emergency Departments: A Simulation-Based Study. Journal of biomedical informatics, 55, 31-40.
Google Scholar
51
-
Aleksi, D.S., Rajkovi, P., Vukovi, D., Jankovi, D., & Milenkovi, A. (2017). Data summarization method for chronic disease tracking. Journal of Biomedical Informatics, 69, 188-202.
Google Scholar
52
-
Samal, L., Wright, A., Wong, B., Linder, J., & Bates, D. (2011). Leveraging electronic health records to support chronic disease management: the need for temporal data views. Informatics in primary care, 19 2, 65-74.
Google Scholar
53
-
Lesselroth, B.J., & Pieczkiewicz, D.S. (2011). Data Visualization Strategies for the Electronic Health Record.
Google Scholar
54
-
Ledesma, A., Bidargaddi, N., Strobel, J., Schrader, G., Nieminen, H., Korhonen, I., & Ermes, M. (2019). Health timeline: an insight-based study of a timeline visualization of clinical data. BMC Medical Informatics and Decision Making, 19.
Google Scholar
55
-
West, V., Borland, D. and Hammond, W. (2014). Innovative information visualization of electronic health record data: a systematic review. Journal of the American Medical Informatics Association.
Google Scholar
56
-
Roque, F., Slaughter, L.A., & Tkatsenko, A. (2010). A Comparison of Several Key Information Visualization Systems for Secondary Use of Electronic Health Record Content. In: Proceedings of NAACL HLT Workshop on Text and Data Mining of Health Documents, pp.1?8.
Google Scholar
57
-
Rind, A., Wang, T. D., Aigner, W., Miksh, S., Wongsuphasawat, K., Plaisant, C., and Shneiderman, B (2013). Interactive Information Visualization to Explore and Query Electronic Health Records. Foundations and Trends in Human?Computer Interaction, 5(3), pp.207-298.
Google Scholar
58
-
Sultanum, N., Singh, D.A., Brudno, M., & Chevalier, F. (2018). Doccurate: A Curation-Based Approach for Clinical Text Visualization. IEEE transactions on visualization and computer graphics.
Google Scholar
59
-
Trivedi, G., Pham, P., Chapman, W.W., Hwa, R., Wiebe, J., & Hochheiser, H. (2018). NLPReViz: an interactive tool for natural language processing on clinical text. Journal of the American Medical Informatics Association: JAMIA, 25(1), pp. 81-87.
Google Scholar
60
-
Yerebakan, H.Z., Shinagawa, Y., Bhatia, P.S., & Zhan, Y. (2018). Document Representation Learning for Patient History Visualization. COLING.
Google Scholar
61
-
West, V. L., Borland, D., & Hammond, W. E. (2015). Innovative information visualization of electronic health record data: a systematic review. Journal of the American Medical Informatics Association : JAMIA, 22(2), pp. 330?339. http://doi.org/10.1136/amiajnl-2014-002955.
Google Scholar
62
-
Plaisant, C., Mushlin, R., Snyder, A., Li, J., Heller, D., & Shneiderman, B. (1998). LifeLines: using visualization to enhance navigation and analysis of patient records. Proceedings. AMIA Symposium, 76-80.
Google Scholar
63
-
Wang, T.D., Plaisant, C., Quinn, A.J., Stanchak, R., Murphy, S., & Shneiderman, B. (2008). Aligning temporal data by sentinel events: discovering patterns in electronic health records. CHI.
Google Scholar
64
-
Zhang, Z., Ahmed, F., Mittal, A., Zhao, R., Viccellio, A., & Mueller, K. (2011). AnamneVis: A Framework for the Visualization of Patient History and Medical Diagnostics Chains.
Google Scholar
65
-
Plaisant, C., Milash, B., Rose, A., Widoff, S., & Shneiderman, B. (1996). LifeLines: visualizing personal histories. CHI '96.
Google Scholar
66
-
West, V. L., Borland, D., & Hammond, W. E. (2015). Innovative information visualization of electronic health record data: a systematic review. Journal of the American Medical Informatics Association : JAMIA, 22(2), 330?339. https://doi.org/10.1136/amiajnl-2014-002955.
Google Scholar
67
-
Plaisant, C., Mushlin, R., Snyder, A., Li, J., Heller, D., & Shneiderman, B. (1998). LifeLines: using visualization to enhance navigation and analysis of patient records. Proceedings. AMIA Symposium, 76-80.
Google Scholar
68
-
Plaisant, C., Milash, B., Rose, A., Widoff, S., & Shneiderman, B. (1996). LifeLines: visualizing personal histories. CHI '96.
Google Scholar
69
-
Martins, S.B., Shahar, Y., Goren-Bar, D., Galperin-Aizenberg, M., Kaizer, H., Basso, L., McNaughton, D., & Goldstein, M. (2008). Evaluation of an architecture for intelligent query and exploration of time-oriented clinical data. Artificial intelligence in medicine, 43 1, 17-34.
Google Scholar
70
-
Klimov, D., Shahar, Y., & Taieb-Maimon, M. (2010). Intelligent visualization and exploration of time-oriented data of multiple patients. Artificial intelligence in medicine, 49 1, 11-31.
Google Scholar
71
-
Klimov, D., Shahar, Y., & Taieb-Maimon, M. (2009). Intelligent interactive visual exploration of temporal associations among multiple time-oriented patient records. Methods of information in medicine, 48 3, 254-62.
Google Scholar
72
-
Ola, O., & Sedig, K. (2016). Beyond simple charts: Design of visualizations for big health data. Online Journal of Public Health Informatics, 8.
Google Scholar
73
-
Sahu, M., & Maringanti, H.B. (2016). Cognitive Architectural Model for Solving Clustering Problem. FICTA.
Google Scholar
74
-
Andrus, M.R., Mcdonough, S.K., Kelley, K., Stamm, P.L., McCoy, E., Lisenby, K.M., Whitley, H., Slater, N.A., Carroll, D., Hester, E., Helmer, A., Jackson, C.W., & Byrd, D. (2018). Development and Validation of a Rubric to Evaluate Diabetes SOAP Note Writing in APPE. American Journal of Pharmaceutical Education, 82.
Google Scholar
75
-
Lisenby, K.M., Andrus, M.R., Jackson, C.W., Stevenson, T., Fan, S., Gaillard, P., & Carroll, D. (2018). Ambulatory care preceptors' perceptions on SOAP note writing in advanced pharmacy practice experiences (APPEs). Currents in pharmacy teaching & learning, 10 12, 1574-1578.
Google Scholar
76
-
[4] Cresswell, S. (2016, October 13). Understanding SOAP format for Clinical Rounds. Retrieved from https://www.gapmedics.com/blog/2015/01/02/understanding-soap-format-for-clinical-rounds/.
Google Scholar
77
-
Mowery, D., Wiebe, J., Visweswaran, S., Harkema, H., & Chapman, W. (2012). Building an automated SOAP classifier for emergency department reports. Journal of biomedical informatics, 45 1, 71-81.
Google Scholar
78
-
March, S. T. and Smith, G. F. (1995) Design and natural science research on information technology, in Decision Support Systems, 15(4): 251-266.
Google Scholar
79
-
Hevner, A. R., March, S. T., Park, J., and Ram, S. (2004) Design science in information systems research. In MIS Quarterly 28 (1):75-105.
Google Scholar
80
-
Norman, K.L. & Schneiderman, B. (2017) QUIS: Questionnaire for UserInteraction Satisfaction. Vol. 2017 University of Maryland.
Google Scholar
81
-
Marghescu, D., & Rajanen, M. (2004). Evaluating the Quality of Use of Visual Data-Mining Tools.
Google Scholar
82
-
Lewis, J.R. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human?Computer Interaction, 34, 577 - 590.
Google Scholar
83
-
Brooke, J. (1996) SUS - A quick and dirty usability scale. Usability evaluation inindustry, 189(194), 4-7.
Google Scholar
84
-
Bangor, A., Kortum, P. & Miller, J. (2009) Determining what individual SUSscores mean: adding an adjective rating scale. J. Usability Studies, 4(3),114-123.
Google Scholar
85
-
Brooke, J. (2013) SUS: a retrospective. J. Usability Studies, 8(2), 29-40.
Google Scholar
86
Most read articles by the same author(s)
-
Frankline Makokha,
Christopher K. Chepken,
Elisha Opiyo,
A Comparative Study of a Client Based Vendor Neutral Cloud QoS Monitoring Tool and Cloud Providers’ Platform Integrated QoS Monitoring Tools , European Journal of Electrical Engineering and Computer Science: Vol. 4 No. 1 (2020)





