Healthc Inform Res.  2014 Jan;20(1):69-75. 10.4258/hir.2014.20.1.69.

Lifelog Agent for Human Activity Pattern Analysis on Health Avatar Platform

• Kwon Y
• Kang K
• Bae C
• Chung HJ
• Kim JH

• KMID: 2166741
• DOI: http://doi.org/10.4258/hir.2014.20.1.69

Abstract

OBJECTIVES
To provide accurate personalized medical care, it is necessary to gather individual-related data or contextual information regarding the target person. Nowadays a large number of people possess smartphones, which enables sensors in the smartphones to be used for lifelogging. The objective of the study is to analyze human activity pattern by using lifelog agent cooperating with the Health Avatar platform.
METHODS
Using the lifelog measured by accelerometer and gyroscope in a smartphone at a 50 Hz rate, the agent reveals how long the user walks, runs, sits, stands, and lies down, and this information is summarized by hours. The summaries are sent to the Health Avatar platform and finally are written in the Continuity of Care Record (CCR) format.
RESULTS
The lifelog agent is successfully operated with the Health Avatar platform. In addition, we implement an application that displays the user's activity patterns in a graph and calculates the metabolic equivalent of task based calorie burned by hour or by day using the lifelog of the CCR form to show that the lifelog can be used as medical records.
CONCLUSIONS
The agent shows how lifelogs are analyzed and summarized to help activity recognition. We believe that our agent demonstrates a way of incorporating lifelogs into medical care and a way of exploiting lifelogs in a medical format.

Keyword

Activities of Daily Living; Health Behavior; Mobile Phone; Automated Pattern Recognition; Medical Records

MeSH Terms

4-Acetamido-4'-isothiocyanatostilbene-2,2'-disulfonic Acid
Activities of Daily Living
Burns
Continuity of Patient Care
Health Behavior
Human Activities*
Humans*
Medical Records
Metabolic Equivalent
Pattern Recognition, Automated
Smartphone
4-Acetamido-4'-isothiocyanatostilbene-2,2'-disulfonic Acid

Figure

• 

  Figure 1 Architecture of Health Avatar platform. CCR: Continuity of Care Record.

• 

  Figure 2 Relationship between lifelog agent and Health Avatar platform. CCR: Continuity of Care Record.

• 

  Figure 3 Process of activity pattern analysis.

• 

  Figure 4 Example of lifelog summary in the Continuity of Care Record (CCR) format.

• 

  Figure 5 Screenshots of the application for monitoring activity patterns and calorie burned.

Reference

1. Amft O, Troster G. Recognition of dietary activity events using on-body sensors. Artif Intell Med. 2008; 42(2):121–136.

2. Zwartjes D, Heida T, van Vugt J, Geelen J, Veltink P. Ambulatory monitoring of activities and motor symptoms in Parkinson's disease. IEEE Trans Biomed Eng. 2010; 57(11):2778–2786.

3. Sazonov ES, Fulk G, Sazonova N, Schuckers S. Automatic recognition of postures and activities in stroke patients. Conf Proc IEEE Eng Med Biol Soc. 2009; 2009:2200–2203.

4. Sazonov ES, Fulk G, Hill J, Schutz Y, Browning R. Monitoring of posture allocations and activities by a shoe-based wearable sensor. IEEE Trans Biomed Eng. 2011; 58(4):983–990.

5. Warren JM, Ekelund U, Besson H, Mezzani A, Geladas N, Vanhees L, et al. Assessment of physical activity: a review of methodologies with reference to epidemiological research: a report of the exercise physiology section of the European Association of Cardiovascular Prevention and Rehabilitation. Eur J Cardiovasc Prev Rehabil. 2010; 17(2):127–139.

6. Arcelus A, Herry CL, Goubran RA, Knoefel F, Sveistrup H, Bilodeau M. Determination of sit-to-stand transfer duration using bed and floor pressure sequences. IEEE Trans Biomed Eng. 2009; 56(10):2485–2492.

7. Fujita T, Masaki K, Maenaka K. Human activity monitoring system using MEMS sensors and machine learning. J Jpn Soc Fuzzy Theory Intell Inform. 2008; 20(1):3–8.

8. Shahriyar R, Bari MF, Kundu G, Ahamed SI, Akbar MM. Intelligent Mobile Health Monitoring System (IMHMS). Int J Control Autom. 2009; 2(3):13–28.

9. Mena LJ, Felix VG, Ostos R, Gonzalez JA, Cervantes A, Ochoa A, et al. Mobile personal health system for ambulatory blood pressure monitoring. Comput Math Methods Med. 2013; 2013:598196.

10. Chung HJ. Health avatar: an informatics platform for personal and private big data of avatars and health agents. In : Medical Informatics Symposium in Bio-Medical Informatics for Future Medicine; 2013 Nov 11-13; Busan, Korea.

11. ASTM. Standard specification for Continuity of Care Record (CCR). West Conshohocken (PA): ASTM International;2012. (ASTM Standard E2369-12).

12. Kwon Y, Heo S, Kang K, Bae C. Personal lifelog upstreaming system for secure and reliable lifelog transmission. Int J Inf Proc Manag. 2013; 4(2):36–44.

13. Rivest RL, Shamir A, Adleman L. A method for obtaining digital signatures and public-key cryptosystems. Commun ACM. 1978; 21(2):120–126.

14. Daemon J, Rijmen V. Rijndael for AES. In : Proceedings of the 3rd AES Candidate Conference; 2000 Apr 13-14; New York, USA. p. 343–348.

15. Cooley JW, Tukey JW. An algorithm for the machine calculation of complex Fourier series. Math Comp. 1965; 19(90):297–301.

16. Bae C, Yeh WC, Shukran MA, Chung YY, Hsieh TJ. A novel anomaly-network intrusion detection system using ABC algorithm. Int J Innov Comput Inf Control. 2012; 8(12):8231–8248.

17. Kwon Y, Heo S, Kang K, Bae C. Particle swarm optimization using adaptive boundary correction for human activity recognition. In : Proceedings of the International Conference on Internet; 2013 Dec 12-16; Pattaya, Thailand.

18. Ainsworth BE, Haskell WL, Herrmann SD, Meckes N, Bassett DR Jr, Tudor-Locke C, et al. 2011 Compendium of Physical Activities: a second update of codes and MET values. Med Sci Sports Exerc. 2011; 43(8):1575–1581.