Grant Number:	1R01CA165255-01 Interpret this number
Primary Investigator:	Sun, Mingui
Organization:	University Of Pittsburgh At Pittsburgh
Project Title:	Wearable Ebutton for Evaluation of Energy Balance with Environmental Context and
Fiscal Year:	2012

DESCRIPTION (provided by applicant): Wearable eButton for Evaluation of Energy Balance with Environmental Context and Behavior Overweight and obesity have become a wide spread epidemic affecting more than 60% of the population in the United States. A recent study indicates that the estimated direct and indirect costs of obesity to the U.S. economy are at least $215 billion annually. In the battle against obesity and related diseases, both the research and clinical communities require an accurate tool to measure people's energy intake and expenditure in real life. However, presently, the most utilized tool is still a questionnaire which is subjective and often inaccurate. The current state-of-the-art in diet and physical activity measurement has fallen far behind what the modern technology is able to provide. The field is mature for a substantial innovation. In this application, we propose the development of a new electronic device which has the potential to produce a technological quantum leap in the measurement of diet and physical activity. This button- like device, eButton, will be worn naturally on the chest using a pair of magnets or a pin. A new measurement concept based on the use of the wearable computer will be utilized in our device design. The eButton will contain a low-power, high-performance microprocessor running a simplified version of the LINUX operating system. It will contain numerous innovative designs, including an optical eating detector to monitor eating/drinking/smoking, two miniature cameras that produce a stereo vision to measure food portion size without depending on a reference card, an ear-based oximeter for measurement of heart rate and oxygen saturation, and an extrapolation formula to measure outdoor environment using the US environmental protection agency (EPA) database. eButton will store the multimedia data acquired by a variety of advanced miniature sensors in a flash memory within the device. It will also have a wireless link to a smart phone which will allow researchers to monitor the operating status of eButton remotely in real time. All sensors and function modules will be individually controlled by software to allow researchers to select among the available system resources for their particular needs. Despite the wide functionality of the device, eButton requires an extremely low user respondent burden. The research participant is required to do nothing more than turning on/off the device and recharging its battery at night. During our research, eButton and associated algorithms/software will be designed and constructed in our laboratory by an experienced team of electronic/software engineers based on an early version of the device developed under the NIH GEI diet and physical activity research program. Once eButton is constructed, we will implement a thorough validation process using human subjects to evaluate its accuracy in diet and physical activity assessment by comparing against the doubly-labeled water method as the gold standard. PUBLIC HEALTH RELEVANCE: The primary goal of this research is to develop an advanced, button-like electronic device (eButton) that can be worn naturally on the chest. This device will contain a powerful microprocessor, a novel eating detector, a pair of cameras, and a variety of electronic sensors to automatically, jointly and objectively measure energy intake and expenditure, as well as environment and behavior related to diet and physical activity. All these measurements will be conducted with an extremely low respondent burden to research participants.




Improved Wearable Devices for Dietary Assessment Using a New Camera System.
Authors: Sun M. , Jia W. , Chen G. , Hou M. , Chen J. , Mao Z.H. .
Source: Sensors (basel, Switzerland), 2022-10-20 00:00:00.0; 22(20), .
EPub date: 2022-10-20 00:00:00.0.
PMID: 36298356
Related Citations

An automatic electronic instrument for accurate measurements of food volume and density.
Authors: Yuan D. , Hu X. , Zhang H. , Jia W. , Mao Z.H. , Sun M. .
Source: Public Health Nutrition, 2020-08-28 00:00:00.0; , p. 1-8.
EPub date: 2020-08-28 00:00:00.0.
PMID: 32854804
Related Citations

The Healthy Cooking Index: Nutrition Optimizing Home Food Preparation Practices across Multiple Data Collection Methods.
Authors: Raber M. , Baranowski T. , Crawford K. , Sharma S.V. , Schick V. , Markham C. , Jia W. , Sun M. , Steinman E. , Chandra J. .
Source: Journal Of The Academy Of Nutrition And Dietetics, 2020 Jul; 120(7), p. 1119-1132.
EPub date: 2020-04-09 00:00:00.0.
PMID: 32280056
Related Citations

Automatic food detection in egocentric images using artificial intelligence technology.
Authors: Jia W. , Li Y. , Qu R. , Baranowski T. , Burke L.E. , Zhang H. , Bai Y. , Mancino J.M. , Xu G. , Mao Z.H. , et al. .
Source: Public Health Nutrition, 2019 05; 22(7), p. 1168-1179.
EPub date: 2018-03-26 00:00:00.0.
PMID: 29576027
Related Citations

Image-based food portion size estimation using a smartphone without a fiducial marker.
Authors: Yang Y. , Jia W. , Bucher T. , Zhang H. , Sun M. .
Source: Public Health Nutrition, 2019 05; 22(7), p. 1180-1192.
EPub date: 2018-04-06 00:00:00.0.
PMID: 29623867
Related Citations

A Hierarchical Deep Fusion Framework for Egocentric Activity Recognition Using a Wearable Hybrid Sensor System.
Authors: Yu H. , Pan G. , Pan M. , Li C. , Jia W. , Zhang L. , Sun M. .
Source: Sensors (basel, Switzerland), 2019-01-28 00:00:00.0; 19(3), .
EPub date: 2019-01-28 00:00:00.0.
PMID: 30696100
Related Citations

A multisource fusion framework driven by user-defined knowledge for egocentric activity recognition.
Authors: Yu H. , Jia W. , Li Z. , Gong F. , Yuan D. , Zhang H. , Sun M. .
Source: Eurasip Journal On Advances In Signal Processing, 2019; 2019(1), p. 14.
EPub date: 2019-02-22 00:00:00.0.
PMID: 30881444
Related Citations

Dietary Assessment with a Wearable Camera among Children: Feasibility and Intercoder Reliability.
Authors: Beltran A. , Dadabhoy H. , Ryan C. , Dholakia R. , Jia W. , Baranowski J. , Sun M. , Baranowski T. .
Source: Journal Of The Academy Of Nutrition And Dietetics, 2018 11; 118(11), p. 2144-2153.
EPub date: 2018-08-13 00:00:00.0.
PMID: 30115556
Related Citations

Utility of eButton images for identifying food preparation behaviors and meal-related tasks in adolescents.
Authors: Raber M. , Patterson M. , Jia W. , Sun M. , Baranowski T. .
Source: Nutrition Journal, 2018-02-24 00:00:00.0; 17(1), p. 32.
EPub date: 2018-02-24 00:00:00.0.
PMID: 29477143
Related Citations

Application of Intelligent Recommendation Techniques for Consumers' Food Choices in Restaurants.
Authors: Li X. , Jia W. , Yang Z. , Li Y. , Yuan D. , Zhang H. , Sun M. .
Source: Frontiers In Psychiatry, 2018; 9, p. 415.
EPub date: 2018-09-04 00:00:00.0.
PMID: 30233432
Related Citations

The international food unit: a new measurement aid that can improve portion size estimation.
Authors: Bucher T. , Weltert M. , Rollo M.E. , Smith S.P. , Jia W. , Collins C.E. , Sun M. .
Source: The International Journal Of Behavioral Nutrition And Physical Activity, 2017-09-12 00:00:00.0; 14(1), p. 124.
EPub date: 2017-09-12 00:00:00.0.
PMID: 28899402
Related Citations

Improved method of step length estimation based on inverted pendulum model.
Authors: Zhao Q. , Zhang B. , Wang J. , Feng W. , Jia W. , Sun M. .
Source: International Journal Of Distributed Sensor Networks, 2017 Apr; 13(4), .
EPub date: 2017-04-10 00:00:00.0.
PMID: 29910697
Related Citations

An auxiliary gaze point estimation method based on facial normal.
Authors: Sun W. , Sun N. , Guo B. , Jia W. , Sun M. .
Source: Pattern Analysis And Applications : Paa, 2016 Aug; 19(3), p. 611-620.
EPub date: 2014-08-21 00:00:00.0.
PMID: 29302236
Related Citations

ARCH: Adaptive recurrent-convolutional hybrid networks for long-term action recognition.
Authors: Xin M. , Zhang H. , Wang H. , Sun M. , Yuan D. .
Source: Neurocomputing, 2016-02-20 00:00:00.0; 178, p. 87-102.
EPub date: 2015-11-10 00:00:00.0.
PMID: 29290647
Related Citations

Learning based particle filtering object tracking for visible-light systems.
Authors: Sun W. .
Source: Optik, 2015 Oct; 126(19), p. 1830-1837.
EPub date: 2015-05-15 00:00:00.0.
PMID: 29213151
Related Citations

Fast single image haze removal via local atmospheric light veil estimation.
Authors: Sun W. , Wang H. , Sun C. , Guo B. , Jia W. , Sun M. .
Source: Computers & Electrical Engineering : An International Journal, 2015-08-01 00:00:00.0; 46, p. 371-383.
PMID: 26744548
Related Citations

Cross-trees, Edge and Superpixel Priors-based Cost aggregation for Stereo matching.
Authors: Cheng F. , Zhang H. , Sun M. , Yuan D. .
Source: Pattern Recognition, 2015-07-01 00:00:00.0; 48(7), p. 2269-2278.
PMID: 26034314
Related Citations

An adaptive Hidden Markov model for activity recognition based on a wearable multi-sensor device.
Authors: Li Z. , Wei Z. , Yue Y. , Wang H. , Jia W. , Burke L.E. , Baranowski T. , Sun M. .
Source: Journal Of Medical Systems, 2015 May; 39(5), p. 57.
PMID: 25787786
Related Citations

A Low Power, Parallel Wearable Multi-Sensor System for Human Activity Evaluation.
Authors: Li Y. , Jia W. , Yu T. , Luan B. , Mao Z.H. , Zhang H. , Sun M. .
Source: Proceedings Of The Ieee ... Annual Northeast Bioengineering Conference. Ieee Northeast Bioengineering Conference, 2015 Apr; 2015, .
PMID: 26185409
Related Citations

SIFT-Based Indoor Localization for Older Adults Using Wearable Camera.
Authors: Zhang B. , Zhao Q. , Feng W. , Sun M. , Jia W. .
Source: Proceedings Of The Ieee ... Annual Northeast Bioengineering Conference. Ieee Northeast Bioengineering Conference, 2015 Apr; 2015, .
PMID: 26190909
Related Citations

Assessing Physical Performance in Free-Living Older Adults with a Wearable Computer.
Authors: Zhao Q. , Wang J. , Feng W. , Jia W. , Burke L.E. , Zgibor J.C. , Sun M. .
Source: Proceedings Of The Ieee ... Annual Northeast Bioengineering Conference. Ieee Northeast Bioengineering Conference, 2015 Apr; 2015, .
PMID: 26190910
Related Citations

A FPGA Implementation of JPEG Baseline Encoder for Wearable Devices.
Authors: Li Y. , Jia W. , Luan B. , Mao Z.H. , Zhang H. , Sun M. .
Source: Proceedings Of The Ieee ... Annual Northeast Bioengineering Conference. Ieee Northeast Bioengineering Conference, 2015 Apr; 2015, .
PMID: 26190911
Related Citations

Saliency-aware food image segmentation for personal dietary assessment using a wearable computer.
Authors: Chen H.C. , Jia W. , Sun X. , Li Z. , Li Y. , Fernstrom J.D. , Burke L.E. , Baranowski T. , Sun M. .
Source: Measurement Science & Technology, 2015 Feb; 26(2), .
PMID: 26257473
Related Citations

Multiview stereo and silhouette fusion via minimizing generalized reprojection error.
Authors: Li Z. , Wang K. , Jia W. , Chen H.C. , Zuo W. , Meng D. , Sun M. .
Source: Image And Vision Computing, 2015-01-01 00:00:00.0; 33, p. 1-14.
PMID: 25558120
Related Citations

An exploratory study on a chest-worn computer for evaluation of diet, physical activity and lifestyle.
Authors: Sun M. , Burke L.E. , Baranowski T. , Fernstrom J.D. , Zhang H. , Chen H.C. , Bai Y. , Li Y. , Li C. , Yue Y. , et al. .
Source: Journal Of Healthcare Engineering, 2015; 6(1), p. 1-22.
PMID: 25708374
Related Citations

Cuff-Free Blood Pressure Estimation Using Pulse Transit Time and Heart Rate.
Authors: Wang R. , Jia W. , Mao Z.H. , Sclabassi R.J. , Sun M. .
Source: International Conference On Signal Processing Proceedings. International Conference On Signal Processing, 2014 Oct; 2014, p. 115-118.
PMID: 26213717
Related Citations

Landmark-Based Indoor Positioning for Visually Impaired Individuals.
Authors: Bai Y. , Jia W. , Zhang H. , Mao Z.H. , Sun M. .
Source: International Conference On Signal Processing Proceedings. International Conference On Signal Processing, 2014 Oct; 2014, p. 678-681.
PMID: 26213718
Related Citations

Accuracy of food portion size estimation from digital pictures acquired by a chest-worn camera.
Authors: Jia W. , Chen H.C. , Yue Y. , Li Z. , Fernstrom J. , Bai Y. , Li C. , Sun M. .
Source: Public Health Nutrition, 2014 Aug; 17(8), p. 1671-81.
PMID: 24476848
Related Citations

Obstacle classification and 3D measurement in unstructured environments based on ToF cameras.
Authors: Yu H. , Zhu J. , Wang Y. , Jia W. , Sun M. , Tang Y. .
Source: Sensors (basel, Switzerland), 2014-06-18 00:00:00.0; 14(6), p. 10753-82.
EPub date: 2014-06-18 00:00:00.0.
PMID: 24945679
Related Citations

A Novel Binocular Vision System for Wearable Devices.
Authors: Zhai H. , Li H. , Bai Y. , Jia W. , Sun M. .
Source: Proceedings Of The Ieee ... Annual Northeast Bioengineering Conference. Ieee Northeast Bioengineering Conference, 2014-04-25 00:00:00.0; 2014, p. 1-3.
PMID: 25525322
Related Citations

A fast color image enhancement algorithm based on Max Intensity Channel.
Authors: Sun W. , Han L. , Guo B. , Jia W. , Sun M. .
Source: Journal Of Modern Optics, 2014-03-30 00:00:00.0; 61(6), p. 466-477.
PMID: 25110395
Related Citations

eButton: A Wearable Computer for Health Monitoring and Personal Assistance.
Authors: Sun M. , Burke L.E. , Mao Z.H. , Chen Y. , Chen H.C. , Bai Y. , Li Y. , Li C. , Jia W. .
Source: Proceedings / Design Automation Conference. Design Automation Conference, 2014; 2014, p. 1-6.
PMID: 25340176
Related Citations

Perceptual Contrast Enhancement with Dynamic Range Adjustment.
Authors: Zhang H. , Li Y. , Chen H. , Yuan D. , Sun M. .
Source: Optik, 2013-12-01 00:00:00.0; 124(23), .
PMID: 24339452
Related Citations

Eating Activity Detection from Images Acquired by a Wearable Camera.
Authors: Sun X. , Yao H. , Jia W. , Sun M. .
Source: Sensecam 2013 : Proceedings Of The 4th Sensecam Conference : Sensecam And Pervasive Imaging 2013 : San Diego, Usa, November 18-19, 2013. Sensecam (conference) (4th : 2013 : San Diego, Calif.), 2013 Nov; 2013, p. 80-81.
PMID: 30596207
Related Citations

Model-based measurement of food portion size for image-based dietary assessment using 3D/2D registration.
Authors: Chen H.C. , Jia W. , Yue Y. , Li Z. , Sun Y.N. , Fernstrom J.D. , Sun M. .
Source: Measurement Science & Technology, 2013 Oct; 24(10), .
PMID: 24223474
Related Citations

Dense Stereo Matching Method Based on Local Affine Model.
Authors: Li J. , Shi W. , Deng D. , Jia W. , Sun M. .
Source: Journal Of Computers, 2013 Jul; 8(7), p. 1696-1703.
PMID: 24163727
Related Citations

Anthropometric body measurements based on multi-view stereo image reconstruction.
Authors: Li Z. , Jia W. , Mao Z.H. , Li J. , Chen H.C. , Zuo W. , Wang K. , Sun M. .
Source: Conference Proceedings : ... Annual International Conference Of The Ieee Engineering In Medicine And Biology Society. Ieee Engineering In Medicine And Biology Society. Annual Conference, 2013; 2013, p. 366-9.
PMID: 24109700
Related Citations

Daily life event segmentation for lifestyle evaluation based on multi-sensor data recorded by a wearable device.
Authors: Li Z. , Wei Z. , Jia W. , Sun M. .
Source: Conference Proceedings : ... Annual International Conference Of The Ieee Engineering In Medicine And Biology Society. Ieee Engineering In Medicine And Biology Society. Annual Conference, 2013; 2013, p. 2858-61.
PMID: 24110323
Related Citations

Helping the blind to find the floor of destination in multistory buildings using a barometer.
Authors: Bai Y. , Jia W. , Zhang H. , Mao Z.H. , Sun M. .
Source: Conference Proceedings : ... Annual International Conference Of The Ieee Engineering In Medicine And Biology Society. Ieee Engineering In Medicine And Biology Society. Annual Conference, 2013; 2013, p. 4738-41.
PMID: 24110793
Related Citations

Eating Event Detection by Magnetic Proximity Sensing.
Authors: Li C. , Bai Y. , Jia W. , Sun M. .
Source: Proceedings Of The Ieee ... Annual Northeast Bioengineering Conference. Ieee Northeast Bioengineering Conference, 2013; 2013, p. 15-16.
PMID: 25342877
Related Citations

Bayesian Stereo Matching Method Based on Edge Constraints.
Authors: Li J. , Shi W. , Deng D. , Jia W. , Sun M. .
Source: International Journal Of Advancements In Computing Technology, 2012 Dec; 4(22), p. 36-47.
PMID: 25309710
Related Citations