tinyML Talks on April 27, 2021 “Train-by-weight (TBW): Accelerated Deep Learning by Data Dimensionality Reduction” by Xingheng Lin and Michael Jo

Announcing our next tinyML Talks webcast! Michael Jo and Xingheng Lin from Rose-Hulman Institute of Technology will present Train-by-weight (TBW): Accelerated Deep Learning by Data Dimensionality Reduction on April 27, 2021 at 8:00 AM Pacific Time.

The state-of-the-arts pretrained machine/deep learning (M/DL) models are available in tinyML community for numerous applications. However, training these models for new objects and retraining the pretrained models are computationally expensive.
Our proposed Train-by-Weight (TBW) approach is a combination of linear classifier, such as principal component analysis (PCA), and a nonlinear classifier, such as deep learning model. There are two key contributions in this approach. First, we perform dimensionality reduction by generating weighted data sets using linear classifiers. Secondly, weighted data sets offer essential data sets to M/DL model. As a result, we achieved reduced training and verification time by maximum 88% in deep artificial neural network model with approximately 1% accuracy loss.
TinyML community may benefit from the proposed approach by faster training of M/DL models due to lower bandwidth of data. Moreover, this may offer energy efficient hardware/software solutions due to its relatively simple architecture.

Xingheng Lin was born in Jiangxi Province, China, in 2000. He is currently pursuing the B. S. degree in computer engineering at Rose-Hulman Institute of Technology. His primary research interests are Principle Component Analysis based machine learning and deep learning acceleration. Besides his primary research project, Xingheng is currently working on pattern recognition of rapid saliva COVID-19 test response which is a collaboration with 12-15 Molecular Diagnostics.

Michael Jo received his Ph.D. in Electrical and Computer Engineering in 2018 from the University of Illinois at Urbana-Champaign. He is currently an assistant professor at Rose-Hulman Institute of Technology in the department of Electrical and Computer Engineering. His current research interests are accelerated embedded machine learning, computer vision, and integration of artificial intelligence and nanotechnology.


IMPORTANT: Please register here

Once registered, you will receive a link and dial in information to Zoom by email, that you can also add to your calendar.

We encourage you to register earlier since on-line broadcast capacity may be limited.

Note: tinyML Talks slides and videos will be available here on the tinyML Forum and the tinyML YouTube Channel afterwards for those who missed the live session. Please take a moment and subscribe to the YouTube channel today.

Feel free to ask your questions on this thread and keep the conversation going!