Two tinyML Talks on September 15, 2020: 1) “TinyML as-a-Service - Bringing ML inference to the deepest IoT Edge” by Hiroshi Doyu (Ericsson); 2) “Speech Recognition on low power devices” by Vikrant Tomar and Sam Myer ( Inc.)

We held our next tinyML Talks webcast with two presentations: Hiroshi Doyu from Ericsson Research has presented TinyML as-a-Service - Bringing ML inference to the deepest IoT Edge; Vikrant Tomar and Sam Myer from Inc. presented Speech Recognition on low power devices on September 15, 2020 at 8:00 AM and 8:30 AM Pacific Time.

Announcement September 15
Hiroshi Doyu

Vikrant Tomar (left) and Sam Myer (right)

TinyML, as a concept, concerns the running of ML inference on Ultra Low-Power microcontrollers found on IoT devices. Yet today, various challenges still limit the effective execution of TinyML in the embedded IoT world. As both a concept and community, it is still
under development.
Here at Ericsson, the focus of our TinyML as-a-Service activity is to democratize TinyML, enabling manufacturers to start their AI businesses using TinyML more easily.
Our goal is to make the execution of ML tasks possible and easy in a specific class of devices. These devices are characterized by very constrained hardware and software resources such as sensor and actuator nodes based on these microcontrollers.
We will present how we can bind the “as-a-service” model to TinyML and provide a high-level technical overview of our concept and introduce the design requirements and building blocks which characterize this emerging paradigm.

System software developer, researcher and long-time Linux kernel contributor.
Hiroshi Doyu is part of the Ericsson Research IoT technologies team. He has spent more than 20 years in product development, and has contributed to the upstream Linux kernel development for more than a decade, including Nvidia Tegra SoC.
He received his M.Sc. in Aerospace engineering from the Osaka Prefecture University, Japan.
Hiroshi is passionate about technology but also loves to play floorball and ice hockey. Hiroshi Doyu - Senior Researcher IoT - Ericsson

In this talk, we will cover how we at go from training models in high level libraries such as Pytorch and then run the models on low-power MCUs, such as ARM Cortex M series of microcontrollers, or DSPG digital signal processors. We will talk about optimizations achieved using low-level programming optimizations, as well as, neural network optimizations, such as 8-bit quantization, unique model architectures, network compression, layer selection, etc.

Vikrant Tomar is Founder and CTO of Inc. He is a scientist and executive with nearly 10 years of experience in speech recognition and machine/deep learning. He obtained his PhD in automatic speech recognition at McGill University, Canada, where he worked on manifold learning and deep learning approaches for acoustic modeling. In the past, he has also worked at Nuance Communications Inc. and Vestec Inc. as a Research Scientist.

Sam Myer is the lead developer at Inc., where his responsibilities include Fluent’s embedded speech recognition engine. He has a M.Sc. in signal processing from Queen Mary University of London and a B.Sc. in computer science from McGill University. Sam has extensive software development experience encompassing nearly 15 years and multiple cities including New York, Berlin and Montreal.


Watch on YouTube:
Hiroshi Doyu
Vikrant Tomar and Sam Myer

Download presentation slide:
Hiroshi Doyu
Vikrant Tomar and Sam Myer

Feel free to ask your questions on this thread and keep the conversation going!

1 Like