This event has passed.
Friday, March 3, 2023 – 12:00PM to 1:00PM
Presenter
Dr. Peizhen Guo
The NSF AI Institute for Edge Computing (Athena) presents the next in our seminar series by Dr. Peizhen Guo, titled "A Model Management Layer for Edge Intelligence" on Friday, March 3, 2023, from 12-1pm EST via Zoom.
Abstract:
Edge intelligence has already become a reality, where servers, mobile, wearable, and IoT devices analyze data collected or generated at end devices and extract actionable insights, increasingly via deep learning inference and in real time. In this talk, we present a DNN model management framework that automatically generates and selects models for diverse hardware capability and performance requirements. Our framework consists of a series of services that handle neural network model tailoring, model indexing and query, and approximate computation reuse. Together, these services provide abstractions and algorithms to restructure the computation flow, reducing programming and deployment time by orders of magnitude and improving resource efficiency by 3x-10x.