Session + Live Q&A
How to Operationalize Transformer Models on the Edge
Sometimes the hardest part of building ML solutions is deployment. In this session, we will look at different model deployment architectures, how to deploy with edge devices and inference in different programming languages. By the end of the demo-heavy session, you will see how to optimize large models, reduce costs, and deploy anywhere.
Speaker
Cassie Breviu
Senior Program Manager @Microsoft
Cassie Breviu is a Senior Program Manager at Microsoft on the AI Frameworks team. She is a career switcher and self-taught developer. She is passionate about D&I and helping others learn to code. She enjoys working in technologies with two letter abbreviations: AI/ML, MR/VR/XR/AR. But really,...
Read moreDate
Thursday May 12 / 10:00AM EDT (50 minutes)
Track
Slides
Slides are not available
Add to Calendar
Add to calendarShare
From the same track
The Next Decade of Software Is About Climate - What Is the Role of ML?
Thursday May 12 / 12:20PM EDT
Please note: there will not be a live Q&A for this session.Climate action has risen to the top of many technology companies' agenda. But how does one get started? Green software engineering is an emerging discipline and being a part of the climate change solution is a relatively new part...
Sara Bergman
Software Engineer at the Green Software Foundation
Open Machine Learning
Thursday May 12 / 11:10AM EDT
In this talk, Omar will talk about trends in the ML ecosystem for Open Science and Open Source. Omar will talk about the power of creating interactive demos using Open Source libraries, BigScience, a one-year long research workshop involving over 700 researchers, and other community-led efforts...
Omar Sanseviero
Machine Learning Engineer @huggingface
Operationalizing Responsible AI in Practice
Thursday May 12 / 01:30PM EDT
Enabling responsible development of artificial intelligent technologies is one of the major challenges we face as the field moves from research to practice. Researchers and practitioners from different disciplines have highlighted the ethical and legal challenges posed by the use of machine...
Mehrnoosh Sameki
Senior Technical Program Manager & Tech Lead @Microsoft