The video on-demand of this session is available to logged in QCon attendees only. Please login to your QCon account to watch the session.

Session + Live Q&A

How to Operationalize Transformer Models on the Edge

Sometimes the hardest part of building ML solutions is deployment. In this session, we will look at different model deployment architectures, how to deploy with edge devices and inference in different programming languages. By the end of the demo-heavy session, you will see how to optimize large models, reduce costs, and deploy anywhere.


Cassie Breviu

Senior Program Manager @Microsoft

Cassie Breviu is a Senior Program Manager at Microsoft on the AI Frameworks team. She is a career switcher and self-taught developer. She is passionate about D&I and helping others learn to code. She enjoys working in technologies with two letter abbreviations: AI/ML, MR/VR/XR/AR. But really,...

Read more


Thursday May 12 / 10:00AM EDT (50 minutes)


Innovations in ML Systems


Slides are not available

Add to Calendar

Add to calendar


From the same track


The Next Decade of Software Is About Climate - What Is the Role of ML?

Thursday May 12 / 12:20PM EDT

Please note: there will not be a live Q&A for this session.Climate action has risen to the top of many technology companies' agenda. But how does one get started? Green software engineering is an emerging discipline and being a part of the climate change solution is a relatively new part...

Sara Bergman

Software Engineer at the Green Software Foundation

Session + Live Q&A

Open Machine Learning

Thursday May 12 / 11:10AM EDT

In this talk, Omar will talk about trends in the ML ecosystem for Open Science and Open Source. Omar will talk about the power of creating interactive demos using Open Source libraries, BigScience, a one-year long research workshop involving over 700 researchers, and other community-led efforts...

Omar Sanseviero

Machine Learning Engineer @huggingface

Session + Live Q&A

Operationalizing Responsible AI in Practice

Thursday May 12 / 01:30PM EDT

Enabling responsible development of artificial intelligent technologies is one of the major challenges we face as the field moves from research to practice. Researchers and practitioners from different disciplines have highlighted the ethical and legal challenges posed by the use of machine...

Mehrnoosh Sameki

Senior Technical Program Manager & Tech Lead @Microsoft

View full Schedule