Track Overview

Modern Data Pipelines & DataMesh

Since data systems are becoming more complicated software solutions, how do we ensure that the architecture we are building is sustainable, reliable, and highly available? What best practices can we adopt for building modern, yet complex data pipelines?

And what is our role, as individuals who design architectures and intensive data applications in qualifying the data? Delivering on our promises to data users while making sure it is secure?  What about enforcing data governance regulations and other requirements?

In this track, you will learn about processes and best practices for complex data systems- the good, the bad, and the hopefully bright future. Join us as we explore the data mesh, data lifecycle management, and modern data pipelines paradigms and walk away with actionable best practices to improve both your data product and the lives of your colleagues.

Adi Polak

VP of DevEx @Treeverse

From this track

Session + Live Q&A Data Engineering

Taming the Data Mess, How Not to Be Overwhelmed by the Data Landscape

Wednesday May 18 / 09:00AM EDT

The data engineering field has evolved at a tremendous pace in the last decade, new systems that enable the processing of huge amounts of data generated enormous opportunities, as well as challenges for software practitioners. All these new tools and methodologies created a new set of...

Ismaël Mejía

Senior Cloud Advocate @Microsoft

Session + Live Q&A Data Engineering

Data Versioning at Scale: Chaos and Chaos Management

Wednesday May 18 / 10:10AM EDT

Version control is fundamental when managing code, but what about data? Our data changes over time, first since it accumulates, we have new data points for new points in time. But this is not the only reason. We also have additional data added to past time, since we were able to get additional...

Dr. Einat Orr

Co-creator of @lakeFS, Co-founder & CEO of Treeverse

Session + Live Q&A Data Engineering

Modern Data Pipelines in AdTech—Life in the Trenches

Wednesday May 18 / 11:20AM EDT

There are various tasks that the modern data pipelines approach helps us solve in different domains, including advertising. Modern data pipelines allow us to process data in a more efficient manner with a diverse set of data transformation tools for both batch and streaming data processing....

Roksolana Diachuk

Big Data Engineer @Captify

Session + Live Q&A Data Engineering

Orchestrating Hybrid Workflows with Apache Airflow

Wednesday May 18 / 12:30PM EDT

According to analysts, 87 percent of enterprises have already adopted hybrid cloud strategies. Customers have many reasons why they need to support hybrid environments, from maximizing the value from heritage systems to meeting local compliance and data processing regulations. As they build...

Ricardo Sueiras

Principal Advocate in Open Source @AWS


Speakers from this track

Ismaël Mejía

Senior Cloud Advocate @Microsoft

Ismaël Mejía is a Senior Cloud Advocate at Microsoft working on the Azure Data and AI team. He has more than a decade of experience architecting systems for startups and financial companies. He has been recently focused on distributed data frameworks, he is an active open-source contributor of...

Read more
Find Ismaël Mejía at:

Dr. Einat Orr

Co-creator of @lakeFS, Co-founder & CEO of Treeverse

Einat Orr has 20+ years of experience building R&D organizations and leading the technology vision at multiple companies, the latest being Similarweb, that IPO in NYSE last May.  Currently she serves as Co-founder and CEO of Treeverse, the company behind lakeFS, an open source platform...

Read more
Find Dr. Einat Orr at:

Roksolana Diachuk

Big Data Engineer @Captify

Roksolana works as a Big Data Engineer at Captify. She is a speaker at technical conferences and meetups, one of the Women Who Code Kyiv leads. She is passionate about Big Data, Scala, and Kubernetes. Her hobbies include building technical topics around fairytales and discovering new cities.

Read more

Ricardo Sueiras

Principal Advocate in Open Source @AWS

Over 30 years spent working in the technology industry, helping customers solve business problems with open source and cloud. Currently I am a Developer Advocate at AWS focusing on open source, where I help raise awareness of AWS and our customers open source projects and technology, and work...

Read more
Find Ricardo Sueiras at:

Track Date

Wednesday May 18 / 09:00AM EDT

Share

Track Host

Adi Polak

VP of DevEx @Treeverse

As Vice President of Developer Experience at Treeverse, Adi helps build lakeFS, git-like capabilities for data lakes. In her work, she brings her vast industry research and engineering experience to bear in educating and helping teams design, architect, and build cost-effective data systems and...

Read more