Session + Live Q&A
From Batch to Streams: Building Value from Data In-Motion
Most things in life are a constant flow of events. Falling in love, getting a mortgage, and becoming a parent are good examples. However, something usually goes unnoticed: most events ultimately lead to another, and there is an inherent correlation between them. You just need to look closer and continuously.
The power of looking at things closer and continuously comes when you realize that your building block of analysis is no longer silos of data but rather streams of data. Currently, systems are designed to capture data and store it — leaving the analysis part for later. This batch-oriented thinking leads to business processes that can't be linked together without extra integration efforts such as ETL and conciliation systems.
Adopting streaming data architectures requires a fundamental shift in how you see data; and, more importantly — how do you capture, store, and analyze them while they are in motion. FIS companies are beginning to realize the importance of data-in-motion in the enterprise world and how their business processes need to be designed to be in their liquid form — as they are in constant change to adapt to new business needs.
This talk will discuss the risks of designing siloed-based systems and how streaming data architectures can become a solution to address competitiveness and mitigate the problem of business opportunities that happened unseen. It will explain the journey to achieve this within your development teams in the most disruptive form and highlight the changes that may disrupt their business but — are necessary to pave the way for how FIS companies can focus on building value and better customer experiences.
Key Takeaways:
- Understand the benefits of streaming-based systems for financial industries.
- Comprehend the journey to move from batch to streams.
- Illustrate the technical challenges that development teams face.
- Understand what open source technologies exist and their trade-offs.
- Highlight common "shortcuts and traps" that must be avoided.
Speaker
Ricardo Ferreira
Principal Developer Advocate @elastic
Ricardo is Principal Developer Advocate at Elastic—the company behind the Elastic Stack (Elasticsearch, Kibana, Beats, and Logstash), where he does community advocacy for North America. With +20 years of experience, he may have learned a thing or two about Distributed Systems, Databases,...
Read moreFind Ricardo Ferreira at:
From the same track
Architecting Software for Leverage
Tuesday May 25 / 09:10AM EDT
When a financial services startup is created, it’s fair to assume that it will have a small team of engineers who will have the knowledge and control about the whole system being created to launch the first products. With few people and limited resources, it's necessary to think of the...
Lucas Cavalcanti
Principal Engineer @nubank
This Is What a Large-Scale Cloud Adoption Program Looks Like
Tuesday May 25 / 10:10AM EDT
We have seen countless stories of teams that transformed or migrated applications to the cloud. Yet there aren’t many insights into what it takes to move hundreds and hundreds of workloads, of various technologies, languages, and platforms. In this session, you’ll hear some of...
Dio Rettori
Head of Cloud Architecture @jpmorgan
Panel: Challenges & Opportunities of the Modern Financial Institutions
Tuesday May 25 / 12:10PM EDT
In the panel, we’ll have the chance to discuss the challenges and opportunities of modern financial institutions with experts of different backgrounds and sectors of the financial industry, Dio Rettori, and Lucas Cavalcanti. With the key support of a broader view of the market from Camila...
Lucas Cavalcanti
Principal Engineer @nubank
Dio Rettori
Head of Cloud Architecture @jpmorgan
Camilla Crispim
Portfolio Technology Director @ThoughtWorks