You are viewing content from a past/completed QCon Plus - May 2021

The video on-demand of this session is available to logged in QCon attendees only. Please login to your QCon account to watch the session.

Session + Live Q&A

From Batch to Streams: Building Value from Data In-Motion

Most things in life are a constant flow of events. Falling in love, getting a mortgage, and becoming a parent are good examples. However, something usually goes unnoticed: most events ultimately lead to another, and there is an inherent correlation between them. You just need to look closer and continuously.  

The power of looking at things closer and continuously comes when you realize that your building block of analysis is no longer silos of data but rather streams of data. Currently, systems are designed to capture data and store it — leaving the analysis part for later. This batch-oriented thinking leads to business processes that can't be linked together without extra integration efforts such as ETL and conciliation systems.  

Adopting streaming data architectures requires a fundamental shift in how you see data; and, more importantly — how do you capture, store, and analyze them while they are in motion. FIS companies are beginning to realize the importance of data-in-motion in the enterprise world and how their business processes need to be designed to be in their liquid form — as they are in constant change to adapt to new business needs.

This talk will discuss the risks of designing siloed-based systems and how streaming data architectures can become a solution to address competitiveness and mitigate the problem of business opportunities that happened unseen. It will explain the journey to achieve this within your development teams in the most disruptive form and highlight the changes that may disrupt their business but — are necessary to pave the way for how FIS companies can focus on building value and better customer experiences.

Key Takeaways:

  1. Understand the benefits of streaming-based systems for financial industries.
  2. Comprehend the journey to move from batch to streams.
  3. Illustrate the technical challenges that development teams face.
  4. Understand what open source technologies exist and their trade-offs.
  5. Highlight common "shortcuts and traps" that must be avoided.

Speaker

Ricardo Ferreira

Principal Developer Advocate @elastic

Ricardo is Principal Developer Advocate at Elastic—the company behind the Elastic Stack (Elasticsearch, Kibana, Beats, and Logstash), where he does community advocacy for North America. With +20 years of experience, he may have learned a thing or two about Distributed Systems, Databases,...

Read more
Find Ricardo Ferreira at:

Date

Tuesday May 25 / 11:10AM EDT (40 minutes)

Track

Architecting a Modern Financial Institution

Topics

Financial Applications

Add to Calendar

Add to calendar

Share

From the same track

Session + Live Q&A Financial Applications

Architecting Software for Leverage

Tuesday May 25 / 09:10AM EDT

When a financial services startup is created, it’s fair to assume that it will have a small team of engineers who will have the knowledge and control about the whole system being created to launch the first products. With few people and limited resources, it's necessary to think of the...

Lucas Cavalcanti

Principal Engineer @nubank

PANEL DISCUSSION + Live Q&A Financial Applications

This Is What a Large-Scale Cloud Adoption Program Looks Like

Tuesday May 25 / 10:10AM EDT

We have seen countless stories of teams that transformed or migrated applications to the cloud. Yet there aren’t many insights into what it takes to move hundreds and hundreds of workloads, of various technologies, languages, and platforms.  In this session, you’ll hear some of...

Dio Rettori

Head of Cloud Architecture @jpmorgan

PANEL DISCUSSION + Live Q&A Financial Applications

Panel: Challenges & Opportunities of the Modern Financial Institutions

Tuesday May 25 / 12:10PM EDT

In the panel, we’ll have the chance to discuss the challenges and opportunities of modern financial institutions with experts of different backgrounds and sectors of the financial industry, Dio Rettori, and Lucas Cavalcanti. With the key support of a broader view of the market from Camila...

Lucas Cavalcanti

Principal Engineer @nubank

Dio Rettori

Head of Cloud Architecture @jpmorgan

Camilla Crispim

Portfolio Technology Director @ThoughtWorks

View full Schedule