Paul Stack at the DevOps Conference 2015

How to scale a logging infrastructure to accept a billion messages a day

JAXenter Editorial Team

Over the past year, OpenTable have been re-architecting their system from a monolithic architecture to move more towards microservices and small applications. As the infrastructure has changed, so too the logging infrastructure has had to change. In this session, recorded at the DevOps Conference, Paul Stack explains how they did it.

We then adopted the ELK stack. This allowed us to be able to scale more. As the company moved into the cloud, we had to be able to scale even more. We decided that we would move to Apache Kafka.

This talk is all about the steps we went through and how we approached the work as well as the lessons learned. We are now in a position where we are able to elastically scale our logging infrastructure easily.

paul-stackPaul Stack is a London based infrastructure engineer. Paul has spoken at various events throughout the world about his passion for continuous integration and continuous delivery and why they should be part of what developers do on a day to day basis. He believes that reliably delivering software is just as important as its development. Paul’s newest passion is the DevOps movement and how this helps not just development and operations but the entire business and it’s customers.
Inline Feedbacks
View all comments