Raj Shekhar and Mehmet Can Kurt, Quantcast
This talk is about how we migrated from an in-house legacy datastore that handles 1.5 million lookup requests (per second) to a more reliable, flexible, and cheaper system.
We will talk about how to achieve three major goals for the migration process:
- at least similar or better performance than the legacy system
- ensure the quality and correctness of the data served by the new system, and
- do the first two without any downtime on production and affecting the company's main revenue generating product.
This talk is aimed at software engineers and site reliability engineers who are thinking of replacing a critical part of their distributed system.
Raj Shekhar, Quantcast
Raj is a Staff System Engineer at Quantcast, working on maintaining the uptime and reliability of the servers tracking Quantcast pixels across the web. He enjoys poking sleeping dragons in large scale distributed systems. When not working, you can find him planning his next getaway, usually to a place accessible by motorcycle.
Open Access Media
USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.
author = {Raj Shekhar and Mehmet Can Kurt},
title = {Hot Swap Your Datastore: A Practical Approach and Lessons Learned},
booktitle = {SREcon20 Americas (SREcon20 Americas)},
year = {2020},
url = {https://www.usenix.org/conference/srecon20americas/presentation/shekhar},
publisher = {USENIX Association},
month = dec
}