Realtime Analytics @ Twitter

Robin Dhamankar,
Software Engineer, Twitter

Bio: Robin Dhamankar is a Software Engineer in the Data Infrastructure team at Twitter. His team works on building messaging (pub-sub) technologies such as Kestrel and scribe for the real-time data pipeline. Before Twitter, he worked in the SQL Server database engine team at Microsoft. He has a Master’s degree in Computer Science from the University of Illinois at Urbana-Champaign. You can follow him @RobinDhamankar on twitter.

Krishna Gade,
Engineering Manager, Twitter

Bio: Krishna Gade is an Engineering Manager in the Data Infrastructure group at Twitter. His teams work on building caching and stream processing systems such as twemcache, redis, finagle and storm. Prior to that, Krishna worked on the search teams at Twitter and Microsoft (Bing), where he helped build core search and relevance infrastructure. Krishna has a Master's degree in Computer Science from the University at Minnesota where his research was focused on data mining and information retrieval. You can follow him @krishnagade on twitter.

Abstract: In this talk, we will discuss the data pipeline at Twitter that collects, aggregates and processes large volumes of data in real time and also how it fits in the broader data infrastructure ecosystem. We will also discuss challenges we have faced and lessons we have learned while building this infrastructure at Twitter.