Friday November 30, 2007. 9:30am- 12:00pm
The design of a reliable message distribution service for Google.
By: John Reumann, Google
This tutorial will discuss the design of a process-to-process messaging infrastructure service for Google that helps connect loosely-coupled applications in a manner that is close to real-time, while ensuring reliable data transfer during inevitable problems in a large scale network deployment. This middleware itself is run as a shared service in a manner that is similar to a shared file system. The rational for this design choice and its practical implications will be presented. Important dependencies on other Google infrastructure services will be detailed as well.
For the last two years John has been leading a small team of software engineers at Google in the design, implementation, and operation of a reliable, global message and data distribution infrastructure. This infrastructure is used in several real-time oriented projects, in particular within the ads infrastructure. Prior to joining Google in NYC John worked at IBM T. J. Watson in the Enterprise Networking department on fine-grained distributed monitoring problems. His background is in operating system support for Internet services and distributed systems. He holds a Ph.D. and M. Sc. in Computer Science from the University of Michigan (Ann Arbor). His alma mater is the University of Bonn, Germany.