Achieving high throughput for large scale event streaming across geographically distributed data-centers with JetStream.

ABSTRACTThe increasing scale at which data processing is being performed nowadays calls for data management systems that enable high-performance data exchanges among geographically remote instances of large web services. In this demonstration we show how JetStream can increase the transfer rate of events which are streamed between geographically remote cloud data centers. The demonstration setup focuses on presenting how the binding can be done between JetStream and the event source on one hand and with the StreamInsight processing engine on the other hand. By considering a data source with an event generation rate that is variable in time, we demonstrate the importance of adapting the transfer scheme to the streaming context.