Low Latency, High Performance Data Stream Processing (Paperback) (ISBN-13: 9783639240757)

Data stream oriented applications are typically dealing with huge volumes of data. Storing data and performing off-line processing on this huge data set can be costly, time consuming and impractical. This work describes our research results while designing and implementing an efficient data management system for on-line and off-line processing of streaming data. We present major existing data stream processing engines, their internal architecture and how they compare to our platform, Global Sensor Network (GSN) middleware. In order to achieve high efficiency while processing large volumes of streaming data using window-based continuous queries, we present a set of optimization algorithms and techniques to intelligently group and process different types of continuous queries. Moreover we present an efficient query scheduling component which not only increases the performance at least by an order of magnitude but also, decreases the response time and memory requirements. Finally, we present techniques and algorithms to enable scalable delivery of streaming data for high data rate streams (e.g., Financial Ticks).

Author: Ali Salehi
ISBN-10: 3639240758
ISBN-13: 9783639240757
Publisher: VDM Verlag
Language: English
Published: 04/28/2010
Pages: 148
Format: Paperback
Weight: 0.50lbs
Size: 9.00h x 6.00w x 0.34d