PopSub: Improving Resource Utilization in Distributed Content-based Publish/Subscribe Systems. (Research Paper)
Distributed content-based publish/subscribe systems provide a selective, scalable, and decentralized approach to data dissemination. In a pub/sub overlay network, hop-by-hop routing allows brokers to correctly forward messages without requiring global knowledge. However, this model causes brokers to forward publications without knowing the volume and distance of matching subscribers, which can result in inefficient resource utilization. In order to raise the scalability of pub/sub, we introduce Popularity-Based Publication Routing for Content-based Pub/Sub (PopSub), which is specifically designed to raise the resource utilization efficiency. We define a utilization metric to measure the impact of forwarding a publication on the overall delivery of the system. Furthermore, we propose a new publication routing algorithm that takes into account broker resources and publication popularity among subscribers. Lastly, we propose three approaches to handle unpopular publications. Based on our evaluations, using real-world workloads and traces, PopSub is able to improve resource efficiency of the brokers by up to 62%, and reduce delivery latency by up to 57% under high load.
Thu 22 JunDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:30 - 12:10 | Session 3: Publish/SubscribeDEBS Research Papers at Sala d'Actes, Vertex Building Chair(s): Mohammad Sadoghi Purdue | ||
10:30 25mTalk | PopSub: Improving Resource Utilization in Distributed Content-based Publish/Subscribe Systems. (Research Paper) DEBS Research Papers Pooya Salehi Technical University of Munich, Kaiwen Zhang TU Munich, Hans-Arno Jacobsen University of Toronto | ||
10:55 25mTalk | Addressing TCAM Limitations of Software-Defined Networks for Content-Based Routing. (Research Paper) DEBS Research Papers Sukanya Bhowmik University of Stuttgart, Muhammad Adnan Tariq University of Stuttgart, Alexander Balogh University of Stuttgart, Kurt Rothermel Universitaet Stuttgart | ||
11:20 20mTalk | Kafka versus RabbitMQ. (Industry Paper) DEBS Research Papers | ||
11:40 20mTalk | An Autonomous and Dynamic Coordination and Discovery Service for Wide-Area Peer-to-peer Publish/Subscribe. (Experience Paper) DEBS Research Papers |