Apache RocketMQ

<h2 id="history">History</h2>
<p>The development of RocketMQ can be divided into three stages.<a class="footnote-ref" id="fnref:2" href="#fn:2"><sup>2</sup></a>
</p><p>The first generation uses the push mode in data transportation, and relational database in data storage. It shows low latency in message delivery and meets the command of a typical E-commerce platform<a class="footnote-ref" id="fnref:3" href="#fn:3"><sup>3</sup></a> with distributed transactions.
</p><p>The second generation uses the pull mode in data transportation, and file system in data storage. It paid more attention to stability and reliability, and shows a comparable performance to the first generation in response time and Kafka on log collection.
</p><p>The third generation combines the Pull mode with some Push operations. It inherits the advantages of the first and second generation, and shows high performance in concurrency and massive amounts of data scenarios.
</p>
<h2 id="features">Features</h2>
<p>Much comparison have been made between the various messaging solutions, and it is widely known that when the number of topics increases dramatically, the throughput of RocketMQ dropped much less than Kafka.<a class="footnote-ref" id="fnref:4" href="#fn:4"><sup>4</sup></a> Because the characteristics of high performance, high reliability and high real-time ability, more and more efforts have been made to the combination of RocketMQ and other protocol components in every type of messaging scenarios such as MQTT.<a class="footnote-ref" id="fnref:5" href="#fn:5"><sup>5</sup></a> 
</p>
<table><tbody><tr><th>Client SDK</th><th>Protocol and Specification</th><th>Ordered Message</th><th>Scheduled Message</th><th>Batched Message</th><th>BroadCast Message</th><th>Message Filter</th><th>Server Triggered Redelivery</th></tr><tr><td>Java, C/C++, Python, Go, Nodejs</td><td>Pull model, support TCP, JMS, OpenMessaging</td><td>Ensure strict ordering of messages, and can scale out gracefully</td><td>Supported</td><td>Supported, with sync mode to avoid message loss</td><td>Supported</td><td>Supported, property filter expressions based on SQL92</td><td>Supported</td></tr><tr><th>Message Storage</th><th>Message Retroactive</th><th>Message Priority</th><th>High Availability and Failover</th><th>Message Track</th><th>Configuration</th></tr><tr><td>High performance and low latency file storage</td><td>Supported timestamp and offset two indicates</td><td>Not Supported</td><td>Supported, Master-Slave model, without another kit</td><td>Supported</td><td>Work out of box,user only need to pay attention to a few configurations</td></tr></tbody></table>
<h2 id="architecture">Architecture</h2>

<p>RocketMQ consists of four parts: name servers, brokers, producers and consumers. Each of them can be horizontally extended without a single point of Failure. As shown in image left.
</p>
<h3>NameServer Cluster</h3>
<p>The lightweight component for service discovery and they can be used to read and write routing information. Each one records global information, and supports fast storage expansion.
</p>
<h3>Broker Cluster</h3>
<p>They use lightweight TOPIC and QUEUE mechanisms to manage data storage. To realize fault tolerance, two copies or three copies of data are provided. And Client can get message in Push and Pull model. In addition, disaster recovery and rich metrics statistics are also supported.
</p>
<h3>Producer Cluster</h3>
<p>Producers can be distributed deployed, and messages from producers to brokers can be balanced through multi-path. In addition, fast failure and low latency are supported.
</p>
<h3>Consumer Cluster</h3>
<p>Consumers can also be distributed deployed in the push and pull model, and they can subscribe message real-time, consume message in the unit of cluster. Message broadcasting is also supported.
</p>
<h2 id="applications">Applications</h2>
<p>There are at least five aspects Apache RocketMQ could relate to:
</p>
<ul><li>The integration of heterogeneous systems;</li>
<li>Decoupling between applications;</li>
<li>Backbone in the event-driven mechanism and complex event architecture model;</li>
<li>Data replication channels;</li>
<li>Integration with flow calculation engine;</li>
<li>Stream data access.</li></ul>
<h2 id="community-maintenance">Community Maintenance</h2>
<p>The RocketMQ team has done much to keep the community active. Meetups, workshops, ApacheCon and Code Marathons are regularly held in Beijing, Shenzhen and Hangzhou to attract new contributors and committers. The OpenMessaging benchmarking suites are available for RocketMQ now, helping RocketMQ keep pace with the global standard for distributed messaging.<a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a> As for version management, a series of standardized software development processes have been adopted. The latest version is 4.2.0, with 4.3.0 on the way. More information can be obtained <a href="https://github.com/apache/rocketmq">here</a>.
</p>
<h2 id="awards">Awards</h2>
<p><a href="https://www.oschina.net/question/2886655_2216338">2016 China's most popular open source software award</a> <a href="https://web.archive.org/web/20180619063413/https://www.oschina.net/question/2886655_2216338">Archived</a> 2018-06-19 at the <a href="/facts/Wayback_Machine/nmQ3a6JC">Wayback Machine</a>
</p><p><a href="https://www.oschina.net/question/2896879_2271735">2017 China's most popular open source software award</a> <a href="https://web.archive.org/web/20180619063522/https://www.oschina.net/question/2896879_2271735">Archived</a> 2018-06-19 at the <a href="/facts/Wayback_Machine/nmQ3a6JC">Wayback Machine</a>
</p><p><a href="http://www.copu.org.cn/new/266">16th CJK(China-Japan-South Korea) open source software outstanding technology award</a>
</p><p><a href="https://www.oschina.net/question/2896879_2290300?sort=default&">2018 China's most popular open source software award</a> <a href="https://web.archive.org/web/20190102143223/https://www.oschina.net/question/2896879_2290300?sort=default&">Archived</a> 2019-01-02 at the <a href="/facts/Wayback_Machine/nmQ3a6JC">Wayback Machine</a>
</p><p><a href="https://www.oschina.net/question/2918182_2313492">2019 China's most popular open source software award</a>
</p>
<h2 id="see-also">See also</h2>

<ul><li><a href="/facts/Apache_ActiveMQ/qxP90TQI">Apache ActiveMQ</a></li>
<li><a href="/facts/Apache_Flink/CTB6m4j2">Apache Flink</a></li>
<li><a href="/facts/Apache_Qpid/pQYMn7z9">Apache Qpid</a></li>
<li><a href="/facts/Apache_Samza/pmHY6XzP">Apache Samza</a></li>
<li><a href="/facts/Apache_Spark/rHQVfSBc">Apache Spark Streaming</a></li>
<li><a href="/facts/Data_Distribution_Service/V2fu8coB">Data Distribution Service</a></li>
<li><a href="/facts/Enterprise_Integration_Patterns/r4Jhlvzq">Enterprise Integration Patterns</a></li>
<li><a href="/facts/Enterprise_messaging_system/WHyKTTyE">Enterprise messaging system</a></li>
<li><a href="/facts/Event_stream_processing/0808WCf0">Streaming analytics</a></li>
<li><a href="/facts/Event-driven_SOA/EnVBo8pF">Event-driven SOA</a></li>
<li><a href="/facts/Message-oriented_middleware/jI3NVb5b">Message-oriented middleware</a></li>
<li><a href="/facts/Service-oriented_architecture/g8krR0dk">Service-oriented architecture</a></li>
<li><a href="/facts/Apache_Kafka/DVzgoEmu">Apache Kafka</a></li></ul>

<h2 id="external-links">External links</h2>
<ul><li><a href="https://rocketmq.apache.org/">Apache RocketMQ website</a></li>
<li><a href="https://github.com/apache/rocketmq-externals">Apache RocketMQ Externals</a></li>
<li><a href="https://ieeexplore.ieee.org/document/8089955/">A MQTT Protocol Message Push Server Based on RocketMQ</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1"><p>"apache/rocketmq". GitHub. Retrieved 2018-05-25. <a href="https://github.com/apache/rocketmq" target="_blank">https://github.com/apache/rocketmq</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li>
<li id="fn:2"><p>"From Alibaba to Apache: RocketMQ's Past, Present, and Future". InfoQ. Retrieved 2018-06-26. <a href="https://www.infoq.com/articles/alibaba-apache-rocketmq" target="_blank">https://www.infoq.com/articles/alibaba-apache-rocketmq</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li>
<li id="fn:3"><p>Liao, Jianwei; Zhuang, Xiaodan; Fan, Renyi; Peng, Xiaoning (2017). "Toward a General Distributed Messaging Framework for Online Transaction Processing Applications". IEEE Access. 5: 18166–18178. Bibcode:2017IEEEA...518166L. doi:10.1109/ACCESS.2017.2717930. <a href="https://doi.org/10.1109%2FACCESS.2017.2717930" target="_blank">https://doi.org/10.1109%2FACCESS.2017.2717930</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li>
<li id="fn:4"><p>Cloud, Alibaba (2018-01-04). "Kafka vs. RocketMQ- Multiple Topic Stress Test Results". Medium. Retrieved 2018-07-08. <a href="https://medium.com/@Alibaba_Cloud/kafka-vs-rocketmq-multiple-topic-stress-test-results-d27b8cbb360f" target="_blank">https://medium.com/@Alibaba_Cloud/kafka-vs-rocketmq-multiple-topic-stress-test-results-d27b8cbb360f</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li>
<li id="fn:5"><p>Yue, Ma; Ruiyang, Yan; Jianwei, Sun; Kaifeng, Yao (2017). "A MQTT Protocol Message Push Server Based on RocketMQ". 2017 10th International Conference on Intelligent Computation Technology and Automation (ICICTA). pp. 295–298. doi:10.1109/ICICTA.2017.72. ISBN 978-1-5386-1230-9. S2CID 28825800. <a href="978-1-5386-1230-9" target="_blank">978-1-5386-1230-9</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li>
<li id="fn:6"><p>"The OpenMessaging Benchmark Framework". openmessaging.cloud. Retrieved 2018-07-08. <a href="http://openmessaging.cloud/docs/benchmarks/" target="_blank">http://openmessaging.cloud/docs/benchmarks/</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li>
</ol>

Apache RocketMQ open-in-new

Apache RocketMQ