VENUS: Distributed Message Middleware towards Heterogeneous Database Synchronization

李碧  窦凤虎  刘洋  张鹏 



To solve the problem of data inconsistency in distributed database, this paper designed a distributed message-oriented middleware to synchronize heterogeneous database. In detail, the paper presents a method of capturing incremental data based on triggers and log tables to get dynamic incremental data. Moreover, the paper presents a message transmission mechanism based on half message and message review to guarantee messages’ order and the exactly-once semantics. In addition, the paper presents a method of generating full data based on incremental data‘s real-time computation to achieve high scalability and high availability. Finally, this paper implemented a prototype system named VENUS. The final test shows that VENUS strictly guarantees the data consistency between the destination database and the source one. Besides, the message transmission of VENUS is the most efficient compared to Kafka and RocketMQ.




首页
团队介绍
发展历史
组织结构
MESA大事记
新闻中心
通知
组内动态
科研成果
专利
论文
项目
获奖
软著
人才培养
MESA毕业生
MESA在读生
MESA员工
招贤纳士
走进MESA
学长分享
招聘通知
招生宣传
知识库
文章
地址:北京市朝阳区华严北里甲22号楼五层 | 邮编:100029
邮箱:nelist@iie.ac.cn
京ICP备15019404号-1