refactor(canal/server): 优化CanalServer日志，加锁等逻辑 #5545
+140
−105
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- canal server logback.xml 配置增加 CanalServerWithEmbedded 单独日志配置，流量非常大的情况下，getMessages/ack等日志量非常大 日志刷盘太快也影响性能，占磁盘空间。用户可以根据需要单独调整日志级别。默认是INFO - TableMetaCache 锁的范围太大，针对这块做了代码逻辑优化。以下场景影响性能： - 当用户关闭tsdb.enable=false, 分库分表数量非常多回查次数很多； - 每张表有四五百列甚至更多，里面的集合容器提前初始化，减少扩容的次数； - DatabaseTableMeta 标记一个内存不安全的地方，以后看情况优化掉 使用MemoryTableMeta在内存区记录表元数据，当分库分表数量非常多，表结构非常复杂非常吃内存，容易OOM
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
canal server logback.xml 配置增加 CanalServerWithEmbedded 单独日志配置，流量非常大的情况下，getMessages/ack等日志量非常大 日志刷盘太快也影响性能，占磁盘空间。用户可以根据需要单独调整日志级别。默认是INFO
TableMetaCache 锁的范围太大，针对这块做了代码逻辑优化。以下场景影响性能：
DatabaseTableMeta 标记一个内存不安全的地方，以后看情况优化掉 使用MemoryTableMeta在内存区记录表元数据，当分库分表数量非常多，表结构非常复杂非常吃内存，容易OOM