Conversation
…transport_store_dev
…transport_store_dev
将 UbDiag 性能监控配置移至目标链接后,确保依赖顺序正确。 重命名 GET_BATCH_INTERNAL_SELECT_REPL 和 GET_BATCH_INTERNAL_ALLOC 常量,使其名称更完整清晰。
UbDiag 现在被设为必需依赖,因此无需再通过 UBDIAG_ENABLED 宏进行条件编译。这简化了构建配置,并确保性能检测代码在构建中始终被包含。相应的 CMake 定义也已移除。
…locator.cpp Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
- 在 Python 绑定层 (store_py.cpp) 的 put 和 put_batch 方法中添加性能打点 - 在 RealClient 的 put_internal 和 put_batch_internal 方法中添加关键步骤的性能打点 - 在 Client 服务层的 Put 和 BatchPut 方法中添加完整流程及子步骤的性能打点 - 更新性能点定义文件 (mooncake_perf_points.def),新增 put 相关性能键 - 更新文档 (pipline.md),添加 put 和 put_batch 的详细流程图 - 新增底层逻辑详解文档 (put_get_logic.md),说明 put/get 的完整流程 - 在 TransferData 方法中根据操作类型 (读/写) 选择对应的性能键
- 在 put、get、batch_put、batch_get 操作中添加 INFO 级别日志,记录关键指标(键、大小、耗时、成功/失败数量) - 将性能监控点 GET_INTERNAL_MEMDISH_READ 拆分为 GET_INTERNAL_MEM_READ 和 GET_INTERNAL_DISK_READ,以区分内存和磁盘读取 - 在 Python 包装层添加操作耗时统计,便于性能分析和问题排查 - 优化批量操作的结果统计,提供更详细的执行情况反馈
- 在 Get 操作完成时记录传输耗时 - 在 BatchGet 完成后记录成功数量和总耗时 - 在 Put 操作开始和结束时记录关键状态和耗时 - 在 BatchPut 开始和结束时记录操作数量和失败计数
- 将 Python 包装层的 Full 打点上移至 store_py.cpp,以准确测量内部核心逻辑耗时 - 移除 client_service.cpp 中冗余的 Full 打点,避免与上层打点重叠 - 更新性能点定义文件,修正描述和层级,使监控链路更清晰 - 更新文档中的性能监控流程图,反映新的打点位置和结构
改进副本选择日志输出,在原有内存/磁盘类型基础上,增加对本地磁盘副本的识别和显示,使日志能更准确地反映实际副本类型。
- 在 Python 绑定层 (store/store_py.cpp) 的 get、get_batch、put、put_batch 方法中添加慢操作告警日志,当操作耗时超过阈值(单操作 3ms,批量操作 10ms)时记录 WARNING 日志 - 在核心逻辑层 (client_service.cpp) 的 Get、BatchGet、Put、BatchPut 方法中增强日志,添加数据大小、缓存命中、待处理任务数等关键指标,便于性能分析 - 在 real_client.cpp 中为 get_buffer_internal 和 batch_get_buffer_internal 方法添加详细的耗时分解日志,记录查询、选择副本、分配内存、数据读取等各阶段耗时及副本类型 - 在 TransferData 方法中添加传输耗时拆分日志,区分提交耗时和等待耗时 - 新增文档 docs/yh/log-reference.md 和 docs/yh/transfer-engine-deep-dive.md,分别提供全链路日志参考手册和传输引擎深度解析
add UbDiag Perf Points
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Module
mooncake-transfer-engine)mooncake-store)mooncake-ep)mooncake-integration)mooncake-p2p-store)mooncake-wheel)mooncake-pg)mooncake-rl)Type of Change
How Has This Been Tested?
Checklist
./scripts/code_format.shbefore submitting.