Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

perf: 定时任务全量加载速度优化 #3363

Open
jsonwan opened this issue Dec 26, 2024 · 0 comments
Open

perf: 定时任务全量加载速度优化 #3363

jsonwan opened this issue Dec 26, 2024 · 0 comments
Assignees
@jsonwan
Labels
for gray 可以在灰度环境/预发布环境验收 kind/enhancement 功能改进特性

Comments

@jsonwan
Copy link
Collaborator

jsonwan commented Dec 26, 2024

当前加载方式为逐个定时任务单独加载，导致大量的DB查询耗时累加，需要优化为批量处理。
@jsonwan jsonwan added kind/enhancement 功能改进特性 backlog 需求初始状态，等待产品进行评估 labels Dec 26, 2024
@bkjob-bot bkjob-bot added todo 进入开发排期的状态，纳入了最近的迭代 and removed backlog 需求初始状态，等待产品进行评估 labels Jan 9, 2025
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 14, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
1975429 
1.更准确地判断Quartz状态；
2.加载任务前增加对Quartz状态的判断，Quartz启动完成后才开始加载任务。
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 14, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
560edb9 
1.添加Quartz关闭插件，收到kill -15信号后立即关闭Quartz，避免后续Spring容器销毁后任务触发使用Bean异常。
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 14, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
d2219fc 
1.所有上游服务的负载均衡缓存刷新时间调整为20s（默认35s）；
2.调整GracefulShutdown等待时间为30s。
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 14, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
5ad39d3 
1.重构部分老代码，降低圈复杂度。
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 14, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
3849d51 
1.重构部分老代码，降低圈复杂度。
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 14, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
a83f1ad 
1.优化批量加载定时任务至Quartz过程的性能，避免循环DB查询。
jsonwan added a commit that referenced this issue Jan 15, 2025
@jsonwan
Merge pull request #3379 from jsonwan/github_perf/cron
a217c9c 
perf: 定时任务全量加载速度优化 #3363
@bkjob-bot bkjob-bot added doing 已经接受处理，正在开发实施 and removed todo 进入开发排期的状态，纳入了最近的迭代 labels Jan 15, 2025
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 16, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
df5efd2 
1.优化日志打印。
@bkjob-bot bkjob-bot added todo 进入开发排期的状态，纳入了最近的迭代 and removed todo 进入开发排期的状态，纳入了最近的迭代 labels Jan 16, 2025
jsonwan added a commit that referenced this issue Jan 16, 2025
@jsonwan
Merge pull request #3382 from jsonwan/github_perf/cron
2162aca 
perf: 定时任务全量加载速度优化 #3363
@bkjob-bot bkjob-bot added for gray 可以在灰度环境/预发布环境验收 and removed doing 已经接受处理，正在开发实施 labels Jan 16, 2025
@jsonwan jsonwan self-assigned this Jan 16, 2025
jsonwan added a commit to jsonwan/bk-job that referenced this issue Jan 17, 2025
@jsonwan
perf: 定时任务全量加载速度优化 TencentBlueKing#3363
ee9537e 
1.修复不触发的bug。
jsonwan added a commit that referenced this issue Jan 17, 2025
@jsonwan
Merge pull request #3384 from jsonwan/github_perf/cron
257f052 
perf: 定时任务全量加载速度优化 #3363
@bkjob-bot bkjob-bot added doing 已经接受处理，正在开发实施 and removed doing 已经接受处理，正在开发实施 labels Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jsonwan jsonwan

Labels
for gray 可以在灰度环境/预发布环境验收 kind/enhancement 功能改进特性
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jsonwan @bkjob-bot