Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[INLONG-11352][SDK] Add dirty data collection sdk #11354

Merged
merged 10 commits into from
Oct 21, 2024

Conversation

justinwwhuang
Copy link
Contributor

@justinwwhuang justinwwhuang commented Oct 14, 2024

Fixes #11352

Motivation

The ability to archive dirty data is required for each module and needs to be made into an independent SDK

Modifications

Add dirty data collection sdk

Verifying this change

(Please pick either of the following options)

  • This change is a trivial rework/code cleanup without any test coverage.

  • This change is already covered by existing tests, such as:
    (please describe tests)

  • This change added tests and can be verified as follows:

    (example:)

    • Added integration tests for end-to-end deployment with large payloads (10MB)
    • Extended integration test for recovery after broker failure

Documentation

No doc needed

@justinwwhuang justinwwhuang added this to the 2.1.0 milestone Oct 14, 2024
@justinwwhuang justinwwhuang self-assigned this Oct 14, 2024
@aloyszhang aloyszhang changed the title [INLONG-11352][Agent] Add dirty data collection sdk [INLONG-11352][SDK] Add dirty data collection sdk Oct 14, 2024
aloyszhang
aloyszhang previously approved these changes Oct 16, 2024
dockerzhang
dockerzhang previously approved these changes Oct 16, 2024
@justinwwhuang justinwwhuang dismissed stale reviews from dockerzhang and aloyszhang via 81e93af October 17, 2024 07:33
aloyszhang
aloyszhang previously approved these changes Oct 19, 2024
vernedeng
vernedeng previously approved these changes Oct 21, 2024
@dockerzhang dockerzhang dismissed stale reviews from vernedeng and aloyszhang via 6ad46e1 October 21, 2024 06:07
@dockerzhang dockerzhang merged commit 8c7d31d into apache:master Oct 21, 2024
7 checks passed
@justinwwhuang justinwwhuang deleted the b11352 branch October 22, 2024 06:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improve][SDK] Add dirty data collection sdk
5 participants