Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

issue-539: add service-side two-stage writes support for scaling throughput #807

Merged
merged 12 commits into from
Apr 2, 2024

Conversation

debnatkh
Copy link
Collaborator

@debnatkh debnatkh commented Mar 22, 2024

Continuation of #707, references #539.

Add the ability to perform client-side writes:

  1. BlobIds are issued to a client via a GenerateBlobIds request.
  2. Data is written directly to the BlobStorage
  3. On the completion AddData request is called to complete the write.

On any error, a fallback to a regular write path is used.

@debnatkh debnatkh added the filestore Add this label to run only cloud/filestore build and tests on PR label Mar 22, 2024
@debnatkh debnatkh marked this pull request as ready for review March 22, 2024 17:40
@debnatkh debnatkh requested a review from qkrorlqr March 22, 2024 18:53
@debnatkh debnatkh added the large-tests Launch large tests for PR label Mar 28, 2024
@debnatkh debnatkh force-pushed the users/debnatkh/issue-539-service branch from f142b02 to afad34a Compare March 28, 2024 15:52
Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🔴 linux-x86_64-relwithdebinfo: some tests FAILED for commit afad34a.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1519 1510 0 9 0 0

Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🔴 linux-x86_64-relwithdebinfo: some tests FAILED for commit 8ece49b.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1513 1512 0 1 0 0

Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 9d44221.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1513 1513 0 0 0 0

cloud/filestore/libs/storage/service/service_ut.cpp Outdated Show resolved Hide resolved
cloud/filestore/libs/storage/service/service_ut.cpp Outdated Show resolved Hide resolved
cloud/filestore/libs/storage/service/service_ut.cpp Outdated Show resolved Hide resolved
cloud/filestore/libs/storage/service/service_ut.cpp Outdated Show resolved Hide resolved
@debnatkh debnatkh force-pushed the users/debnatkh/issue-539-service branch from 77cd748 to e23324e Compare March 29, 2024 16:31
@debnatkh debnatkh force-pushed the users/debnatkh/issue-539-service branch from e23324e to 5a57e45 Compare March 29, 2024 16:35
Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🔴 linux-x86_64-relwithdebinfo: some tests FAILED for commit 5a57e45.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1514 1512 0 2 0 0

@debnatkh debnatkh force-pushed the users/debnatkh/issue-539-service branch from 23db01a to 7edf251 Compare April 2, 2024 09:59
Copy link
Contributor

github-actions bot commented Apr 2, 2024

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 7edf251.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
1513 1513 0 0 0 0

@debnatkh debnatkh merged commit 64228ad into main Apr 2, 2024
7 checks passed
@debnatkh debnatkh deleted the users/debnatkh/issue-539-service branch April 2, 2024 15:29
debnatkh added a commit that referenced this pull request Apr 2, 2024
…ughput (#807)

issue-539: add service-side two-stage writes support
debnatkh added a commit that referenced this pull request Apr 3, 2024
* issue-539: extract writedata actor into separate location + add TABLET_VERIFY for ReleaseCollectBarrier (#790)

issue-539: extract writedata actor into separate location + add TABLET_VERIFY for ReleaseCollectBarrier

* fix arcadia build: trailing EOL (#808)

* issue-539: add tablet-side two-stage writes support for scaling throughput (#707)

issue-539: add two-stage writes for scaling throughput

* issue-539: add service-side two-stage writes support for scaling throughput (#807)

issue-539: add service-side two-stage writes support

* fix cmake build
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
filestore Add this label to run only cloud/filestore build and tests on PR large-tests Launch large tests for PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants