[Backport 2024.2] aws: add i7ie instance type #599
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Here's measurement environment details: - Measured on i7ie.* instances with latest version of Ubuntu 24.04 LTS AMI (We cannot use Scylla AMI since we do want to measure single drive performance) - Measured single local SSD w/o RAID0, since we simulate RAID0 performance on scylla_cloud_io_setup script from single drive performance - Use iotune for the measurement, executed 3 times for each instance size and used average of the results - Automated measurement by script: https://github.com/syuu1228/ec2_run_script Here's raw output of iotune: - i7ie.large (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47148 IOPS (deviation 27%) Measuring random read IOPS: 58450 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47144 IOPS (deviation 27%) Measuring random read IOPS: 58447 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47145 IOPS (deviation 27%) Measuring random read IOPS: 58452 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (2/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94166 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1094 MB/s (deviation 43%) Measuring random write IOPS: 94161 IOPS (deviation 14%) Measuring random read IOPS: 117270 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94177 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119127 IOPS Measuring random read IOPS: 352843 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 118973 IOPS Measuring random read IOPS: 352844 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119881 IOPS Measuring random read IOPS: 352817 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3273 MB/s (deviation 28%) Measuring random write IOPS: 118808 IOPS Measuring random read IOPS: 352813 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119741 IOPS Measuring random read IOPS: 352837 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119246 IOPS Measuring random read IOPS: 352822 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119566 IOPS Measuring random read IOPS: 352835 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119214 IOPS Measuring random read IOPS: 352829 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 118033 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3267 MB/s (deviation 26%) Measuring random write IOPS: 119544 IOPS Measuring random read IOPS: 352825 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119555 IOPS Measuring random read IOPS: 352816 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119518 IOPS Measuring random read IOPS: 352815 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119147 IOPS Measuring random read IOPS: 352824 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119154 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119535 IOPS Measuring random read IOPS: 352826 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 13%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119516 IOPS Measuring random read IOPS: 352834 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119574 IOPS Measuring random read IOPS: 352831 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119226 IOPS Measuring random read IOPS: 352815 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf Closes scylladb#559 (cherry picked from commit d943950)
|
@syuu1228 - This PR has conflicts, therefore it was moved to |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class.
Closes #559
Parent PR: #561