AWS i7ie enablement #559

avikivity · 2024-12-04T13:09:20Z

Add pre-measured io_properties.yaml for i7ie.

https://aws.amazon.com/blogs/aws/now-available-storage-optimized-amazon-ec2-i7ie-instances/

Adding preset value of i7ie instance type. Closes scylladb#559

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. Closes scylladb#559

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Measured 3 times for each instance types, and used average of the results. Closes scylladb#559

roydahan · 2024-12-08T14:02:45Z

There are several things we need to verify while adding:

Artifact tests.
Performance test and "validity of io-properties" - previously there were claims that io-properties are/were wrong for i4i instances.
This may require a discussion or at least an agreement of how do we qualify the io-properties. (FYI @yaronkaikov, @xemul, @fruch )

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Measured 3 times for each instance types, and used average of the results. Closes scylladb#559

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Measured 3 times for each instance types, and used average of the results. Measurement environment details: - Measured on i7ie.* instances with latest version of Ubuntu 24.04 LTS AMI (We cannot use Scylla AMI since we do want to measure single drive performance) - Measured single local SSD w/o RAID0, since we simulate RAID0 performance on scylla_cloud_io_setup script from single drive performance - Use iotune for the measurement, executed 3 times for each instance size and used average of the results - Automated measurement by script: https://github.com/syuu1228/ec2_run_script Here's raw output of iotune: - i7ie.large (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47148 IOPS (deviation 27%) Measuring random read IOPS: 58450 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47144 IOPS (deviation 27%) Measuring random read IOPS: 58447 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47145 IOPS (deviation 27%) Measuring random read IOPS: 58452 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (2/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94166 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1094 MB/s (deviation 43%) Measuring random write IOPS: 94161 IOPS (deviation 14%) Measuring random read IOPS: 117270 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94177 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119127 IOPS Measuring random read IOPS: 352843 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 118973 IOPS Measuring random read IOPS: 352844 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119881 IOPS Measuring random read IOPS: 352817 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3273 MB/s (deviation 28%) Measuring random write IOPS: 118808 IOPS Measuring random read IOPS: 352813 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119741 IOPS Measuring random read IOPS: 352837 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119246 IOPS Measuring random read IOPS: 352822 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119566 IOPS Measuring random read IOPS: 352835 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119214 IOPS Measuring random read IOPS: 352829 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 118033 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3267 MB/s (deviation 26%) Measuring random write IOPS: 119544 IOPS Measuring random read IOPS: 352825 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119555 IOPS Measuring random read IOPS: 352816 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119518 IOPS Measuring random read IOPS: 352815 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119147 IOPS Measuring random read IOPS: 352824 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119154 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119535 IOPS Measuring random read IOPS: 352826 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 13%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119516 IOPS Measuring random read IOPS: 352834 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119574 IOPS Measuring random read IOPS: 352831 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119226 IOPS Measuring random read IOPS: 352815 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf Closes scylladb#559

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Here's measurement environment details: - Measured on i7ie.* instances with latest version of Ubuntu 24.04 LTS AMI (We cannot use Scylla AMI since we do want to measure single drive performance) - Measured single local SSD w/o RAID0, since we simulate RAID0 performance on scylla_cloud_io_setup script from single drive performance - Use iotune for the measurement, executed 3 times for each instance size and used average of the results - Automated measurement by script: https://github.com/syuu1228/ec2_run_script Here's raw output of iotune: - i7ie.large (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47148 IOPS (deviation 27%) Measuring random read IOPS: 58450 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47144 IOPS (deviation 27%) Measuring random read IOPS: 58447 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47145 IOPS (deviation 27%) Measuring random read IOPS: 58452 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (2/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94166 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1094 MB/s (deviation 43%) Measuring random write IOPS: 94161 IOPS (deviation 14%) Measuring random read IOPS: 117270 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94177 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119127 IOPS Measuring random read IOPS: 352843 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 118973 IOPS Measuring random read IOPS: 352844 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119881 IOPS Measuring random read IOPS: 352817 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3273 MB/s (deviation 28%) Measuring random write IOPS: 118808 IOPS Measuring random read IOPS: 352813 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119741 IOPS Measuring random read IOPS: 352837 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119246 IOPS Measuring random read IOPS: 352822 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119566 IOPS Measuring random read IOPS: 352835 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119214 IOPS Measuring random read IOPS: 352829 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 118033 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3267 MB/s (deviation 26%) Measuring random write IOPS: 119544 IOPS Measuring random read IOPS: 352825 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119555 IOPS Measuring random read IOPS: 352816 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119518 IOPS Measuring random read IOPS: 352815 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119147 IOPS Measuring random read IOPS: 352824 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119154 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119535 IOPS Measuring random read IOPS: 352826 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 13%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119516 IOPS Measuring random read IOPS: 352834 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119574 IOPS Measuring random read IOPS: 352831 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119226 IOPS Measuring random read IOPS: 352815 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf Closes scylladb#559

mykaul · 2025-01-08T13:34:33Z

@roydahan , @fruch - I assume there's some work to enable this instance type in SCT? Is it tracked somewhere?

fruch · 2025-01-08T13:40:23Z

@roydahan , @fruch - I assume there's some work to enable this instance type in SCT? Is it tracked somewhere?

we have a task to test its performance - and it's in progress
I think we should add those into the artifacts test list of instances, which is in scylla-pkg, @yaronkaikov

roydahan · 2025-01-08T14:36:12Z

If we want, we can replace all (or most) i3en usages to i7ie which is much much faster.

mykaul · 2025-01-08T14:58:48Z

If we want, we can replace all (or most) i3en usages to i7ie which is much much faster.

But it's unclear if this is the path our customers would go, cost/performance-wise.
I also assume it's availability is not great. I suggest gradual move.

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Here's measurement environment details: - Measured on i7ie.* instances with latest version of Ubuntu 24.04 LTS AMI (We cannot use Scylla AMI since we do want to measure single drive performance) - Measured single local SSD w/o RAID0, since we simulate RAID0 performance on scylla_cloud_io_setup script from single drive performance - Use iotune for the measurement, executed 3 times for each instance size and used average of the results - Automated measurement by script: https://github.com/syuu1228/ec2_run_script Here's raw output of iotune: - i7ie.large (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47148 IOPS (deviation 27%) Measuring random read IOPS: 58450 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47144 IOPS (deviation 27%) Measuring random read IOPS: 58447 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47145 IOPS (deviation 27%) Measuring random read IOPS: 58452 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (2/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94166 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1094 MB/s (deviation 43%) Measuring random write IOPS: 94161 IOPS (deviation 14%) Measuring random read IOPS: 117270 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94177 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119127 IOPS Measuring random read IOPS: 352843 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 118973 IOPS Measuring random read IOPS: 352844 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119881 IOPS Measuring random read IOPS: 352817 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3273 MB/s (deviation 28%) Measuring random write IOPS: 118808 IOPS Measuring random read IOPS: 352813 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119741 IOPS Measuring random read IOPS: 352837 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119246 IOPS Measuring random read IOPS: 352822 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119566 IOPS Measuring random read IOPS: 352835 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119214 IOPS Measuring random read IOPS: 352829 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 118033 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3267 MB/s (deviation 26%) Measuring random write IOPS: 119544 IOPS Measuring random read IOPS: 352825 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119555 IOPS Measuring random read IOPS: 352816 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119518 IOPS Measuring random read IOPS: 352815 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119147 IOPS Measuring random read IOPS: 352824 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119154 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119535 IOPS Measuring random read IOPS: 352826 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 13%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119516 IOPS Measuring random read IOPS: 352834 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119574 IOPS Measuring random read IOPS: 352831 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119226 IOPS Measuring random read IOPS: 352815 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf Closes scylladb#559 (cherry picked from commit d943950)

avikivity · 2025-01-12T11:46:57Z

Customers that are storage bound will stay on i3en. Moving to i7ie will not help them, and it's more expensive.

Customers that are heavily CPU bound will stay on i4i.

Customers that are in between will benefit from moving to i7ie. If you have too much CPU on i4i and too much storage on i3en, then i7ie can be a good solution.

roydahan · 2025-01-12T20:09:54Z

If we want, we can replace all (or most) i3en usages to i7ie which is much much faster.

Bringing this back, @fruch I think it worth moving some of the current tests from i3en to i7ie.

fruch · 2025-01-13T08:19:37Z

If we want, we can replace all (or most) i3en usages to i7ie which is much much faster.

Bringing this back, @fruch I think it worth moving some of the current tests from i3en to i7ie.

all of the perf test that are using i3en ? care to explain a bit why, i.e. why you think we can benefit from it ? or just to try them out first ?

roydahan · 2025-01-13T10:31:44Z

Actually not the perf tests (yet), but regular tests in SCT, to have some coverage and experience with the new instance types.

fruch · 2025-01-13T11:12:15Z

suggestion from tier 1:

longevity-twcs-48h
longevity-large-partition-200k_pks-4days.yaml (but we run this one on GCE)
longevity-multidc-parallel-topology-schema-changes-12h

the rest are not that used test, and some manager tests

mykaul · 2025-01-22T15:51:08Z

i7ie.xlarge:
  read_iops: 117257
  read_bandwidth: 1148572714
  write_iops: 94180
  write_bandwidth: 505684885
i7ie.2xlarge:
  read_iops: 117257
  read_bandwidth: 1148572714
  write_iops: 94180
  write_bandwidth: 505684885

Whereas https://docs.aws.amazon.com/ec2/latest/instancetypes/so.html#so_instance-store says:

i7ie.large	1 x 1250 GB	NVMe SSD	54,166 / 43,333		✓
i7ie.xlarge	1 x 2500 GB	NVMe SSD	108,333 / 86,666		✓
i7ie.2xlarge	2 x 2500 GB	NVMe SSD	216,666 / 173,332		✓

So double the performance between them.

roydahan · 2025-01-22T22:10:21Z

@mykaul what are you saying here?
Do we need to double the metrics we have for i7ie.2xlarge?
Anyway, this one is a closed issue, if this is the case, please open a new issue and let's discuss there what and why we have these numbers.

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Here's measurement environment details: - Measured on i7ie.* instances with latest version of Ubuntu 24.04 LTS AMI (We cannot use Scylla AMI since we do want to measure single drive performance) - Measured single local SSD w/o RAID0, since we simulate RAID0 performance on scylla_cloud_io_setup script from single drive performance - Use iotune for the measurement, executed 3 times for each instance size and used average of the results - Automated measurement by script: https://github.com/syuu1228/ec2_run_script Here's raw output of iotune: - i7ie.large (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47148 IOPS (deviation 27%) Measuring random read IOPS: 58450 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47144 IOPS (deviation 27%) Measuring random read IOPS: 58447 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47145 IOPS (deviation 27%) Measuring random read IOPS: 58452 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (2/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94166 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1094 MB/s (deviation 43%) Measuring random write IOPS: 94161 IOPS (deviation 14%) Measuring random read IOPS: 117270 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94177 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119127 IOPS Measuring random read IOPS: 352843 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 118973 IOPS Measuring random read IOPS: 352844 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119881 IOPS Measuring random read IOPS: 352817 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3273 MB/s (deviation 28%) Measuring random write IOPS: 118808 IOPS Measuring random read IOPS: 352813 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119741 IOPS Measuring random read IOPS: 352837 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119246 IOPS Measuring random read IOPS: 352822 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119566 IOPS Measuring random read IOPS: 352835 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119214 IOPS Measuring random read IOPS: 352829 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 118033 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3267 MB/s (deviation 26%) Measuring random write IOPS: 119544 IOPS Measuring random read IOPS: 352825 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119555 IOPS Measuring random read IOPS: 352816 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119518 IOPS Measuring random read IOPS: 352815 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119147 IOPS Measuring random read IOPS: 352824 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119154 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119535 IOPS Measuring random read IOPS: 352826 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 13%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119516 IOPS Measuring random read IOPS: 352834 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119574 IOPS Measuring random read IOPS: 352831 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119226 IOPS Measuring random read IOPS: 352815 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf Closes scylladb#559 (cherry picked from commit d943950)

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. All preset values are measured by iotune on target instances. Here's measurement environment details: - Measured on i7ie.* instances with latest version of Ubuntu 24.04 LTS AMI (We cannot use Scylla AMI since we do want to measure single drive performance) - Measured single local SSD w/o RAID0, since we simulate RAID0 performance on scylla_cloud_io_setup script from single drive performance - Use iotune for the measurement, executed 3 times for each instance size and used average of the results - Automated measurement by script: https://github.com/syuu1228/ec2_run_script Here's raw output of iotune: - i7ie.large (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47148 IOPS (deviation 27%) Measuring random read IOPS: 58450 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47144 IOPS (deviation 27%) Measuring random read IOPS: 58447 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.large (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 241 MB/s (deviation 11%) Measuring sequential read bandwidth: 548 MB/s (deviation 43%) Measuring random write IOPS: 47145 IOPS (deviation 27%) Measuring random read IOPS: 58452 IOPS (deviation 24%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (2/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.xlarge (3/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94184 IOPS (deviation 14%) Measuring random read IOPS: 117261 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (1/3) Creating XFS volume for scylla using 1 disk(s): /dev/nvme1n1 Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94166 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1094 MB/s (deviation 43%) Measuring random write IOPS: 94161 IOPS (deviation 14%) Measuring random read IOPS: 117270 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.2xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 482 MB/s (deviation 10%) Measuring sequential read bandwidth: 1095 MB/s (deviation 43%) Measuring random write IOPS: 94177 IOPS (deviation 14%) Measuring random read IOPS: 117266 IOPS (deviation 25%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119127 IOPS Measuring random read IOPS: 352843 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 118973 IOPS Measuring random read IOPS: 352844 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.3xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119881 IOPS Measuring random read IOPS: 352817 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3273 MB/s (deviation 28%) Measuring random write IOPS: 118808 IOPS Measuring random read IOPS: 352813 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119741 IOPS Measuring random read IOPS: 352837 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.6xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 6%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119246 IOPS Measuring random read IOPS: 352822 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3263 MB/s (deviation 25%) Measuring random write IOPS: 119566 IOPS Measuring random read IOPS: 352835 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119214 IOPS Measuring random read IOPS: 352829 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.12xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 9%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 118033 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3267 MB/s (deviation 26%) Measuring random write IOPS: 119544 IOPS Measuring random read IOPS: 352825 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119555 IOPS Measuring random read IOPS: 352816 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.18xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1456 MB/s (deviation 11%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119518 IOPS Measuring random read IOPS: 352815 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119147 IOPS Measuring random read IOPS: 352824 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119154 IOPS Measuring random read IOPS: 352832 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.24xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3266 MB/s (deviation 26%) Measuring random write IOPS: 119535 IOPS Measuring random read IOPS: 352826 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (1/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 13%) Measuring sequential read bandwidth: 3264 MB/s (deviation 25%) Measuring random write IOPS: 119516 IOPS Measuring random read IOPS: 352834 IOPS (deviation 18%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (2/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3265 MB/s (deviation 26%) Measuring random write IOPS: 119574 IOPS Measuring random read IOPS: 352831 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf - i7ie.48xlarge (3/3) Starting Evaluation. This may take a while... Measuring sequential write bandwidth: 1455 MB/s (deviation 12%) Measuring sequential read bandwidth: 3269 MB/s (deviation 27%) Measuring random write IOPS: 119226 IOPS Measuring random read IOPS: 352815 IOPS (deviation 19%) Writing result to /etc/scylla.d/io_properties.yaml Writing result to /etc/scylla.d/io.conf Closes #559 (cherry picked from commit d943950)

mykaul · 2025-01-23T12:09:32Z

@mykaul what are you saying here? Do we need to double the metrics we have for i7ie.2xlarge? Anyway, this one is a closed issue, if this is the case, please open a new issue and let's discuss there what and why we have these numbers.

I'm saying that there's something wrong.
#608

yaronkaikov assigned syuu1228 Dec 4, 2024

syuu1228 added a commit to syuu1228/scylla-machine-image that referenced this issue Dec 5, 2024

scylla_cloud_io_setup: add i7ie instance type

5c746cf

Adding preset value of i7ie instance type. Closes scylladb#559

syuu1228 added a commit to syuu1228/scylla-machine-image that referenced this issue Dec 5, 2024

aws: add i7ie instance type

94d38a0

Adding preset io parameters of i7ie to scylla_cloud_io_setup, and also added i7ie to supported instance type on aws_instance class. Closes scylladb#559

syuu1228 mentioned this issue Dec 5, 2024

aws: add i7ie instance type #561

Merged

mykaul added this to the 2025.1 milestone Dec 9, 2024

yaronkaikov closed this as completed in #561 Jan 6, 2025

yaronkaikov closed this as completed in d943950 Jan 6, 2025

scylladbbot mentioned this issue Jan 9, 2025

[Backport 2024.2] aws: add i7ie instance type #599

Merged

mykaul mentioned this issue Jan 23, 2025

IO values for i7ie.2xlarge are identical to i7ie.xlarge #608

Open

This was referenced Jan 27, 2025

docs: Issue on page Cloud Instance Recommendations for AWS: add i7ie scylladb/scylladb#22524

Open

docs: Issue on page Cloud Instance Recommendations for AWS: add i7ie scylladb/scylladb#22525

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

AWS i7ie enablement #559

AWS i7ie enablement #559

avikivity commented Dec 4, 2024

roydahan commented Dec 8, 2024

mykaul commented Jan 8, 2025

fruch commented Jan 8, 2025

roydahan commented Jan 8, 2025

mykaul commented Jan 8, 2025

avikivity commented Jan 12, 2025

roydahan commented Jan 12, 2025

fruch commented Jan 13, 2025

roydahan commented Jan 13, 2025

fruch commented Jan 13, 2025

mykaul commented Jan 22, 2025

roydahan commented Jan 22, 2025

mykaul commented Jan 23, 2025

AWS i7ie enablement #559

AWS i7ie enablement #559

Comments

avikivity commented Dec 4, 2024

roydahan commented Dec 8, 2024

mykaul commented Jan 8, 2025

fruch commented Jan 8, 2025

roydahan commented Jan 8, 2025

mykaul commented Jan 8, 2025

avikivity commented Jan 12, 2025

roydahan commented Jan 12, 2025

fruch commented Jan 13, 2025

roydahan commented Jan 13, 2025

fruch commented Jan 13, 2025

mykaul commented Jan 22, 2025

roydahan commented Jan 22, 2025

mykaul commented Jan 23, 2025