Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: adds network test with latency #3738

Closed
wants to merge 35 commits into from
Closed

test: adds network test with latency #3738

Show file tree
Hide file tree
Changes from 32 commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
dd31ca6
checks the target size against the max block size
staheri14 Jul 8, 2024
810bf33
removes unnecessary usage of Printf for logs
staheri14 Jul 8, 2024
d09f00f
adds benchtest with latency
staheri14 Jul 8, 2024
0d9abd0
adds ReadBlockchainInfo
staheri14 Jul 8, 2024
48adbef
retrieves block metadata
staheri14 Jul 8, 2024
423a8db
reads block headers in E2ESimple
staheri14 Jul 8, 2024
48a7014
updates log messages
staheri14 Jul 8, 2024
3b87baa
resolves linter issues
staheri14 Jul 8, 2024
8ee445f
increase seq count per txclient in E2ESimple
staheri14 Jul 8, 2024
3af0a79
expands on the godoc
staheri14 Jul 8, 2024
71655d5
Merge branch 'sanaz/perf-improvement-blockchain-read' into sanaz/test…
staheri14 Jul 9, 2024
e4e5333
includes LargeNetworkBigBlock64MBLatency in the list of available tests
staheri14 Jul 9, 2024
b7896f3
sets txsim volume to 0
staheri14 Jul 9, 2024
d09f96e
reads the entire history
staheri14 Jul 10, 2024
2909d2e
extends wait time
staheri14 Jul 11, 2024
0f218bb
updates read blockchain info
staheri14 Jul 11, 2024
22f6f1f
refactors the implementation
staheri14 Jul 11, 2024
0901d09
swaps info with headers
staheri14 Jul 11, 2024
c7bede7
minor doc fix
staheri14 Jul 11, 2024
070101e
deletes print statements
staheri14 Jul 11, 2024
b52cb08
retracts old waiting values
staheri14 Jul 11, 2024
8ae64a3
fix a bug
staheri14 Jul 11, 2024
c89ac2c
updates some of the comments for clarity
staheri14 Jul 11, 2024
9a240c9
Merge branch 'sanaz/perf-improvement-blockchain-read' into sanaz/test…
staheri14 Jul 11, 2024
9be6048
adds network test with latency and 8 MB block size
staheri14 Jul 11, 2024
074bea1
extends wait time for genesis nodes to sync
staheri14 Jul 11, 2024
c925179
adds a prefix
staheri14 Jul 12, 2024
222d45d
extends test duration
staheri14 Jul 12, 2024
af001b2
reduces sequences to 1
staheri14 Jul 12, 2024
7497714
manifest of next experiment
staheri14 Jul 12, 2024
09fc929
Merge branch 'main' into sanaz/test-w-latency
staheri14 Jul 25, 2024
a90fd89
Merge remote-tracking branch 'origin/main' into sanaz/test-w-latency
staheri14 Aug 1, 2024
bafff03
Merge branch 'main' into sanaz/test-w-latency
staheri14 Aug 21, 2024
7170731
sets volume to 1Gi
staheri14 Aug 21, 2024
38e08ef
Merge branch 'main' into sanaz/test-w-latency
staheri14 Aug 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions test/e2e/benchmark/main.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@ func main() {
{"LargeNetworkBigBlock8MB", LargeNetworkBigBlock8MB},
{"LargeNetworkBigBlock32MB", LargeNetworkBigBlock32MB},
{"LargeNetworkBigBlock64MB", LargeNetworkBigBlock64MB},
{"LargeNetworkBigBlock64MBLatency", LargeNetworkBigBlock64MBLatency},
{"LargeNetworkBigBlock8MBLatency", LargeNetworkBigBlock8MBLatency},
}

// check the test name passed as an argument and run it
Expand Down
22 changes: 22 additions & 0 deletions test/e2e/benchmark/throughput.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -179,3 +179,25 @@ func LargeNetworkBigBlock64MB(logger *log.Logger) error {
manifest.BlobSequences = 2
return runBenchmarkTest(logger, "LargeNetworkBigBlock64MB", manifest)
}

func LargeNetworkBigBlock64MBLatency(logger *log.Logger) error {
manifest := bigBlockManifest
manifest.MaxBlockBytes = 64 * testnet.MB
manifest.Validators = 50
manifest.TxClients = 50
manifest.BlobSequences = 2
manifest.EnableLatency = true
manifest.LatencyParams = LatencyParams{70, 0}
return runBenchmarkTest(logger, "LargeNetworkBigBlock64MBLatency", manifest)
}
func LargeNetworkBigBlock8MBLatency(logger *log.Logger) error {
manifest := bigBlockManifest
manifest.MaxBlockBytes = 8 * testnet.MB
manifest.Validators = 50
manifest.TxClients = 50
manifest.BlobSequences = 2
manifest.EnableLatency = true
manifest.LatencyParams = LatencyParams{70, 0}
manifest.TestDuration = 10 * time.Minute
return runBenchmarkTest(logger, "LargeNetworkBigBlock8MBLatency", manifest)
}
2 changes: 1 addition & 1 deletion test/e2e/testnet/defaults.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ var DefaultResources = Resources{
MemoryRequest: "400Mi",
MemoryLimit: "400Mi",
CPU: "300m",
Volume: "1Gi",
Volume: "0Gi",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The minimum size for a volume is 1Gi.
If you don't want a volume, you should not call AddVolume for that Instance.

}

const (
Expand Down
4 changes: 2 additions & 2 deletions test/e2e/testnet/testnet.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -339,7 +339,7 @@ func (t *Testnet) WaitToSync() error {
if err != nil {
return fmt.Errorf("failed to initialize client for node %s: %w", node.Name, err)
}
for i := 0; i < 10; i++ {
for i := 0; i < 100; i++ {
resp, err := client.Status(context.Background())
if err == nil {
if resp.SyncInfo.LatestBlockHeight > 0 {
Expand All @@ -350,7 +350,7 @@ func (t *Testnet) WaitToSync() error {
} else {
err = errors.New("error getting status")
}
if i == 9 {
if i == 99 {
return fmt.Errorf("failed to start node %s: %w", node.Name, err)
}
log.Info().Str("name", node.Name).Int("attempt", i).Msg(
Expand Down
Loading