-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
test: try enabling Lux tests on Mac #150
Open
avik-pal
wants to merge
6
commits into
main
Choose a base branch
from
ap/test_mac
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
+2
−4
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reactant.jl Benchmarks
Benchmark suite | Current: 2363d60 | Previous: f3c65db | Ratio |
---|---|---|---|
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant |
1496619860 ns |
1458455508 ns |
1.03 |
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Lux |
225987607 ns |
251236706 ns |
0.90 |
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant |
5532761600 ns |
5585368365 ns |
0.99 |
ViT base (256 x 256 x 3 x 32)/forward/CPU/Lux |
21699199959 ns |
18510942516 ns |
1.17 |
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant |
1446634269 ns |
1416635330 ns |
1.02 |
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Lux |
9038526 ns |
8999966.5 ns |
1.00 |
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant |
1639347710.5 ns |
1626174510 ns |
1.01 |
ViT small (256 x 256 x 3 x 4)/forward/CPU/Lux |
2124893554 ns |
2507000840 ns |
0.85 |
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant |
1386584287.5 ns |
1464452980 ns |
0.95 |
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Lux |
92014647.5 ns |
87282999 ns |
1.05 |
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant |
2179545161 ns |
2196952516 ns |
0.99 |
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Lux |
6437323903.5 ns |
5380501243 ns |
1.20 |
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant |
1461561466.5 ns |
1539579056 ns |
0.95 |
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Lux |
7807952 ns |
7997757 ns |
0.98 |
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant |
1466356603.5 ns |
1478484824 ns |
0.99 |
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Lux |
1445358684 ns |
1648231085 ns |
0.88 |
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant |
1520530953 ns |
1433497500 ns |
1.06 |
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Lux |
86485316.5 ns |
79774892 ns |
1.08 |
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant |
1764201461 ns |
1780124071 ns |
0.99 |
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Lux |
2384796693 ns |
2802545314 ns |
0.85 |
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant |
1393429282 ns |
1366374529 ns |
1.02 |
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Lux |
91079816 ns |
87273858 ns |
1.04 |
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant |
2278766978.5 ns |
2290981311 ns |
0.99 |
ViT small (256 x 256 x 3 x 16)/forward/CPU/Lux |
3646917987 ns |
4409558714 ns |
0.83 |
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant |
1380087270 ns |
1481595475 ns |
0.93 |
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Lux |
113673026.5 ns |
117880246.5 ns |
0.96 |
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant |
2997146452 ns |
3059007138 ns |
0.98 |
ViT small (256 x 256 x 3 x 32)/forward/CPU/Lux |
5245479565.5 ns |
8537922961 ns |
0.61 |
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant |
1406323039 ns |
1475455846 ns |
0.95 |
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Lux |
138222163 ns |
137789966 ns |
1.00 |
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant |
3259324662 ns |
3144114552 ns |
1.04 |
ViT base (256 x 256 x 3 x 16)/forward/CPU/Lux |
6413693615.5 ns |
11348055235 ns |
0.57 |
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant |
1463180668 ns |
1431172027 ns |
1.02 |
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Lux |
83510147 ns |
84404630.5 ns |
0.99 |
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant |
1972227939.5 ns |
1904321145.5 ns |
1.04 |
ViT base (256 x 256 x 3 x 4)/forward/CPU/Lux |
2592003490 ns |
2628751204 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
This comment was marked as outdated.
This comment was marked as outdated.
avik-pal
commented
Oct 20, 2024
avik-pal
commented
Oct 20, 2024
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.