Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: try enabling Lux tests on Mac #150

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

test: try enabling Lux tests on Mac #150

wants to merge 6 commits into from

Conversation

avik-pal
Copy link
Collaborator

@avik-pal avik-pal commented Oct 3, 2024

No description provided.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reactant.jl Benchmarks

Benchmark suite Current: 2363d60 Previous: f3c65db Ratio
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant 1496619860 ns 1458455508 ns 1.03
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Lux 225987607 ns 251236706 ns 0.90
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant 5532761600 ns 5585368365 ns 0.99
ViT base (256 x 256 x 3 x 32)/forward/CPU/Lux 21699199959 ns 18510942516 ns 1.17
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant 1446634269 ns 1416635330 ns 1.02
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Lux 9038526 ns 8999966.5 ns 1.00
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant 1639347710.5 ns 1626174510 ns 1.01
ViT small (256 x 256 x 3 x 4)/forward/CPU/Lux 2124893554 ns 2507000840 ns 0.85
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant 1386584287.5 ns 1464452980 ns 0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Lux 92014647.5 ns 87282999 ns 1.05
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant 2179545161 ns 2196952516 ns 0.99
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Lux 6437323903.5 ns 5380501243 ns 1.20
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant 1461561466.5 ns 1539579056 ns 0.95
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Lux 7807952 ns 7997757 ns 0.98
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant 1466356603.5 ns 1478484824 ns 0.99
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Lux 1445358684 ns 1648231085 ns 0.88
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant 1520530953 ns 1433497500 ns 1.06
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Lux 86485316.5 ns 79774892 ns 1.08
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant 1764201461 ns 1780124071 ns 0.99
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Lux 2384796693 ns 2802545314 ns 0.85
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant 1393429282 ns 1366374529 ns 1.02
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Lux 91079816 ns 87273858 ns 1.04
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant 2278766978.5 ns 2290981311 ns 0.99
ViT small (256 x 256 x 3 x 16)/forward/CPU/Lux 3646917987 ns 4409558714 ns 0.83
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant 1380087270 ns 1481595475 ns 0.93
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Lux 113673026.5 ns 117880246.5 ns 0.96
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant 2997146452 ns 3059007138 ns 0.98
ViT small (256 x 256 x 3 x 32)/forward/CPU/Lux 5245479565.5 ns 8537922961 ns 0.61
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant 1406323039 ns 1475455846 ns 0.95
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Lux 138222163 ns 137789966 ns 1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant 3259324662 ns 3144114552 ns 1.04
ViT base (256 x 256 x 3 x 16)/forward/CPU/Lux 6413693615.5 ns 11348055235 ns 0.57
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant 1463180668 ns 1431172027 ns 1.02
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Lux 83510147 ns 84404630.5 ns 0.99
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant 1972227939.5 ns 1904321145.5 ns 1.04
ViT base (256 x 256 x 3 x 4)/forward/CPU/Lux 2592003490 ns 2628751204 ns 0.99

This comment was automatically generated by workflow using github-action-benchmark.

This comment was marked as outdated.

test/runtests.jl Outdated Show resolved Hide resolved
test/runtests.jl Outdated Show resolved Hide resolved
test/runtests.jl Outdated Show resolved Hide resolved
avik-pal and others added 2 commits October 20, 2024 14:25
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant