Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pin llama-cpp-python<=0.2.75 #23

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

pin llama-cpp-python<=0.2.75 #23

wants to merge 1 commit into from

Conversation

lapp0
Copy link
Owner

@lapp0 lapp0 commented May 27, 2024

No description provided.

@lapp0 lapp0 force-pushed the fix-llmaacpp-tests branch from 7116b94 to 07f98e3 Compare May 27, 2024 09:33
Copy link

github-actions bot commented May 27, 2024

Benchmark Suite Results:

Before [592c884] After [4808dd0] Ratio Benchmark (Parameter)
4.92±0.02s 4.98±0.05s 1.01 bench_numba_compile.NumbaCompileBenchmark.time_compile_numba
5.75±0.05s 5.78±0.03s 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('complex_span_constrained_relation_extraction')
351±1ms 353±1ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('date')
285±2ms 288±2ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('email')
415±4ms 418±4ms 1.01 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('url')
4.18±0.01s 4.20±0.02s 1 bench_json_schema.JsonSchemaBenchmark.time_json_schema_to_fsm('complex_schema')
592M 593M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('complex_span_constrained_relation_extraction')
497M 497M 1 bench_regex_guide.MemoryRegexGuideBenchmark.peakmem_regex_to_guide('simple_phone')
621±2ms 622±4ms 1 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('complex_phone')
243±2ms 244±2ms 1 bench_regex_guide.RegexGuideBenchmark.time_regex_to_guide('ip')

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant