Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEAT]: implement real speculative decoding(SD) and multi-step reasoning(MS) #12

Open
Monstertail opened this issue Jun 24, 2024 · 0 comments
Open

[FEAT]: implement real speculative decoding(SD) and multi-step reasoning(MS) #12

Monstertail opened this issue Jun 24, 2024 · 0 comments
Labels
enhancement New feature or request priority-1 priority of the issue
Milestone
NIPs rebuttal

Comments

@Monstertail
Copy link
Collaborator

Monstertail commented Jun 24, 2024 •
edited
Loading

Description

We simulate SD and MS in deft paper v2. I think we should support real SD and MS for rebuttal. @chiakicage @tlin-taolin what do you think?

Additional Information

No response
@Monstertail Monstertail added enhancement New feature or request priority-1 priority of the issue labels Jun 24, 2024
@Monstertail Monstertail changed the title [FEAT]: implement real speculative decodinmG(SD) and multi-step reasoning(MS) [FEAT]: implement real speculative decoding(SD) and multi-step reasoning(MS) Jun 30, 2024
@Monstertail Monstertail added this to the NIPs rebuttal milestone Jun 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request priority-1 priority of the issue
Projects
None yet
Milestone
NIPs rebuttal
Development

No branches or pull requests
1 participant
@Monstertail