Lexer cleanup: Split literal lexing to separate file and simplify `Cursor`.#82757

Closed

Julian-Wollersberger wants to merge 6 commits intorust-lang:masterfrom

Julian-Wollersberger:lexer-cleanup

Commits on Feb 13, 2021

Move lexing of number and string literals into a separate file.
Julian Wollersberger
committed

Commits on Mar 3, 2021

Move the `eat_*_digits()` methods to `literals.rs`.
Julian Wollersberger
committed
Make `advance_token` a freestanding function.
Julian Wollersberger
committed

Commits on Mar 4, 2021

Simplified `cursor.rs` a bit and renamed `first` to `peek` and `eat_while` to `bump_while`.
Julian Wollersberger
committed
Inline some helper functions that are only used once, to lower the number of things I need to keep in my head.
Julian Wollersberger
committed
Address the "Hidden lifetime in path" warning.
Julian Wollersberger
committed