Code

Lexer improvements#99884

Code

Merged

bors merged 7 commits intorust-lang:masterrust-lang/rust:masterfrom nnethercote:lexer-improvementsnnethercote/rust:lexer-improvementsCopy head branch name to clipboardAug 1, 2022

+128-117

Commits

Commits on Jul 31, 2022

• Improve shebang handling.

  Show description for 5518599
  nnethercote

  committed
  5518599

  Copy full SHA for 5518599

• Remove StringReader::end_src_index.

  Show description for bd23d68
  nnethercote

  committed
  bd23d68

  Copy full SHA for bd23d68

• Inline first_token.

  Show description for b4fdf64
  nnethercote

  committed
  b4fdf64

  Copy full SHA for b4fdf64

• Avoid an unnecessary return.

  nnethercote

  committed
  c01a36d

  Copy full SHA for c01a36d

• Inline TokenStreamBuilder::push.

  Show description for ddf62b5
  nnethercote

  committed
  ddf62b5

  Copy full SHA for ddf62b5

• Add a size assertion for Token.

  nnethercote

  committed
  e6b9fcc

  Copy full SHA for e6b9fcc

• Shrink Token.

  Show description for 99f5c79
  nnethercote

  committed
  99f5c79

  Copy full SHA for 99f5c79