Failed to parse toml with comment and crlf as EOL

[trim21]

How are you running Renovate?

Mend Renovate hosted app on github.com

If you're self-hosting Renovate, tell us what version of Renovate you run.

No response

If you're self-hosting Renovate, select which platform you are using.

None

Was this something which used to work for you, and then stopped?

It used to work, and then stopped

Describe the problem

renovatebot failed to parse valid toml file with comment # ... and use CRLF as EOL

https://github.com/trim21-archive/renovate-bot-bug-toml-crlf/issues/1

upstream issue iarna/iarna-toml#33

Relevant debug logs

Logs

DEBUG: Failed to parse and validate pyproject file
{
  "packageFile": "pyproject.toml"
  "err": {
    "name": "TomlError",
    "fromTOML": true,
    "wrapped": null,
    "line": 17,
    "col": 13,
    "pos": 489,
    "message": "Control characters (codes < 0x1f and 0x7f) are not allowed in comments, use \\u000d instead at row 18, col 14, pos 489:\n17: \r\n18> # dependencie\r\n                 ^\n19: requests = \"^2.23.0\"\r\n\n",
    "stack": "TomlError: Control characters (codes < 0x1f and 0x7f) are not allowed in comments, use \\u000d instead at row 18, col 14, pos 489:\n17: \r\n18> # dependencie\r\n                 ^\n19: requests = \"^2.23.0\"\r\n\n\n    at TOMLParser.errorControlCharIn (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/toml-parser.js:737:25)\n    at TOMLParser.parseComment (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/toml-parser.js:390:22)\n    at TOMLParser.runOne (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/parser.js:64:30)\n    at TOMLParser.parse (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/parser.js:45:22)\n    at Object.parseString [as parse] (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/parse-string.js:13:12)\n    at parsePyProject (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/modules/manager/pep621/utils.ts:116:26)\n    at Object.extractPackageFile (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/modules/manager/pep621/extract.ts:25:29)\n    at extractPackageFile (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/modules/manager/index.ts:67:9)\n    at getManagerPackageFiles (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/extract/manager-files.ts:45:43)\n    at /opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/extract/index.ts:59:28\n    at async Promise.all (index 0)\n    at extractAllDependencies (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/extract/index.ts:56:26)\n    at extract (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/process/extract-update.ts:140:28)\n    at extractDependencies (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/process/index.ts:154:26)\n    at Object.renovateRepository (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/index.ts:61:9)\n    at attributes.repository (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/global/index.ts:184:11)\n    at start (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/global/index.ts:169:7)\n    at /opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/renovate.ts:18:22"
  }
}

DEBUG: Error parsing pyproject.toml file
{
  "err": {
    "name": "TomlError",
    "fromTOML": true,
    "wrapped": null,
    "line": 17,
    "col": 13,
    "pos": 489,
    "message": "Control characters (codes < 0x1f and 0x7f) are not allowed in comments, use \\u000d instead at row 18, col 14, pos 489:\n17: \r\n18> # dependencie\r\n                 ^\n19: requests = \"^2.23.0\"\r\n\n",
    "stack": "TomlError: Control characters (codes < 0x1f and 0x7f) are not allowed in comments, use \\u000d instead at row 18, col 14, pos 489:\n17: \r\n18> # dependencie\r\n                 ^\n19: requests = \"^2.23.0\"\r\n\n\n    at TOMLParser.errorControlCharIn (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/toml-parser.js:737:25)\n    at TOMLParser.parseComment (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/toml-parser.js:390:22)\n    at TOMLParser.runOne (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/parser.js:64:30)\n    at TOMLParser.parse (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/lib/parser.js:45:22)\n    at parseString (/opt/containerbase/tools/renovate/36.24.2/node_modules/@iarna/toml/parse-string.js:13:12)\n    at Object.extractPackageFile (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/modules/manager/poetry/extract.ts:154:26)\n    at extractPackageFile (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/modules/manager/index.ts:67:9)\n    at getManagerPackageFiles (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/extract/manager-files.ts:45:43)\n    at /opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/extract/index.ts:59:28\n    at async Promise.all (index 1)\n    at extractAllDependencies (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/extract/index.ts:56:26)\n    at extract (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/process/extract-update.ts:140:28)\n    at extractDependencies (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/process/index.ts:154:26)\n    at Object.renovateRepository (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/repository/index.ts:61:9)\n    at attributes.repository (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/global/index.ts:184:11)\n    at start (/opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/workers/global/index.ts:169:7)\n    at /opt/containerbase/tools/renovate/36.24.2/node_modules/renovate/lib/renovate.ts:18:22"
  }
  "packageFile": "pyproject.toml"
}

Have you created a minimal reproduction repository?

I have linked to a minimal reproduction in the description above

[trim21]

already fixed since we are using new TOML parser