如果有limit的情况下,根据source row count来判断是否一次取数 #96
Assignees
Comments
hn5092
added a commit
that referenced
this issue
Jan 13, 2020
chenzhx
pushed a commit
to chenzhx/spark
that referenced
this issue
Feb 24, 2022
…in parquet ### What changes were proposed in this pull request? Spark should remove check field name when reading/writing parquet files. ### Why are the changes needed? Support spark reading existing parquet files with special chars in column names. ### Does this PR introduce _any_ user-facing change? Such as parquet, user can use spark to read existing files with special chars in column names. And then can use back quote to wrap special column name such as &Kyligence#96;max(t)&Kyligence#96; or use &Kyligence#96;max(t)&Kyligence#96; as &Kyligence#96;max_t&Kyligence#96;, then user can use `max_t`. ### How was this patch tested? Added UT Closes apache#35229 from AngersZhuuuu/SPARK-27442. Authored-by: Angerszhuuuu <[email protected]> Signed-off-by: Wenchen Fan <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
https://github.com/Kyligence/KAP/issues/17384 因为bitmap很大但是行数很少,如果每次还是一个分区一个分区取数很导致查询变慢
The text was updated successfully, but these errors were encountered: