Skip to content

[parquet] Support boolean predicate push down for parquet - #8971

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/parquet-bool-pushdown
Open

[parquet] Support boolean predicate push down for parquet#8971
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/parquet-bool-pushdown

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • ParquetFilters drops any predicate on boolean column. toParquetObject does not have bool conversion logic, the conversion throws an error and silently drops the filter. (hence pushdown of bool filter dos not work)
  • Convert Boolean literals so equality, inequality, and IN predicates on boolean columns push down to parquet.

Tests

  • UT

@JingsongLi JingsongLi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi

Copy link
Copy Markdown
Contributor

Please resolve conflicts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants