Skip to content

[core] Fix chain table partition listing under data filters.#7268

Open
JunRuiLee wants to merge 2 commits intoapache:masterfrom
JunRuiLee:fix-chain-table-1
Open

[core] Fix chain table partition listing under data filters.#7268
JunRuiLee wants to merge 2 commits intoapache:masterfrom
JunRuiLee:fix-chain-table-1

Conversation

@JunRuiLee
Copy link
Contributor

Purpose

Fix incorrect results for chain table reads with non‑partition filters.

Expected behavior is that chain reads enumerate partitions using only partition predicates, while non‑partition filters apply only when reading splits within each partition.
The current implementation calls listPartitions() on a scan that already applies data filters, so partition listing gets pruned by non‑partition predicates. This can skip fallback partitions and yield empty or incomplete results.

Tests

  • `SparkChainTableITCase

@JunRuiLee
Copy link
Contributor Author

Hi @Aitozi , could you please help review this PR? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant