[Feature] The multiple partition min-max predicate may lead to regression in partition filter

[Aitozi]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

In #1982 , it introduce the MultiplePartitionPredicate to use the min-max to filter partition. It may lead to regression in partition filter.

We can see the manifest file merge in the picture below. If the delete partition contains the latest partition(compaction) and the historical partition(drop partition), it will lead to a wide range scan for the manifest file, due to the min-max filter not works well

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

• I'm willing to submit a PR!