Skip to content

Fix inconsistent schema projection in ListingTable when file order varies by tracking schema source #16305

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 21 commits into
base: main
Choose a base branch
from
Open

Fix inconsistent schema projection in ListingTable when file order varies by tracking schema source #16305

Changes from all commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
96ea5ef
feat: Enhance schema inference to preserve provided schema in Listing…
kosiew Jun 6, 2025
d5fd7f8
feat: Add SchemaSource enum to track schema origin in ListingTableConfig
kosiew Jun 6, 2025
4512ea7
feat: Add schema_source field to ListingTable to track schema derivation
kosiew Jun 6, 2025
a0ed876
feat: Add tests for schema source tracking in ListingTableConfig
kosiew Jun 6, 2025
82d1bff
feat: Add tests for inferred and specified schema handling for multip…
kosiew Jun 6, 2025
7787863
Merge branch 'main' into list-table-config-file-schema-16270
kosiew Jun 7, 2025
d8d86d8
Fix tests
kosiew Jun 7, 2025
7957b87
refactor: remove PartialEq from SchemaSource enum
kosiew Jun 7, 2025
47514f4
docs: add back parameter description for collect_stats in ListingTable
kosiew Jun 7, 2025
5e3ac75
test: refactor schema creation in tests to use a helper function
kosiew Jun 7, 2025
dd607e4
test: add comprehensive schema source tracking tests and replace over…
kosiew Jun 7, 2025
29fe6e9
refactor: remove outdated comments and consolidate test cases in List…
kosiew Jun 7, 2025
517818b
fix: add PartialEq derivation to SchemaSource enum for comparison sup…
kosiew Jun 7, 2025
feb2f09
fix: update SQL query in tests to reference correct table name t
kosiew Jun 7, 2025
46c2646
refactor: reorganize imports for clarity and consistency in table.rs
kosiew Jun 7, 2025
a69642a
test: add helper functions to generate test file paths for improved f…
kosiew Jun 7, 2025
43c5972
Merge branch 'main' into list-table-config-file-schema-16270
kosiew Jun 7, 2025
890b5e2
refactor: reorganize test imports for improved clarity and consistency
kosiew Jun 7, 2025
712c572
fix clippy errors
kosiew Jun 7, 2025
22d38c0
test: add TODO comment to correct byte size in partition statistics a…
kosiew Jun 7, 2025
a40a448
test: remove TODO comment for byte size correction in partition stati…
kosiew Jun 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading