Skip to content

API, Core: Only include required stats fields - #15739

Merged
nastra merged 2 commits into
apache:mainfrom
nastra:content-stats-projection
Mar 23, 2026
Merged

nastra merged 2 commits into
apache:mainfrom
nastra:content-stats-projection

Conversation

@nastra

@nastra nastra commented Mar 23, 2026 •

Copy link
Copy Markdown
Contributor

This keeps only the required field stats for a given column. For example

  • nan_value_count is only needed for Floats/Doubles
  • avg_value_size / max_value_size is only needed for String/Binary
  • null_value_count is only needed for nullable columns

@nastra
nastra force-pushed the content-stats-projection branch 2 times, most recently from eebc259 to afa87da Compare March 23, 2026 15:44
@nastra
nastra force-pushed the content-stats-projection branch 2 times, most recently from 661de51 to cb85b68 Compare March 23, 2026 16:04
@nastra nastra changed the title API, Core: Only project required stats fields API, Core: Only include/project required stats fields Mar 23, 2026
@nastra
nastra force-pushed the content-stats-projection branch from cb85b68 to 5adc22e Compare March 23, 2026 16:14
@nastra
nastra requested a review from danielcweeks March 23, 2026 16:14
@nastra nastra changed the title API, Core: Only include/project required stats fields API, Core: Only include required stats fields Mar 23, 2026
@nastra
nastra merged commit 72b5f8e into apache:main Mar 23, 2026
35 checks passed
@nastra
nastra deleted the content-stats-projection branch March 23, 2026 18:34
manuzhang pushed a commit to manuzhang/iceberg that referenced this pull request Mar 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants