Skip to content

Spark 3.4, 3.5, 4.1: Fix "AlreadyExistsException: Location already exists" at rewrite_table_path - #15616

Merged
nastra merged 2 commits into
apache:mainfrom
Bhargavkonidena:fix_14859_other_versions
Mar 20, 2026
Merged

nastra merged 2 commits into
apache:mainfrom
Bhargavkonidena:fix_14859_other_versions

Conversation

@Bhargavkonidena

Copy link
Copy Markdown
Contributor

Addresses review comment from @nastra on #14859

@github-actions github-actions Bot added the spark label Mar 13, 2026
@nastra nastra changed the title Port changes of Issue 14850 to other spark versions Spark: Fix "AlreadyExistsException: Location already exists" at rewrite_table_path Mar 13, 2026
rewriteManifests(deltaSnapshots, endMetadata, metaFiles);

// rebuild position delete files
// Use DeleteFileSet to ensure proper equality comparison based on file location, content

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the comment wasn't in the original PR. Let's keep it a clean backport

@nastra nastra changed the title Spark: Fix "AlreadyExistsException: Location already exists" at rewrite_table_path Spark3.4, 3.5, 4.1: Fix "AlreadyExistsException: Location already exists" at rewrite_table_path Mar 13, 2026
Co-authored-by: Eduard Tudenhoefner <etudenhoefner@gmail.com>
@nastra nastra changed the title Spark3.4, 3.5, 4.1: Fix "AlreadyExistsException: Location already exists" at rewrite_table_path Spark 3.4, 3.5, 4.1: Fix "AlreadyExistsException: Location already exists" at rewrite_table_path Mar 19, 2026
@nastra
nastra merged commit 9057bf3 into apache:main Mar 20, 2026
24 checks passed
manuzhang pushed a commit to manuzhang/iceberg that referenced this pull request Mar 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants