Skip to content

Spark 3.5, 4.0, 4.1: Backport RepairTable action (#17622) - #19068

Merged
huaxingao merged 3 commits into
apache:mainfrom
rahulsmahadev:repair-table-backport
Nov 20, 2026
Merged

huaxingao merged 3 commits into
apache:mainfrom
rahulsmahadev:repair-table-backport

Conversation

@rahulsmahadev

Copy link
Copy Markdown
Contributor

This backports the RepairTable Spark action from #17622 to Spark 3.5, 4.0 and 4.1.

The change is the same as the merged Spark 4.2 commit:

  • RepairTableSparkAction, RepairMetrics and ManifestWriterFactory are copied as is, and so are the three test classes.
  • BaseSparkAction, RewriteManifestsSparkAction and SparkActions get the same changes as on Spark 4.2.

For each of Spark 3.5, 4.0 and 4.1, formatting, checkstyle, TestRepairTableAction, TestRepairTableActionEncryption, TestRepairMetrics and TestRewriteManifestsAction pass. Spark 3.5 was checked on Scala 2.12 and 2.13.

This pull request and its description were written by Isaac.

rahulsmahadev and others added 3 commits November 20, 2026 18:55
The new files are copied from Spark 4.2 as is, and the changes to
BaseSparkAction, RewriteManifestsSparkAction and SparkActions are the
same as in the merged Spark 4.2 commit.

Co-authored-by: Isaac <no-reply@databricks.com>
The new files are copied from Spark 4.2 as is, and the changes to
BaseSparkAction, RewriteManifestsSparkAction and SparkActions are the
same as in the merged Spark 4.2 commit.

Co-authored-by: Isaac <no-reply@databricks.com>
The new files are copied from Spark 4.2 as is, and the changes to
BaseSparkAction, RewriteManifestsSparkAction and SparkActions are the
same as in the merged Spark 4.2 commit.

Co-authored-by: Isaac <no-reply@databricks.com>
@rahulsmahadev

Copy link
Copy Markdown
Contributor Author

A note on the last line of the description: Isaac is the internal agent harness I use at work, and Claude is the model.

@github-actions github-actions Bot added the spark label Nov 20, 2026
@huaxingao
huaxingao merged commit 79e42ff into apache:main Nov 20, 2026
35 checks passed
@huaxingao

Copy link
Copy Markdown
Contributor

Thanks @rahulsmahadev for the back-porting PR!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants