Skip to content

Regenerate Spark 4.3.0 release notes - #716

Merged
HeartSaVioR merged 1 commit into
apache:asf-sitefrom
HeartSaVioR:spark-release-4.3.0-notes
Nov 4, 2026
Merged

HeartSaVioR merged 1 commit into
apache:asf-sitefrom
HeartSaVioR:spark-release-4.3.0-notes

Conversation

@HeartSaVioR

Copy link
Copy Markdown
Contributor

Rewrites the Spark 4.3.0 release-notes post, reconstructed from the v4.2.0..v4.3.0 commit range and public Apache JIRA metadata. The existing frontmatter is preserved; only the post body changes.

Highlights covered: stateful Real-Time Mode (streaming aggregation, dropDuplicates, transformWithState) built on concurrent stage scheduling and pipelined shuffles, SCD Type 2 in Auto CDC, faster queries on small data, Spark Connect REST endpoints and operation IDs, JSON_TABLE and VARIANT transformation functions, SQL ASOF JOIN, and nanosecond-precision timestamps (preview).

The rendered site/releases/spark-release-4-3-0.html is regenerated with bundle exec jekyll build, and contributor credits are cleaned up (bot accounts and duplicate identities removed).

This pull request and its description were written by Isaac.

@HeartSaVioR

Copy link
Copy Markdown
Contributor Author

@cloud-fan / @HyukjinKwon Would you mind taking a look? Thanks in advance!

@HyukjinKwon HyukjinKwon left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review summary

I checked the release-notes post and the regenerated HTML for consistency. The HTML matches the markdown, and the table-of-contents anchors, including the three "Notable fixes" sections, resolve to their headings. The new intro line saying 4.3.0 starts a quarterly feature-release cadence matches the site's existing versioning policy page, which already names 4.3.0 as the first quarterly feature release. I found no defects. One question about the contributor credits follows.

Findings

0 total: 0 P0, 0 P1, 0 P2, 0 P3.

No findings.

Decision challenges

Credits may list one contributor twice as 'jon-gao-db' and 'Jonathan Gao'

The Credits paragraph (line 312 of the post, mirrored in the rendered HTML) lists both jon-gao-db and Jonathan Gao. The PR description says duplicate identities were removed from this list, and -db handles elsewhere in the list (for example aleksandar-trajkovic-db and daniel-lunin-db) follow the same GitHub-handle pattern. Neither name appears in any earlier release post, so the repository can't tell whether these are one person. Could you check the commit author emails or GitHub accounts behind the two entries? If they are the same contributor, please keep one entry. If they are different people, no change is needed.

Replace the placeholder Spark 4.3.0 release-notes post with the full
release notes, preserving the existing frontmatter, clean up the
contributor credits, and regenerate site/releases/spark-release-4-3-0.html.

Co-authored-by: Isaac <no-reply@databricks.com>
@HeartSaVioR
HeartSaVioR force-pushed the spark-release-4.3.0-notes branch from 8261707 to 5d59fa0 Compare November 4, 2026 02:38
@HeartSaVioR

Copy link
Copy Markdown
Contributor Author

I only made a credit part to try matching more people. Others are the same.

@HeartSaVioR
HeartSaVioR merged commit 7a34b90 into apache:asf-site Nov 4, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants