Repository navigation
Regenerate Spark 4.3.0 release notes - #716
Conversation
|
@cloud-fan / @HyukjinKwon Would you mind taking a look? Thanks in advance! |
HyukjinKwon
left a comment
There was a problem hiding this comment.
Review summary
I checked the release-notes post and the regenerated HTML for consistency. The HTML matches the markdown, and the table-of-contents anchors, including the three "Notable fixes" sections, resolve to their headings. The new intro line saying 4.3.0 starts a quarterly feature-release cadence matches the site's existing versioning policy page, which already names 4.3.0 as the first quarterly feature release. I found no defects. One question about the contributor credits follows.
Findings
0 total: 0 P0, 0 P1, 0 P2, 0 P3.
No findings.
Decision challenges
Credits may list one contributor twice as 'jon-gao-db' and 'Jonathan Gao'
The Credits paragraph (line 312 of the post, mirrored in the rendered HTML) lists both jon-gao-db and Jonathan Gao. The PR description says duplicate identities were removed from this list, and -db handles elsewhere in the list (for example aleksandar-trajkovic-db and daniel-lunin-db) follow the same GitHub-handle pattern. Neither name appears in any earlier release post, so the repository can't tell whether these are one person. Could you check the commit author emails or GitHub accounts behind the two entries? If they are the same contributor, please keep one entry. If they are different people, no change is needed.
Replace the placeholder Spark 4.3.0 release-notes post with the full release notes, preserving the existing frontmatter, clean up the contributor credits, and regenerate site/releases/spark-release-4-3-0.html. Co-authored-by: Isaac <no-reply@databricks.com>
8261707 to
5d59fa0
Compare
|
I only made a credit part to try matching more people. Others are the same. |
Rewrites the Spark 4.3.0 release-notes post, reconstructed from the
v4.2.0..v4.3.0commit range and public Apache JIRA metadata. The existing frontmatter is preserved; only the post body changes.Highlights covered: stateful Real-Time Mode (streaming aggregation,
dropDuplicates,transformWithState) built on concurrent stage scheduling and pipelined shuffles, SCD Type 2 in Auto CDC, faster queries on small data, Spark Connect REST endpoints and operation IDs,JSON_TABLEandVARIANTtransformation functions, SQLASOF JOIN, and nanosecond-precision timestamps (preview).The rendered
site/releases/spark-release-4-3-0.htmlis regenerated withbundle exec jekyll build, and contributor credits are cleaned up (bot accounts and duplicate identities removed).This pull request and its description were written by Isaac.