Repository navigation
BDX-1692: Package the Arrow C++ Parquet SDK as release artifacts - #37
Merged
bodduv merged 2 commits intoOct 15, 2026
Merged
Conversation
Publish org.apache.arrow:arrow-parquet with linux-x86_64, linux-aarch_64, osx-x86_64 and osx-aarch_64 JARs. Each holds the static Arrow C++ Parquet libraries, headers and an arrow-parquet.pc built from the same Arrow C++ revision as the JNI libraries. A smoke test links and runs against every staged package. The Linux and macOS arm64 packages reuse the existing JNI build. The macOS Intel package comes from a Parquet-only job, because the full JNI build exceeds the runner time limit there; it targets macOS 13.0. Download ORC and Thrift sources from archive.apache.org, since Apache mirrors no longer host the pinned versions. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
bodduv
force-pushed
the
codex/BDX-1340-arrow-parquet
branch
from
October 14, 2026 08:46
3dfe794 to
ea11c90
Compare
bodduv
changed the title
bodduv
commented
Oct 14, 2026
lriggs
reviewed
Oct 14, 2026
lriggs
reviewed
Oct 14, 2026
Arrow Java ships no macOS x86_64 JNI libraries, so arrow-parquet follows the same platforms: linux-x86_64, linux-aarch_64 and osx-aarch_64. Remove the Parquet-only Intel job and the Thrift archive URL it needed; keep the ORC archive URL for the JNI builds. Assign pkg-config output before splitting it, so that a pkg-config failure stops the packaging script. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
lriggs
approved these changes
Oct 15, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Publish
org.apache.arrow:arrow-parquetwithlinux-x86_64,linux-aarch_64andosx-aarch_64JARs. Each JAR contains the static Arrow C++ Parquet libraries, headers andlib/pkgconfig/arrow-parquet.pc, built from the same Arrow C++ revision as the JNI libraries. Dremio's Arrow C++ Parquet writer links against these packages (BDX-1692).ci/scripts/arrow_parquet_package.shstages a package from an Arrow C++ installation, then links and runs a Parquet round trip (Snappy, Gzip, Zstd) using only the staged files.jni_full_build.shpackages the three platform JARs, an empty main JAR and a POM. Binaries fails early if a platform package is missing.Existing JARs keep the same entries. No Arrow APIs change.
Validation: JarBuild 38798795766 of the merged commit
d39eb9a, with Arrow C++1835c91, passed every job. Compared withv19.1.0-f211c97-1835c91, releasev19.1.0-d39eb9a-1835c91adds only the 15arrow-parquetfiles, and all 91 existing JARs have identical entry lists. Every package records Arrow C++1835c91and passed the smoke test on its platform.dremio/automation#3792 publishes these artifacts to Nexus.
🤖 Generated with Claude Code | Edited and Verified by @bodduv