Skip to content

Fixes and verification for RFiles located outside of tables directory - #6611

Draft
dlmarion wants to merge 2 commits into
apache:mainfrom
dlmarion:external-file-it
Draft

dlmarion wants to merge 2 commits into
apache:mainfrom
dlmarion:external-file-it

Conversation

@dlmarion

Copy link
Copy Markdown
Contributor

Removed the logic that enforced RFiles were located in paths that contained '/tables//'. Removed getVolume(), getTableId(), and getTabletDir() from ReferencedTabletFile and the parsing of the parts into the FileParts object.

Modified the GarbageCollector such that file candidates were matched by full URI and modified the logic that removed directories as an optimization to also remove RFiles not located in the directory.

Made related changes to volume replacment, table disk usage and scan server references.

Modified existing tests and created a new ExternalTabletFileIT that has coverage for scanning, major compaction and garbage collection.

Assisted-By: OpenAI GPT-6 Luna

Removed the logic that enforced RFiles were located in paths that contained
'/tables/<tableId>/<tabletDir>'. Removed getVolume(), getTableId(), and
getTabletDir() from ReferencedTabletFile and the parsing of the parts into
the FileParts object.

Modified the GarbageCollector such that file candidates were matched by full
URI and modified the logic that removed directories as an optimization to
also remove RFiles not located in the directory.

Made related changes to volume replacment, table disk usage and scan server
references.

Modified existing tests and created a new ExternalTabletFileIT that has
coverage for scanning, major compaction and garbage collection.

Assisted-By: OpenAI GPT-6 Luna
@dlmarion dlmarion added this to the 4.0.0 milestone Oct 23, 2026
@dlmarion dlmarion self-assigned this Oct 23, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant