Skip to content

Add Pheno4D point cloud segmentation dataset - #62

Merged
js2552 merged 4 commits into
mainfrom
feature/point_cloud_datasets
Sep 12, 2026
Merged

js2552 merged 4 commits into
mainfrom
feature/point_cloud_datasets

Conversation

@bharathsri272

@bharathsri272 bharathsri272 commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Adds Pheno4D point cloud segmentation dataset

First point cloud dataset added to AgML. Live on Hugging Face: https://huggingface.co/datasets/Project-AgML/pheno4d_point_cloud_segmentation (126 labeled scans, maize + tomato).

What's in this PR

  • New entry in static/data/hf_datasets.json
  • A sample preview image (3D scatter plot colored by segmentation label, generated from real data, since standard image-based sample rendering doesn't apply here)

Note on loader compatibility

This dataset's mask/mask_2 columns are Array2D (variable-length numeric arrays), not the Image() type HuggingFaceDataLoader currently expects for segmentation. So while this entry renders correctly on the site (using the closest valid enum values: machine_learning_task: semantic_segmentation, annotation_format: segmentationMask), the dataset likely won't load correctly through the existing loader without changes there. So it would need a new loader path.

@bharathsri272 bharathsri272 self-assigned this Sep 9, 2026
Follows the EmbeddingPlot3D pattern (react-plotly.js, scatter3d),
adapted for raw point coordinates colored by mask value instead of
embedding-space coordinates colored by class. Wired into the Sample
image section rather than the benchmark/embeddings view, since that
pipeline is built for UMAP embeddings and doesn't apply to point
cloud data. Tested locally against the live Pheno4D dataset card.
Supports datasets covering multiple species (e.g. Pheno4D's maize and
tomato) by restructuring the sample file into named per-crop entries
instead of one flat points array. A selector toggle (mirroring the
existing 2D/3D embedding toggle pattern) appears when more than one
crop is present. Camera resets on crop switch.

Sample data updated with real maize (M01_0313_a) and tomato
(T01_0305_a) scans, both dual and single label schemes preserved.
@bharathsri272
bharathsri272 requested a review from js2552 September 9, 2026 23:27
@js2552
js2552 merged commit 2eddc78 into main Sep 12, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants