MaizeField3D: A Curated 3D Point Cloud Dataset of Field-Grown Plants from a Maize Diversity Panel

Iowa State University

*Equal Contribution
MaizeField3D

Abstract

The development of artificial intelligence (AI) and machine learning (ML) based tools for 3D phenotyping, especially for maize, has been limited due to the lack of large and diverse 3D datasets. 2D image datasets fail to capture essential structural details such as leaf architecture, plant volume, and spatial arrangements that 3D data provide. To address this limitation, we present MaizeField3D, a curated dataset of 3D point clouds of field-grown maize plants from a diverse genetic panel, designed to be AI-ready for advancing agricultural research. Our dataset includes 1,045 high-quality point clouds of field-grown maize collected using a terrestrial laser scanner (TLS). Point clouds of 520 plants from this dataset were segmented and annotated using a graph-based segmentation method to isolate individual leaves and stalks, ensuring consistent labeling across all samples. This labeled data was then used for fitting procedural models that provide a structured parametric representation of the maize plants. The leaves of the maize plants in the procedural models are represented using Non-Uniform Rational B-Spline (NURBS) surfaces that were generated using a two-step optimization process combining gradient-free and gradient-based methods. We conducted rigorous manual quality control on all datasets, correcting errors in segmentation, ensuring accurate leaf ordering, and validating metadata annotations. The dataset also includes metadata detailing plant morphology and quality, alongside multi-resolution subsampled point cloud data (100k, 50k, 10k points), which can be readily used for different downstream computational tasks. MaizeField3D will serve as a comprehensive foundational dataset for AI-driven phenotyping, plant structural analysis, and 3D applications in agricultural research.

Dataset Features

  • 1,045 quality-controlled 3D point clouds of diverse field-grown maize plants.
  • Organ-level annotations with detailed semantic and instance segmentation, enabling precise plant structure analysis.
  • AI-compatible formats, ensuring seamless integration with advanced ML models.
  • Color information, enhancing data interpretability.
  • Procedurally generated maize leaf models, providing a NURBS surface-based representation that is beneficial for downstream tasks.
  • Multiple subsampled versions (100k, 50k, and 10k points per cloud), supporting a range of computational requirements.
Comparison Table

Samples from the Dataset

Sample

Examples of maize plant point clouds from the dataset, showcasing the original data. These images highlight the diverse morphologies of maize plants captured using terrestrial laser scanning.

Sample Gif 1
Sample Gif 2
Sample Gif 3

Examples of segmented maize plant point clouds from the dataset, showcasing the color-coded segmentation data.

Sample Gif 1
Sample Gif 2
Sample Gif 3

Samples plants from the procedurally generated maize leaf models, providing a NURBS surface-based representation that is beneficial for downstream tasks.

Comparison Table

Comparison of histograms showing the mean point to point distances for the dataset downsampled to 100K points, 50K points and 10K points.

Acknowledgements

This work was supported by the AI Research Institutes program [AI Institute: for Resilient Agriculture (AIIRA), Award No.2021-67021-35329]from the National Science Foundation and U.S. Department of Agriculture’s National Institute of Food and Agriculture. We acknowledge support from Iowa State University Plant Science Institute. YL was supported in part by NSF grants (DBI-1661475 and IOS-1842097) to PSS and others and a scholarship from the China Scholarship Council.

Team

BibTeX

@inproceedings{kimara2025agriField3D,
  title={MaizeField3D: A Curated 3D Point Cloud Dataset of Field-Grown Plants from a Maize Diversity Panel}, 
  author={Elvis Kimara1, Mozhgan Hadadi, Jackson Godbersen, Aditya Balu, Talukder Jubery, Yawei Li, Adarsh Krishnamurthy, Patrick Schnable, Baskar Ganapathysubramanian},
  booktitle={Arxiv},
  year={2025},
  primaryClass={cs.CV},
  url={}
}