ForestQuery: Boundary-Aware and Spatially Anchored Query Learning for Unified Forest Point Cloud Segmentation

Zhihao Zhan1,2, Le Tao2, Yifei Tian3, Xin Liu4, Jie Yuan1†
1Nanjing University, 2TopXGun Robotics,
3Nanjing University of Posts and Telecommunications, 4Tsinghua University
†Corresponding author

Abstract

Forest point cloud segmentation is fundamental for fine-grained 3D forest scene understanding, yet remains challenging due to irregular tree structures, severe occlusions, density variations, and ambiguous instance boundaries. Recent query-based forest segmentation methods have shown promise for unified semantic and instance prediction, but they still insufficiently exploit forest-specific spatial structure and account for boundary uncertainty. In this paper, we propose ForestQuery, a boundary-aware and spatially anchored query learning framework for unified forest point cloud segmentation. ForestQuery enhances instance and semantic query learning through two complementary designs. Specifically, boundary uncertainty is explicitly modeled to guide reliable instance query construction and modulate query optimization through adaptive loss reweighting. Meanwhile, spatially anchored semantic query enhancement (SA-SQE) introduces learnable 3D anchors encoding forest vertical stratification priors to enrich semantic queries with explicit spatial references. We evaluate ForestQuery on multiple public forest point cloud benchmarks and a self-collected annotated real-world dataset. Extensive experiments demonstrate consistent improvements in both individual-tree segmentation and semantic segmentation across diverse forest scenes.

System Pipeline

ForestQuery pipeline: feature encoding, auxiliary predictions, boundary-guided instance query construction, spatially anchored semantic query enhancement, and unified query decoding.
Overview of the proposed ForestQuery framework. A shared sparse 3D backbone supports boundary-aware instance query construction and joint query decoding. Boundary cues guide instance query construction and optimization, while SA-SQE injects learnable 3D anchors encoding forest vertical stratification priors into semantic queries. The resulting queries are jointly decoded with shared scene features to predict semantic and individual-tree instance masks.

Comparison with State-of-the-Art Methods

Qualitative comparisons on FOR-instanceV2. Click any figure to view it at full resolution.

Qualitative comparison of individual-tree instance segmentation across three FOR-instance V2 forest scenes, with colored circles highlighting local differences.
Individual-tree instance segmentation. Ground points are shown in gray, while different colors denote individual-tree instances. Yellow circles highlight over-segmentation, blue circles indicate undetected trees, and red circles mark points incorrectly assigned from one tree to a neighboring tree.
Qualitative comparison of semantic segmentation across three FOR-instance V2 forest scenes, with colored circles highlighting local differences.
Semantic segmentation. Leaf, wood, and ground points are shown in green, brown, and gray, respectively. Red circles highlight confusion between wood and leaf points, while blue circles indicate tree points incorrectly classified as ground.

BibTeX


@misc{zhan2026forestqueryboundaryawarespatiallyanchored,
      title={ForestQuery: Boundary-Aware and Spatially Anchored Query Learning for Unified Forest Point Cloud Segmentation}, 
      author={Zhihao Zhan and Le Tao and Yifei Tian and Xin Liu and Jie Yuan},
      year={2026},
      eprint={2610.03403},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2610.03403}, 
}