Skip to content

Feat/pandaset support - #3147

Open
SheheryarRamzan wants to merge 4 commits into
open-mmlab:mainfrom
SheheryarRamzan:feat/pandaset-support
Open

SheheryarRamzan wants to merge 4 commits into
open-mmlab:mainfrom
SheheryarRamzan:feat/pandaset-support

Conversation

@SheheryarRamzan

Copy link
Copy Markdown

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.

Motivation

MMDetection3D currently lacks support for the PandaSet dataset, which is a valuable autonomous driving dataset featuring a dual-LiDAR system (Hesai Pandar64 + PandarGT). PandaSet enables cross-dataset generalization testing — evaluating models trained on one dataset (e.g., nuScenes) against data from different LiDAR sensors. This is critical for developing robust LiDAR perception algorithms that generalize beyond their training distribution.

Modification

Adds full PandaSet dataset support for 3D object detection:

  • mmdet3d/datasets/pandaset_dataset.py — PandaSetDataset class with nuScenes 10-class label mapping
  • mmdet3d/datasets/transforms/pandaset_loading.py — LoadPointsFromPandaSet transform (world-to-ego on-the-fly) + NormalizePointsIntensity
  • mmdet3d/evaluation/metrics/pandaset_metric.py — nuScenes-style metric (center-distance AP, mATE, mASE, mAOE, NDS)
  • tools/dataset_converters/pandaset_converter.py — Info pkl generator with dual-LiDAR split
  • tools/convert_pandaset_to_bin_pcd.py — Optional .bin/.pcd pre-conversion tool
  • configs/_base_/datasets/pandaset-3d.py — Base dataset config
  • configs/pointpillars/*pandaset*.py — Evaluation configs for Pandar64 and PandarGT
  • docs/en/advanced_guides/datasets/pandaset.md — Full documentation

Cross-dataset results (nuScenes PointPillars FPN → PandaSet Pandar64):

Metric Value
mAP 0.072
Car AP 0.47
Pedestrian AP 0.21
Car AP (0-25m) 0.72

BC-breaking (Optional)

No. This PR only adds new files and extends __init__.py imports. No existing code is modified in a breaking way.

Use cases (Optional)

1. Cross-dataset generalization testing — Evaluate any nuScenes-trained 3D detector on PandaSet to measure sensor generalization:

python tools/test.py \
    configs/pointpillars/pointpillars_hv_fpn_sbn-all_8xb4-2x_pandaset-eval.py \
    checkpoints/hv_pointpillars_fpn_sbn-all_4x8_2x_nus-3d.pth

2. Dual-LiDAR comparison — Compare model performance on 360 degree spinning LiDAR (Pandar64) vs forward-facing solid-state LiDAR (PandarGT)
3. Distance-based analysis — Built-in distance-bin evaluation (0-25m, 25-50m) shows near-range vs far-range performance automatically

Checklist

  • Code follows existing MMDetection3D style and conventions
  • Unit tests (to be added if requested by maintainers)
  • No impact on downstream projects — purely additive
  • Documentation added at docs/en/advanced_guides/datasets/pandaset.md

Sheheryar Ramzan added 3 commits August 25, 2026 11:07
Add PandaSet dataset integration for cross-dataset evaluation:
- PandaSetDataset class with nuScenes 10-class label mapping
- On-the-fly point cloud loading with world-to-ego transform
- nuScenes-style evaluation metric (center-distance AP, NDS)
- Dataset converter for dual-LiDAR split (Pandar64/PandarGT)
- PointPillars evaluation configs for both sensors
- Pre-conversion tool for .bin/.pcd formats
- Add configs/_base_/datasets/pandaset-3d.py base dataset config
- Add docs/en/advanced_guides/datasets/pandaset.md with full guide
- Fix data_root to use standard data/pandaset/ convention
- Rewrite convert_pandaset_to_bin_pcd.py with argparse (no hardcoded paths)
- Fix docstring example in pandaset_converter.py
@CLAassistant

CLAassistant commented Aug 25, 2026 •

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
1 out of 2 committers have signed the CLA.

✅ SheheryarRamzan
❌ Sheheryar Ramzan


Sheheryar Ramzan seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

@SheheryarRamzan

Copy link
Copy Markdown
Author

minimum_version_cpu fails while installing mmengine@main on Python 3.7.4. Current MMEngine setup.py uses importlib.metadata, which is 3.8+. This is unrelated to the PandaSet changes. Please pin MMEngine or bump the minimum CI Python.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants