Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Implement Camera-LiDAR Pipeline #43

Open
4 tasks
Ulixes-8 opened this issue Mar 3, 2025 · 0 comments
Open
4 tasks

[Feature] Implement Camera-LiDAR Pipeline #43

Ulixes-8 opened this issue Mar 3, 2025 · 0 comments

Comments

@Ulixes-8
Copy link

Ulixes-8 commented Mar 3, 2025

Description

The Camera-LiDAR pipeline fuses data from LiDAR and the six AV cameras, which are merged in a later pipeline with 3D object detections to perform multi-object tracking. The pipeline includes camera-based 2D object detection, LiDAR clustering, and ROI camera-LiDAR cluster fusion.

Checklist
Write a launch file that successfully launches:

  • Camera-based 2D object detection module.
  • The LiDAR pipeline.
  • The occupancy grid map pipeline.
  • ROI cluster fusion module.

Acceptance Criteria

As confirmed by testing:

  • The camera-based 2D object detection module takes in image messages from the 6 AV cameras and returns DetectedObjectsWithFeatures (ROIs).
  • LiDAR clustering module takes in PointCloud2 messages and returns a cluster point cloud in the form of DetectedObjectsWithFeatures.
  • ROI cluster fusion module takes in the ROIs from the camera-based 2D detector and the cluster point cloud from the LiDAR clustering module, as well as camera information, to output the final labeled cluster point cloud as DetectedObjectsWithFeatures.

Priority
High (3/3)

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant