Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

496 general conduct research into detection methods for lane recognition #502

Open
wants to merge 13 commits into
base: main
Choose a base branch
from

Conversation

RoyaLxPole
Copy link
Collaborator

@RoyaLxPole RoyaLxPole commented Nov 13, 2024

Description

A .md file where all research results are summarized to support the decision which model should be implemented for the lane detection
Fixes #496

Type of change

add .md file (research)

Does this PR introduce a breaking change?

e.g. is old functionality not usable anymore

Most important changes

new .md file

Summary by CodeRabbit

  • New Features
    • Introduced an updated document on lane detection models in computer vision, providing in-depth analysis across datasets (TuSimple, CULane, CurveLanes).
    • Highlighted best-performing models with detailed methodologies, advantages, and disadvantages.
    • Added a summary table comparing models based on accuracy, precision, recall, and F1-measure.

Copy link
Contributor

coderabbitai bot commented Nov 13, 2024

Walkthrough

The pull request updates the documentation file lane_detection_research.md, providing a comprehensive overview of lane detection models in computer vision. It includes analyses of three datasets—TuSimple, CULane, and CurveLanes—along with a summary table comparing model performance metrics. The document discusses methodologies, advantages, and disadvantages of the highlighted models, emphasizing the importance of lane detection in real-time applications.

Changes

File Path Change Summary
doc/research/paf24/perception/lane_detection_research.md Updated documentation detailing lane detection models, their methodologies, and performance evaluations across three datasets.

Assessment against linked issues

Objective Addressed Explanation
Conduct research into detection methods for lane recognition (496)

Possibly related PRs

Suggested labels

documentation, general

Suggested reviewers

  • Lukasnol
  • seitzseb

🐇 In the realm of lanes, we hop and we bound,
With models and metrics, new knowledge is found.
From TuSimple to CULane, we gather the facts,
In the dance of detection, our research impacts!
So let’s document well, with precision and care,
For the road ahead beckons, and we’re ready to share! 🌟

Warning

Rate limit exceeded

@RoyaLxPole has exceeded the limit for the number of commits or files that can be reviewed per hour. Please wait 20 minutes and 24 seconds before requesting another review.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

📥 Commits

Reviewing files that changed from the base of the PR and between e83a53b and de012b3.


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

❤️ Share
🪧 Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>, please review it.
    • Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit testing code for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai gather interesting stats about this repository and render them as a table. Additionally, render a pie chart showing the language distribution in the codebase.
    • @coderabbitai read src/utils.ts and generate unit testing code.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.
    • @coderabbitai help me debug CodeRabbit configuration file.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (Invoked using PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger an incremental review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai full review to do a full review from scratch and review all the files again.
  • @coderabbitai summary to regenerate the summary of the PR.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai configuration to show the current CodeRabbit configuration for the repository.
  • @coderabbitai help to get help.

Other keywords and placeholders

  • Add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.
  • Add @coderabbitai summary to generate the high-level summary at a specific location in the PR description.
  • Add @coderabbitai anywhere in the PR title to generate the title automatically.

CodeRabbit Configuration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Outside diff range and nitpick comments (3)
doc/research/paf24/perception/lane_detection_research.md (3)

13-16: Enhance formula explanation section

The reference to evaluation formulas lacks proper explanation. Consider adding:

  1. Brief description of each metric
  2. When/why each metric is important
  3. How these metrics compare to other evaluation methods
🧰 Tools
🪛 LanguageTool

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)


111-115: Standardize performance metrics in summary table

The summary table has inconsistent metric reporting (some models missing Test_Acc). Consider:

  1. Using consistent metrics across all models
  2. Adding a note explaining why certain metrics are unavailable
  3. Adding hyperlinks to the corresponding sections
🧰 Tools
🪛 Markdownlint

115-115: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


75-75: Clean up document formatting

Several formatting issues need attention:

  1. Remove multiple consecutive blank lines (lines 79-80, 98, 108)
  2. Break down long paragraphs (line 75, 119) into smaller, more readable chunks
  3. Ensure consistent spacing around lists

Also, consider adding a comma after "In the following" in line 13 and fix the missing apostrophe in "model's evaluation".

Also applies to: 79-80, 98-98, 108-108, 119-119

🧰 Tools
🪛 Markdownlint

75-75: Expected: 300; Actual: 668
Line length

(MD013, line-length)

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 92b0377 and 353ec70.

⛔ Files ignored due to path filters (4)
  • doc/assets/perception/Comparison_of_CurveLane_Dataset.jpg is excluded by !**/*.jpg
  • doc/assets/perception/Comparison_of_models_CondLSTR(RESNet101).jpg is excluded by !**/*.jpg
  • doc/assets/perception/CondLSTR(RESNet101)_Model_Overview.jpg is excluded by !**/*.jpg
  • doc/assets/perception/Formula_for_Modelevaluation_lane_detection.png is excluded by !**/*.png
📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)

🪛 Markdownlint
doc/research/paf24/perception/lane_detection_research.md

115-115: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


79-79: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


80-80: Expected: 1; Actual: 3
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


98-98: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


108-108: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


75-75: Expected: 300; Actual: 668
Line length

(MD013, line-length)


119-119: Expected: 300; Actual: 415
Line length

(MD013, line-length)


96-96: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)


104-104: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

🔇 Additional comments (1)
doc/research/paf24/perception/lane_detection_research.md (1)

1-128: Overall assessment: Comprehensive research with minor improvements needed

The document provides valuable insights into lane detection models and their performance across different datasets. The structure is logical, and the content is informative. The suggested improvements focus on:

  1. Consistency in navigation and formatting
  2. Robustness of image references
  3. Completeness of technical explanations
  4. Standardization of performance metrics

These changes will enhance the document's maintainability and usefulness as a reference.

🧰 Tools
🪛 LanguageTool

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)

🪛 Markdownlint

115-115: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


79-79: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


80-80: Expected: 1; Actual: 3
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


98-98: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


108-108: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


75-75: Expected: 300; Actual: 668
Line length

(MD013, line-length)


119-119: Expected: 300; Actual: 415
Line length

(MD013, line-length)


96-96: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)


104-104: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

doc/research/paf24/perception/lane_detection_research.md Outdated Show resolved Hide resolved
doc/research/paf24/perception/lane_detection_research.md Outdated Show resolved Hide resolved
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

🧹 Outside diff range and nitpick comments (2)
doc/research/paf24/perception/lane_detection_research.md (2)

13-14: Enhance the evaluation metrics explanation

The document mentions accuracy, precision, recall, and F1-measure but doesn't explain what these metrics mean in the context of lane detection. Consider adding brief descriptions of how each metric relates to lane detection performance.

Add explanations like:

  • Accuracy: Percentage of correctly identified lane pixels
  • Precision: Ratio of correctly identified lane pixels to total predicted lane pixels
  • Recall: Ratio of correctly identified lane pixels to actual lane pixels
  • F1-measure: Harmonic mean of precision and recall

96-107: Improve list formatting consistency

The advantages and disadvantages lists have inconsistent formatting and spacing. Some items have extra blank lines while others don't.

Apply consistent formatting:

  1. Add a blank line before and after each list
  2. Remove extra blank lines between list items
  3. Use consistent capitalization and punctuation for list items
🧰 Tools
🪛 Markdownlint

98-98: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


96-96: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)


104-104: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 353ec70 and 0b59c5f.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~48-~48: Possible missing comma found.
Context: ... Detection on CULane CULane is a large scale challenging dataset for academic resear...

(AI_HYDRA_LEO_MISSING_COMMA)


[grammar] ~123-~123: The past tense and past participle of the verb “to choose” is “chose”. The past participle is “chosen”.
Context: ....org/pdf/2304.13242v2) ## Decision We choosed to implement the CLRerNet-DLA34 and the...

(CHOOSED)

🪛 Markdownlint
doc/research/paf24/perception/lane_detection_research.md

115-115: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


79-79: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


80-80: Expected: 1; Actual: 3
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


98-98: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


108-108: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


125-125: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


75-75: Expected: 300; Actual: 668
Line length

(MD013, line-length)


119-119: Expected: 300; Actual: 415
Line length

(MD013, line-length)


96-96: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)


104-104: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

Comment on lines 121 to 124
## Decision

We choosed to implement the CLRerNet-DLA34 and the CondLSTR(ResNet-101) because they have already implemented code bases to save time.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Enhance the decision section

The decision section would benefit from a more detailed explanation of why these specific models were chosen beyond code availability.

Consider adding:

  1. Performance comparison between the chosen models
  2. Trade-offs considered (accuracy vs. computational requirements)
  3. Implementation complexity assessment
  4. Specific advantages that make these models suitable for your use case
🧰 Tools
🪛 LanguageTool

[grammar] ~123-~123: The past tense and past participle of the verb “to choose” is “chose”. The past participle is “chosen”.
Context: ....org/pdf/2304.13242v2) ## Decision We choosed to implement the CLRerNet-DLA34 and the...

(CHOOSED)

doc/research/paf24/perception/lane_detection_research.md Outdated Show resolved Hide resolved
doc/research/paf24/perception/lane_detection_research.md Outdated Show resolved Hide resolved
Copy link
Collaborator

@seefelke seefelke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Provides a good overview of the selected three detection models. Advantages and disadvantages are clear and the final decision is understandable given the short amount of time we have. The typo mentioned by coderabbit should maybe be fixed.

RoyaLxPole and others added 3 commits November 25, 2024 10:12
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Outside diff range and nitpick comments (2)
doc/research/paf24/perception/lane_detection_research.md (2)

79-80: Fix markdown formatting issues

There are several formatting issues that affect readability:

  1. Remove multiple consecutive blank lines (lines 79-80, 98, 108, 125)
  2. Add blank lines around lists (before line 96 and 104)

Also applies to: 98-98, 108-108, 125-125

🧰 Tools
🪛 Markdownlint (0.35.0)

79-79: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


80-80: Expected: 1; Actual: 3
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


111-115: Clarify missing metrics in comparison table

The table shows "---" for Test_Acc in CLRerNet-DLA34 and CondLSTR entries. If these metrics are unavailable, consider:

  1. Adding a note explaining why these metrics are not available
  2. Using alternative metrics that are available for comparison
🧰 Tools
🪛 Markdownlint (0.35.0)

115-115: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 0b59c5f and 296e29d.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 Markdownlint (0.35.0)
doc/research/paf24/perception/lane_detection_research.md

115-115: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


79-79: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


80-80: Expected: 1; Actual: 3
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


98-98: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


108-108: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


125-125: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


75-75: Expected: 300; Actual: 668
Line length

(MD013, line-length)


119-119: Expected: 300; Actual: 415
Line length

(MD013, line-length)


96-96: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)


104-104: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

🔇 Additional comments (1)
doc/research/paf24/perception/lane_detection_research.md (1)

117-117: Fix inconsistent image path

The image path /doc/assets/perception/Comparison_of_CurveLane_Dataset.jpg uses an absolute path that differs from other image references in the document.

-![Comparison_on_dataset](/doc/assets/perception/Comparison_of_CurveLane_Dataset.jpg)
+![Comparison of models on CurveLane dataset](/assets/perception/Comparison_of_CurveLane_Dataset.jpg)

Comment on lines +121 to +123
## Decision

We chose to implement the CLRerNet-DLA34 and the CondLSTR(ResNet-101) because they have already implemented code bases to save time.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Enhance the decision section with technical justification

The current decision rationale focuses solely on code availability. Consider adding:

  1. Technical comparison between CLRerNet-DLA34 and CondLSTR
  2. How these models align with your specific requirements
  3. Performance trade-offs considered
  4. Resource constraints and deployment considerations

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Outside diff range and nitpick comments (3)
doc/research/paf24/perception/lane_detection_research.md (3)

58-59: Enhance quantitative comparison

While the advantages are well described, consider adding specific performance metrics to support the claim of "improved accuracy". For example, include F1 scores for different scenarios (curves, difficult lighting) to provide concrete evidence of improvement.


118-120: Add implementation details and requirements

Since these models have been selected for implementation, consider adding:

  1. Required dependencies and system requirements
  2. Expected setup and configuration steps
  3. Potential integration challenges
  4. Performance benchmarks on your specific use case

Would you like me to help create a template for documenting these implementation details?


111-111: Fix Markdown formatting issues

Please address the following formatting issues:

  1. Remove trailing space in line 111
  2. Remove extra blank line at 122
  3. Add blank lines around lists at lines 94 and 101

Also applies to: 122-122

🧰 Tools
🪛 Markdownlint (0.35.0)

111-111: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 296e29d and 6e7e011.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 Markdownlint (0.35.0)
doc/research/paf24/perception/lane_detection_research.md

111-111: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


122-122: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


75-75: Expected: 300; Actual: 668
Line length

(MD013, line-length)


115-115: Expected: 300; Actual: 322
Line length

(MD013, line-length)


94-94: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)


101-101: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

🔇 Additional comments (2)
doc/research/paf24/perception/lane_detection_research.md (2)

1-7: LGTM! Well-structured table of contents

The document structure is clear and the navigation links are properly formatted.


113-114: Fix image path format

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Outside diff range and nitpick comments (2)
doc/research/paf24/perception/lane_detection_research.md (2)

3-6: Enhance table of contents with subsections

Consider expanding the table of contents to include subsections for better navigation:

- [Overall](#overall)
- [Lane Detection on TuSimple](#lane-detection-on-tusimple)
- [Lane Detection on CULane](#lane-detection-on-culane)
- [Lane Detection on CurveLanes](#lane-detection-on-curvelanes)
+ [Overall](#overall)
+ [Lane Detection on TuSimple](#lane-detection-on-tusimple)
+   - [SCNN_UNet_Attention_PL Advantages](#scnn_unet_attention_pl-advantages)
+   - [SCNN_UNet_Attention_PL Disadvantages](#scnn_unet_attention_pl-disadvantages)
+ [Lane Detection on CULane](#lane-detection-on-culane)
+   - [CLRerNet-DLA34 Advantages](#clrernet-dla34-advantages)
+   - [CLRerNet-DLA34 Disadvantages](#clrernet-dla34-disadvantages)
+ [Lane Detection on CurveLanes](#lane-detection-on-curvelanes)
+   - [CondLSTR (ResNet-101)](#condlstr-resnet-101)
+ [Summary](#summary)
+ [Decision](#decision)

13-13: Fix grammar and improve readability

Several grammar improvements needed:

- In the following the best perfoming model of the three most common Datasets are presented.
+ In the following, the best-performing model of the three most common datasets is presented.

- The resolution of image is 1280×720.
+ The resolution of the image is 1280×720.

- dataset is divided into 88880 images for training set, 9675 for validation set
+ dataset is divided into 88880 images for the training set, 9675 for the validation set

Also applies to: 20-20, 49-49

🧰 Tools
🪛 LanguageTool

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 6e7e011 and 50c85d5.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)


[uncategorized] ~20-~20: You might be missing the article “the” here.
Context: ...mages on US highways. The resolution of image is 1280×720. The dataset is composed of...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~49-~49: You might be missing the article “the” here.
Context: ...ataset is divided into 88880 images for training set, 9675 for validation set, and 34680...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~49-~49: You might be missing the article “the” here.
Context: ...88880 images for training set, 9675 for validation set, and 34680 for test set. The test s...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~49-~49: You might be missing the article “the” here.
Context: ... 9675 for validation set, and 34680 for test set. The test set is divided into norma...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)

🪛 Markdownlint (0.35.0)
doc/research/paf24/perception/lane_detection_research.md

114-114: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


77-77: Expected: 300; Actual: 321
Line length

(MD013, line-length)


96-96: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

🔇 Additional comments (3)
doc/research/paf24/perception/lane_detection_research.md (3)

116-116: Fix incorrect image path


122-124: Enhance decision section with technical justification


110-114: Complete missing accuracy metrics in summary table

The summary table has missing accuracy values (marked as "---") for CLRerNet-DLA34 and CondLSTR. If these metrics are available in the referenced papers, please include them for a fair comparison.

🧰 Tools
🪛 Markdownlint (0.35.0)

114-114: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Outside diff range and nitpick comments (3)
doc/research/paf24/perception/lane_detection_research.md (3)

3-6: Enhance table of contents for better navigation

Consider expanding the table of contents to include subsections and adding brief descriptions:

- - [Overall](#overall)
- - [Lane Detection on TuSimple](#lane-detection-on-tusimple)
- - [Lane Detection on CULane](#lane-detection-on-culane)
- - [Lane Detection on CurveLanes](#lane-detection-on-curvelanes)
+ - [Overall](#overall)
+   - Introduction to lane detection
+   - Evaluation metrics
+ - [Lane Detection on TuSimple](#lane-detection-on-tusimple)
+   - SCNN_UNet_Attention_PL model analysis
+ - [Lane Detection on CULane](#lane-detection-on-culane)
+   - CLRerNet-DLA34 model analysis
+ - [Lane Detection on CurveLanes](#lane-detection-on-curvelanes)
+   - CondLSTR (ResNet-101) model analysis
+ - [Summary](#summary)
+ - [Decision](#decision)

112-116: Enhance summary table with additional metrics

The summary table could be more informative with additional columns:

  • Model architecture/backbone
  • Inference time/FPS
  • Memory requirements
  • Hardware requirements for training/inference

This would help readers better understand the practical implications of choosing each model.

🧰 Tools
🪛 Markdownlint (0.35.0)

116-116: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


13-13: Fix grammar and improve readability

Apply these corrections:

- The website PapersWithCode [1] gives several benchmarks for different lane detection models. In the following the best perfoming model of the three most common Datasets are presented.
+ The website PapersWithCode [1] provides several benchmarks for different lane detection models. The following sections present the best-performing models from the three most common datasets.

- CULane is a large scale challenging dataset for academic research on traffic lane detection.
+ CULane is a large-scale, challenging dataset for academic research on traffic lane detection.

- The dataset is divided into 88880 images for training set, 9675 for validation set, and 34680 for test set.
+ The dataset is divided into 88,880 images for the training set, 9,675 for the validation set, and 34,680 for the test set.

Also applies to: 50-51

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 50c85d5 and 2fa31df.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~50-~50: Possible missing comma found.
Context: ... Detection on CULane CULane is a large scale challenging dataset for academic resear...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~51-~51: You might be missing the article “the” here.
Context: ...ataset is divided into 88880 images for training set, 9675 for validation set, and 34680...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~51-~51: You might be missing the article “the” here.
Context: ...88880 images for training set, 9675 for validation set, and 34680 for test set. The test s...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~51-~51: You might be missing the article “the” here.
Context: ... 9675 for validation set, and 34680 for test set. The test set is divided into norma...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)

🪛 Markdownlint (0.35.0)
doc/research/paf24/perception/lane_detection_research.md

116-116: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


79-79: Expected: 300; Actual: 321
Line length

(MD013, line-length)


98-98: null
Lists should be surrounded by blank lines

(MD032, blanks-around-lists)

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Outside diff range and nitpick comments (2)
doc/research/paf24/perception/lane_detection_research.md (2)

3-6: Consider adding References to the table of contents

The document includes references at the end, but they're not listed in the table of contents. Consider adding:

 - [Overall](#overall)
 - [Lane Detection on TuSimple](#lane-detection-on-tusimple)
 - [Lane Detection on CULane](#lane-detection-on-culane)
 - [Lane Detection on CurveLanes](#lane-detection-on-curvelanes)
+- [References](#references)

50-51: Enhance readability of CULane dataset description

Consider restructuring the dataset description for better readability:

-CULane is a large scale challenging dataset for academic research on traffic lane detection. It is collected by cameras mounted on six different vehicles driven by different drivers in Beijing. More than 55 hours of videos were collected and 133,235 frames were extracted.
-The dataset is divided into 88880 images for training set, 9675 for validation set, and 34680 for test set. The test set is divided into normal and 8 challenging categories. [4]
+CULane is a large-scale challenging dataset for academic research on traffic lane detection, consisting of:
+- Collection method: Cameras mounted on six different vehicles driven by different drivers in Beijing
+- Total data: Over 55 hours of videos, yielding 133,235 extracted frames
+- Dataset split:
+  - Training set: 88,880 images
+  - Validation set: 9,675 images
+  - Test set: 34,680 images (divided into normal and 8 challenging categories)
+
+[4]
🧰 Tools
🪛 LanguageTool

[uncategorized] ~50-~50: Possible missing comma found.
Context: ... Detection on CULane CULane is a large scale challenging dataset for academic resear...

(AI_HYDRA_LEO_MISSING_COMMA)

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 2fa31df and 8d12f90.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~50-~50: Possible missing comma found.
Context: ... Detection on CULane CULane is a large scale challenging dataset for academic resear...

(AI_HYDRA_LEO_MISSING_COMMA)

🪛 Markdownlint (0.35.0)
doc/research/paf24/perception/lane_detection_research.md

117-117: Expected: 0 or 2; Actual: 1
Trailing spaces

(MD009, no-trailing-spaces)


119-119: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


79-79: Expected: 300; Actual: 321
Line length

(MD013, line-length)

🔇 Additional comments (1)
doc/research/paf24/perception/lane_detection_research.md (1)

126-128: Previous review comment is still applicable

|CondLSTR(ResNet-101)|---|0.9132|0.8580|0.8847|2023|CurveLanes|


![Comparison_on_dataset](/doc/assets/perception/Comparison_of_CurveLane_Dataset.jpg)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue

Fix incorrect image path

The image path uses /doc/assets/ which should be relative to the repository root.

-![Comparison_on_dataset](/doc/assets/perception/Comparison_of_CurveLane_Dataset.jpg)
+![Comparison of models on CurveLane dataset](/assets/perception/Comparison_of_CurveLane_Dataset.jpg)
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
![Comparison_on_dataset](/doc/assets/perception/Comparison_of_CurveLane_Dataset.jpg)
![Comparison of models on CurveLane dataset](/assets/perception/Comparison_of_CurveLane_Dataset.jpg)

doc/research/paf24/perception/lane_detection_research.md Outdated Show resolved Hide resolved
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2

🧹 Outside diff range and nitpick comments (4)
doc/research/paf24/perception/lane_detection_research.md (4)

10-11: Enhance the introduction with specific technical challenges

Consider expanding the introduction to include specific technical challenges in lane detection, such as:

  • Varying road conditions (wet roads, faded markings)
  • Environmental factors (shadows, glare, night conditions)
  • Complex scenarios (intersections, merging lanes)
  • Real-time processing requirements

22-34: Add quantitative performance metrics for pre-training stage

The description of the two-stage training process would benefit from specific metrics showing the improvement gained from the pre-training stage. Consider adding:

  • Pre-training convergence metrics
  • Performance comparison with and without pre-training
  • Resource requirements and training time

64-66: Elaborate on the performance gap analysis

The mention of the performance gap (81.43% vs 98.47%) would be more insightful with:

  • Analysis of factors contributing to this gap
  • Potential approaches to bridge this gap
  • Impact of this gap on real-world applications

107-109: Add real-world performance metrics

The computational complexity concern would be more actionable with specific metrics:

  • Inference time on standard hardware
  • Memory requirements
  • Minimum hardware specifications for real-time operation
📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between 8d12f90 and e83a53b.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~20-~20: You might be missing the article “the” here.
Context: ...mages on US highways. The resolution of image is 1280×720. The dataset is composed of...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~51-~51: You might be missing the article “the” here.
Context: ...ataset is divided into 88880 images for training set, 9675 for validation set, and 34680...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~51-~51: You might be missing the article “the” here.
Context: ...88880 images for training set, 9675 for validation set, and 34680 for test set. The test s...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)


[uncategorized] ~51-~51: You might be missing the article “the” here.
Context: ... 9675 for validation set, and 34680 for test set. The test set is divided into norma...

(AI_EN_LECTOR_MISSING_DETERMINER_THE)

🪛 Markdownlint (0.35.0)
doc/research/paf24/perception/lane_detection_research.md

119-119: Expected: 1; Actual: 2
Multiple consecutive blank lines

(MD012, no-multiple-blanks)


79-79: Expected: 300; Actual: 321
Line length

(MD013, line-length)

Comment on lines +113 to +117
| Model | Test Acc (%) | Precision | Recall | F1-Measure | Release | Dataset |
|--------|-------------|-----------|---------|------------|---------|----------|
| SCNN_UNet_Attention_PL | 98.36 | 0.937 | 0.911 | 0.924 | 2022 | TuSimple |
| CLRerNet-DLA34 | N/A | 0.917 | 0.818 | 0.814 | 2023 | CULane |
| CondLSTR(ResNet-101) | N/A | 0.913 | 0.858 | 0.885 | 2023 | CurveLanes |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Explain missing test accuracy values

The summary table shows "N/A" for test accuracy of CLRerNet-DLA34 and CondLSTR. Please:

  • Explain why these values are not available
  • Provide alternative metrics if test accuracy cannot be measured
  • Consider using different evaluation metrics that are available across all models

Comment on lines +122 to +124
It should be mentioned that the paper by Robin Karlsson et. al was also read, but it was not worth comparing it here as it was a selfsupervised learning model and was not trained on the above datasets but on a smaller dataset and used more sensors and cameras
(6 cameras, 5 radars and 1 lidar) than allowed in the Qualify.
But for interrested people you can find the paper [here](https://arxiv.org/pdf/2304.13242v2)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

Improve clarity of excluded research

The explanation for excluding Robin Karlsson's paper needs restructuring:

-It should be mentioned that the paper by Robin Karlsson et. al was also read, but it was not worth comparing it here as it was a selfsupervised learning model and was not trained on the above datasets but on a smaller dataset and used more sensors and cameras
-(6 cameras, 5 radars and 1 lidar) than allowed in the Qualify.
+The self-supervised learning model proposed by Karlsson et al. was excluded from comparison because:
+1. It uses a different training approach (self-supervised learning)
+2. It was trained on a smaller, incomparable dataset
+3. Its hardware requirements (6 cameras, 5 radars, and 1 lidar) exceed the project constraints
📝 Committable suggestion

‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

Suggested change
It should be mentioned that the paper by Robin Karlsson et. al was also read, but it was not worth comparing it here as it was a selfsupervised learning model and was not trained on the above datasets but on a smaller dataset and used more sensors and cameras
(6 cameras, 5 radars and 1 lidar) than allowed in the Qualify.
But for interrested people you can find the paper [here](https://arxiv.org/pdf/2304.13242v2)
The self-supervised learning model proposed by Karlsson et al. was excluded from comparison because:
1. It uses a different training approach (self-supervised learning)
2. It was trained on a smaller, incomparable dataset
3. Its hardware requirements (6 cameras, 5 radars, and 1 lidar) exceed the project constraints
But for interrested people you can find the paper [here](https://arxiv.org/pdf/2304.13242v2)

Copy link
Contributor

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 0

🧹 Outside diff range and nitpick comments (3)
doc/research/paf24/perception/lane_detection_research.md (3)

13-14: Improve grammar and clarity in the introduction

The text needs better punctuation and more precise wording:

-The website PapersWithCode [1] gives several benchmarks for different lane detection models. In the following the best perfoming model of the three most common Datasets are presented. The models evaluation is based on the calculation of accuracy, precision, Recall, and F1-measure.
+The website PapersWithCode [1] provides benchmarks for various lane detection models. In the following section, the best-performing models from the three most common datasets are presented. The models' evaluation is based on accuracy, precision, recall, and F1-measure calculations.
🧰 Tools
🪛 LanguageTool

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)


55-57: Enhance CLRerNet-DLA34 technical description

The CLRerNet-DLA34 section would benefit from more technical details, similar to the comprehensive coverage provided for CondLSTR. Consider adding:

  1. A diagram or visual representation of the architecture
  2. Detailed explanation of the row-based lane representation approach
  3. Technical specifications of the DLA34 backbone
  4. Performance metrics under different conditions

128-128: Add implementation considerations section

Consider adding a new section after the decision that discusses:

  1. Hardware requirements for each model
  2. Real-time performance expectations
  3. Integration challenges and solutions
  4. Required preprocessing steps
  5. Potential optimization strategies

This would help future implementers understand the practical aspects of deploying these models.

📜 Review details

Configuration used: CodeRabbit UI
Review profile: CHILL

📥 Commits

Reviewing files that changed from the base of the PR and between e83a53b and de012b3.

📒 Files selected for processing (1)
  • doc/research/paf24/perception/lane_detection_research.md (1 hunks)
🧰 Additional context used
🪛 LanguageTool
doc/research/paf24/perception/lane_detection_research.md

[uncategorized] ~13-~13: Possible missing comma found.
Context: ...different lane detection models. In the following the best perfoming model of the three m...

(AI_HYDRA_LEO_MISSING_COMMA)


[uncategorized] ~13-~13: It seems likely that a singular genitive (’s) apostrophe is missing.
Context: ...most common Datasets are presented. The models evaluation is based on the calculation ...

(AI_HYDRA_LEO_APOSTROPHE_S_XS)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[General]: Conduct research into detection methods for lane recognition
2 participants