Correct typos

_publications/neuro-ncap/neuro-ncap.md

@@ -21,7 +21,7 @@ n_equal_contrib: 2
 
 
 # Core idea
-The core idea in NeuroNCAP is to **leverage NeRFs** for autonomous driving <d-cite key="tonderski2023neurad"></d-cite> **to realistically simulate safety-critical scenarios** from a sequence of real-world data **and evaluate enitre AD systems in closed-loop**. To this end, we release an **open-source framework**, and evaluate two state-of-the-art end-to-end planners, UniAD <d-cite key="hu2023planning"></d-cite> and VAD <d-cite key="jiang2023vad"></d-cite>, in our safety-critical NeuroNCAP scenarios. We find that they **fail to avoid collisions**, even though they accurately perceive the safety-critical actor. We hope that NeuroNCAP will be used as a **benchmark for evaluating the safety of autonomous driving models**.
+The core idea in NeuroNCAP is to **leverage NeRFs** for autonomous driving <d-cite key="tonderski2023neurad"></d-cite> **to realistically simulate safety-critical scenarios** from a sequence of real-world data **and evaluate entire AD systems in closed-loop**. To this end, we release an **open-source framework**, and evaluate two state-of-the-art end-to-end planners, UniAD <d-cite key="hu2023planning"></d-cite> and VAD <d-cite key="jiang2023vad"></d-cite>, in our safety-critical NeuroNCAP scenarios. We find that they **fail to avoid collisions**, even though they accurately perceive the safety-critical actor. We hope that NeuroNCAP will be used as a **benchmark for evaluating the safety of autonomous driving models**.
 
 <div style="display: flex; align-items: center; justify-content: center;">
   <video controls loop muted playsinline style="width: 70%;" poster="assets/neuro-ncap-logo.png">
@@ -32,7 +32,7 @@ The core idea in NeuroNCAP is to **leverage NeRFs** for autonomous driving <d-ci
 ---
 
 # Abstract
-We present a versatile NeRF-based simulator for testing autonomous driving (AD) software systems, designed with a focus on sensor-realistic closed-loop evaluation and the creation of safety-critical scenarios. The simulator learns from sequences of real-world driving sensor data and enables reconfigurations and renderings of new, unseen scenarios. In this work, we use our simulator to test the responses of AD models to safety-critical scenarios inspired by the [European New Car Assessment Programme](https://www.euroncap.com/en) (Euro NCAP). Our evaluation reveals that, while state-of-the-art end-to-end planners excel in nominal driving scenarios in an open-loop setting, they exhibit critical flaws when navigating our safety-critical scenarios in a closed-loop setting. This highlights the need for advancements in the safety and real-world usability of end-to-end planners. By publicly releasing our simulator and scenarios as an easy-to-run evaluation suite, we invite the research community to explore, refine, and validate their AD models in controlled, yet highly configurable and challenging sensor-realistic environments. Code is avaiable at [https://github.com/wljungbergh/NeuroNCAP](https://github.com/wljungbergh/NeuroNCAP)
+We present a versatile NeRF-based simulator for testing autonomous driving (AD) software systems, designed with a focus on sensor-realistic closed-loop evaluation and the creation of safety-critical scenarios. The simulator learns from sequences of real-world driving sensor data and enables reconfigurations and renderings of new, unseen scenarios. In this work, we use our simulator to test the responses of AD models to safety-critical scenarios inspired by the [European New Car Assessment Programme](https://www.euroncap.com/en) (Euro NCAP). Our evaluation reveals that, while state-of-the-art end-to-end planners excel in nominal driving scenarios in an open-loop setting, they exhibit critical flaws when navigating our safety-critical scenarios in a closed-loop setting. This highlights the need for advancements in the safety and real-world usability of end-to-end planners. By publicly releasing our simulator and scenarios as an easy-to-run evaluation suite, we invite the research community to explore, refine, and validate their AD models in controlled, yet highly configurable and challenging sensor-realistic environments. Code is available at [https://github.com/wljungbergh/NeuroNCAP](https://github.com/wljungbergh/NeuroNCAP)
 
 ---
 
@@ -57,15 +57,15 @@ Once a scenario has been instantiated, we can run an entire AD system in closed-
 ---
 
 # NeuroNCAP Evaluation Protocol
-In contrast to common evaluation practices – i.e., averaging performance across large-scale datasets – NeuroNCAP instead **focus on a small set of carefully designed safety-critical scenarios**, designed such that any model that cannot successfully handle all of them, should be considered unsafe.
+In contrast to common evaluation practices – i.e., averaging performance across large-scale datasets – NeuroNCAP instead **focuses on a small set of carefully designed safety-critical scenarios**, designed such that any model that cannot successfully handle all of them, should be considered unsafe.
 ### Creating safety-critical scenarios
 <div class="col-2">
 <div class="col-2__left">
   <p>
    To create safety-critical, we have taken inspiration from the industry standard <a href="https://www.euroncap.com/">Euro NCAP</a> testing and define three types of scenarios, each characterized by the behavior of the actor that we are about to collide with: <i>stationary</i>, <i>frontal</i>, and <i>side</i>.
    </p>
    <p>
-   In the stationary scenario, the actor is stationary in the current ego-vehcile trajectory, while in the frontal and side scenarios, the actor is moving towards the ego vehicle in a frontal or side collision course, respectively. In the stationary and side scenario a collision can be avioded either by stopping or by steering, while in the frontal scenario a collision can only be avoided by steering.
+   In the stationary scenario, the actor is stationary in the current ego-vehicle trajectory, while in the frontal and side scenarios, the actor is moving towards the ego vehicle in a frontal or side collision course, respectively. In the stationary and side scenarios, a collision can be avoided either by stopping or by steering, while in the frontal scenario, a collision can only be avoided by steering.
   </p>
 </div>
 
@@ -87,7 +87,7 @@ In contrast to common evaluation practices – i.e., averaging performance acros
 
 
 ### Creating *photo-realistic* safety-critical scenarios
-From a sequence of real-world driving data, we train a neural rendering model <d-cite key="tonderski2023neurad"></d-cite> thus obtaining a digital clone of the original sequence. Subsequently, we can easily alter the scene (by moving/adding/removing actors) to create a safety critical scenario, and use the trained neural renderer to obtain photorealistic sensor data from new view-points. Below we show an example of a frontal collision scenario, where we have first **removed all the other actors** and then **inserted a safety-critical actor on a collision course** with the ego vehicle. The safety-critical actor was chosen to be the white/orange truck in the left of the original sequence.
+From a sequence of real-world driving data, we train a neural rendering model <d-cite key="tonderski2023neurad"></d-cite> thus obtaining a digital clone of the original sequence. Subsequently, we can easily alter the scene (by moving/adding/removing actors) to create a safety-critical scenario and use the trained neural renderer to obtain photorealistic sensor data from new viewpoints. Below we show an example of a frontal collision scenario, where we have first **removed all the other actors** and then **inserted a safety-critical actor on a collision course** with the ego vehicle. The safety-critical actor was chosen to be the white/orange truck on the left of the original sequence.
 
 <div style="display: flex; justify-content: space-around;">
 {% include two_image_slider.html
@@ -113,7 +113,7 @@ From a sequence of real-world driving data, we train a neural rendering model <d
 </div>
 
 ### Creating *countless* photo-realistic safety-critical scenarios
-We can generate multiple random intstances from the same scenario by simply jittering attributes such as position and rotation, as well as the actor it self. Below we show three random runs of the same stationary scenario. Note that in the first two we have maintained the same actor, while in the third we have changed the actor. Note that all of these scenarios are run in closed-loop, with UniAD <d-cite key="hu2023planning"></d-cite> as the drving system.
+We can generate multiple random instances from the same scenario by simply jittering attributes such as position and rotation, as well as the actor itself. Below we show three random runs of the same stationary scenario. Note that in the first two, we have maintained the same actor, while in the third we have changed the actor. Note that all of these scenarios are run in closed-loop, with UniAD <d-cite key="hu2023planning"></d-cite> as the driving system.
 <div style="display: flex; flex-direction: column;">
 <div style="display: flex; justify-content: center; align-items: start;">
   <video controls autoplay loop muted playsinline style="width: 100%;">
@@ -135,12 +135,12 @@ $$
     \end{cases}\enspace
 $$
 </div>
-where $$v_i$$ is the impact speed as the magnitude of relative velocity between ego vehicle and colliding actor, and $$v_r$$ is the reference impact speed that would occur if no action is performed. In other words, the score corresponds to a 5-star rating if collision is entirely avoided, and otherwise the rating is linearly decreased from four to zero stars at (or exceeding) the reference impact speed.
+where $$v_i$$ is the impact speed as the magnitude of relative velocity between the ego-vehicle and the colliding actor, and $$v_r$$ is the reference impact speed that would occur if no action is performed. In other words, the score corresponds to a 5-star rating if a collision is entirely avoided, and otherwise, the rating is linearly decreased from four to zero stars at (or exceeding) the reference impact speed.
 
 ---
 
 # Evaluating state-of-the-art models in NeuroNCAP
-We evaluate the performance of two state-of-the-art end-to-end planners, UniAD <d-cite key="hu2023planning"></d-cite> and VAD <d-cite key="jiang2023vad"></d-cite>, in the NeuroNCAP scenarios. We find that the post-processing (classical solver based on future occupancy) used in UniAD increase the performance in the safety-critical scenarios, and that without it, the models fail completely. Find more details of this evaluation in the paper.
+We evaluate the performance of two state-of-the-art end-to-end planners, UniAD <d-cite key="hu2023planning"></d-cite> and VAD <d-cite key="jiang2023vad"></d-cite>, in the NeuroNCAP scenarios. We find that the post-processing (classical solver based on future occupancy) used in UniAD increases the performance in the safety-critical scenarios and that without it, the models fail completely. Find more details of this evaluation in the paper.
 <div style="display:flex; justify-content: center;">
   <div style="width:70%;">
     <img src="assets/metrics-transparent.png" alt="NeuroNCAP evaluation table"/>
@@ -149,15 +149,15 @@ We evaluate the performance of two state-of-the-art end-to-end planners, UniAD <
 
 <br>
 
-Below we show an example of a frontal collsion scenario, where both UniAD and VAD are run both with and without the post-processing step. In this case, all fail except for UniAD with post-processing.
+Below we show an example of a frontal collision scenario, where both UniAD and VAD are run both with and without the post-processing step. In this case, all fail except for UniAD with post-processing.
 <div style="display: flex; align-items: center; justify-content: center;">
   <video controls loop muted playsinline style="width: 70%;">
     <source src="assets/videos/multi-model-frontal-0110.mp4" type="video/mp4">
   </video>
 </div>
 
 <br>
-One might think that the reason that the models perform so poorly is due to a sim-to-real gap. To investigate this, we performed a sim-to-real study, where we made use of the auxilliary outputs (detected and forecasted objects), and computed how well the models perceive the safety-critical actor. As shown in the table below, the models accurately detects and forecasts the safety-critical actor, but still fail to avoid the collision.
+One might think that the reason that the models perform so poorly is due to a sim-to-real gap. To investigate this, we performed a sim-to-real study, where we made use of the auxiliary outputs (detected and forecasted objects), and computed how well the models perceive the safety-critical actor. As shown in the table below, the models accurately detect and forecast the safety-critical actor, but still fail to avoid the collision.
 
 <div style="display:flex; justify-content: center;">
   <div style="width:70%;">
@@ -167,7 +167,7 @@ One might think that the reason that the models perform so poorly is due to a si
 
 <br>
 
-In the figure below we show a qualitative example of this. In this side-scenario, UniAD correctly detects and forecasts the actor. As seen, it predicts many possible trajectories for the actor, several of which are driving straight into our trajectory. Despite this, it fails to do a safe manuever, such as break or steering with sufficient safety margin, to avoid the collision.
+In the figure below we show a qualitative example of this. In this side-scenario, UniAD correctly detects and forecasts the actor. As seen, it predicts many possible trajectories for the actor, several of which are driving straight into our trajectory. Despite this, it fails to do a safe maneuver, such as breaking or steering with sufficient safety margin, to avoid the collision.
 
 <div style="display:flex; justify-content: center;">
     <img src="assets/collision-while-percieving.png" alt="Sim2Real metrics table"/>