Skip to content

Commit

Permalink
[05/14/24] update Talk2drive
Browse files Browse the repository at this point in the history
  • Loading branch information
cancui19 committed May 14, 2024
1 parent 8e4c68e commit d82b420
Show file tree
Hide file tree
Showing 3 changed files with 9 additions and 7 deletions.
Binary file added images/main.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed images/main_update.png
Binary file not shown.
16 changes: 9 additions & 7 deletions talk2drive.html
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@
<!-- Post -->
<section class="post">
<center>
<h2>Large Language Models for Autonomous Driving: Real-World Experiments<br /></h2>
<h2>Personalized Autonomous Driving with Large Language Models: Field Experiments<br /></h2>
</center>


Expand Down Expand Up @@ -77,16 +77,18 @@ <h4>Can Cui, Zichong Yang, Yupeng Zhou, Yunsheng Ma, Juanwu Lu, Lingxi Li, Yaobi


<hr />
<p><span class="image right"><img src="images/main_update.png" alt="" /></span>Talk2Drive framework
<p><span class="image right"><img src="images/main.png" alt="" /></span>Talk2Drive framework
architecture.
A human's spoken instructions are processed by cloud-based LLMs,
A human's spoken instructions I are processed by cloud-based LLMs,
which synthesize contextual data C from weather, traffic conditions, and local traffic rules
information.
The LLMs generate executable codes P that are communicated to the vehicle's Electronic Control
information, the predefined system messages S and the history interaction H.
The LLMs generate executable language model programs (LMPs) P that are communicated to the
vehicle's Electronic Control
Unit (ECU).
These codes operate the actuation of vehicle controls, ensuring that the human's intent is
These LMPs operate the actuation of vehicle controls, ensuring that the human's intent is
translated into safe
and personalized driving actions. A memory module archives every command I, its resultant codes
and personalized driving actions. A memory module archives every command I, its resultant
programs
P, and
subsequent user feedback F, ensuring continuous refinement of the personalized driving
experience.
Expand Down

0 comments on commit d82b420

Please sign in to comment.