1.1.0

Major Features

• Added Configuration GUI using Streamlit for easier setup of vendor and settings
• Implemented new Debugging Assistant for ROS 2 network inspection and troubleshooting
• Added support for base_url configuration in OpenAI section to support compatible APIs
• Integrated with rai_state_logs for improved system state monitoring

Improvements

• Converted XML launchfiles to Python for better maintainability
• Updated manipulation demo with Streamlit interface and synchronization improvements
• Improved documentation structure and demo organization
• Implemented second person perspective for identity building
• Added default value for keep_speaker_busy parameter in TTS launchfiles

Bug Fixes

• Fixed empty allowlist behavior in text_hmi (empty allowlist now allows all)
• Fixed wrong argument name and type in priority of task demos
• Fixed various documentation links and references
• Reduced system prompt logging verbosity

Documentation

• Added new debugging assistant documentation
• Updated demo documentation and organization
• Removed external demo repository links from readme
• Added ROSCon 2024 talk reference

Other Changes

• Updated Discord server link
• Added CodeRabbit configuration
• Updated poetry dependencies
• Various code style and license notice formatting improvements

What's Changed

• Talk and community group update by @adamdbrw in #299
• Embodied AI Community Group update by @adamdbrw in #306
• docs: fix link to rosbot-xl python script by @boczekbartek in #305
• chore: coderabbit config by @maciejmajek in #308
• feat: implement configuration gui by @maciejmajek in #304
• docs: update link to roscon2024 talk about rai by @boczekbartek in #310
• Update poetry dependencies by @github-actions in #300
• style: remove additional hash from license notice by @maciejmajek in #311
• fix(text_hmi): empty allowlist == allow all by @maciejmajek in #318
• refactor: add default value for keep_speaker_busy parameter to tts launchfiles by @maciejmajek in #316
• chore: reduce system prompt logging verbosity by @maciejmajek in #315
• build(deps): bump tornado from 6.4.1 to 6.4.2 by @dependabot in #319
• Update poetry dependencies by @github-actions in #321
• feat: implement launchfile for rai_state_logs by @boczekbartek in #322
• fix(demos): wrong argument name and type in priority of task by @boczekbartek in #325
• refactor: xml launchfiles to python by @boczekbartek in #324
• Manipulation demo: Set calibration parameters by @knicked in #330
• feat(manipulation demo): use pretty print of the last message & new system prompt by @maciejmajek in #333
• feat: integrate with rai_state_logs by @boczekbartek in #314
• feat: debugging assistant by @maciejmajek in #326
• feat: allow passing base_url in openai section of config.toml by @maciejmajek in #328
• tests: tool runner by @maciejmajek in #327
• Manipulation demo: Update launching steps by @knicked in #332
• Update poetry dependencies by @github-actions in #329
• chore: Update misleading acronym expansion by @maciejmajek in #342
• docs: update by @maciejmajek in #343
• docs: fix link to agriculture demo by @maciejmajek in #344
• docs: remove demos' repository links from readme by @maciejmajek in #348
• refactor: use second person for identity building by @maciejmajek in #347
• Manipulation demo: Synchronize node launching by @knicked in #341
• Add image display in streamlit tool display by @knicked in #349
• Manipulation demo: Add streamlit interface by @knicked in #337

Full Changelog: 1.0.0...1.1.0

RAI 1.0.0 release

What's Changed

New Features

• Added tools for open-set detection, manipulation, taxi, and agriculture demos
• Enhanced voice-based apps and ROS2 message tools
• Integrated Langfuse for system-wide tracing
• Introduced GenAI URDF parser

Fixes and Improvements

• Various bug fixes in text_hmi, Ros2PubMessageTool, and Turtlebot configuration
• Refactoring for better clarity and modularity (vendor separation, toolset updates)
• Improved task handling, tracing, and documentation

Documentation Updates

• New tutorials and improved docs for ROSbot XL and Turtlebot4
• Added vendor table and demo documentation

Build and CI Updates

• Updated CI setup with self-hosted runners and pre-commit configurations

Chores and Maintenance

• Dependency updates and minor improvements to launch files and extensions

What's Changed

• Update poetry dependencies by @github-actions in #234
• feat: add tool for open-set detection using grounding dino by @rachwalk in #215
• fix(docs and code): text_hmi by @maciejmajek in #238
• docs: improve whoami docs by @boczekbartek in #239
• fix(text_hmi): uids are strings by @boczekbartek in #241
• fix(Ros2PubMessageTool): not all messages has headers + unitest by @boczekbartek in #237
• feat: improve ros2 pub msg tool by @boczekbartek in #242
• build: remove CI on draft PRs by @rachwalk in #244
• fix(hri.launch): use voice_hmi_node instead of hmi_node by @maciejmajek in #246
• feat(rai_tts&rai_hmi): stable elevenlabs voice, reintroduced chunking by @maciejmajek in #247
• refactor: decouple default vendor by @maciejmajek in #248
• feat: Langfuse integration, system-wide tracing configuration (LangSmith&Langfuse) by @maciejmajek in #253
• docs: Added vendor table by @adamdbrw in #255
• refactor: separate files for ToolRunner and artifact handlers by @maciejmajek in #256
• feat: rai_hmi api for universal voice-based apps by @maciejmajek in #257
• feat: insert system prompt when not present by @maciejmajek in #259
• Update poetry dependencies by @github-actions in #254
• feat: genAI urdf parser by @maciejmajek in #260
• CI: update to self-hosted runner by @skrobinho in #245
• feat: taxi demo by @maciejmajek in #250
• chore: add sam2 and change extension name to open_set_vision by @rachwalk in #243
• docs: adapt rosbot-xl docs to adhere to new ros2 action interface by @boczekbartek in #264
• docs&refactor: clarity improvements by @maciejmajek in #267
• CI: pre-commit runner ubuntu image update by @skrobinho in #275
• feat: manipulation toolset by @maciejmajek in #271
• feat: handle background ros2 actions and refactor RaiNodes + integrate w/ open-set vision by @boczekbartek in #273
• bb/refactor/text hmi wide remove legacy by @boczekbartek in #278
• chore: reduce verbosity & feat: enhance typing by @maciejmajek in #282
• fix: adding task to the queue from text hmi by @boczekbartek in #284
• refactor: manipulation toolset by @maciejmajek in #280
• fix: add tracing to the agent in RaiStateBasedLlmNode by @boczekbartek in #288
• feat: add autoware call in taxi-demo by @maciejmajek in #263
• improve RAG formating in streamlit by @boczekbartek in #289
• feat: agriculture demo by @maciejmajek in #285
• docs: add turtlebot4 tutorial by @boczekbartek in #240
• feat/docs: add rosbot xl launchfile and improve demos docs by @boczekbartek in #291
• chore(turtlebot): update links to binaries by @boczekbartek in #294
• chore: add rviz to turtlebot launchfile by @boczekbartek in #293
• docs: release update by @maciejmajek in #283
• fix(turtlebot): vendors config and readme updates by @boczekbartek in #296
• feat: add manipulation demo by @maciejmajek in #295
• feat: manipulation and taxi demo launch files and readme by @maciejmajek in #297

New Contributors

• @skrobinho made their first contribution in #245

Full Changelog: 0.9.0-beta...1.0.0

0.9.0-beta

Summary of changes

This release brings a considerable refactoring effort to the RAI's agent system. RAI architecture now consists of two separate agents:

• HMI agent (for communication, both voice and text)
• RAI agent (for solving tasks/missions)
  The default workflow now is to add a task to the RAI agent via HMI such as text_hmi (streamlit app). The RAI Agent will pick up the task, report feedback on every iteration and return task's report at the very end (success or no).

We have also added a new, refactored version of the voice interface with much better voice detection system. Our ASR now supports (possibly) any recording device (no matter the sampling rate), as well as wake word using OpenWakeWord.

Additionally, other enhancements were introduced:

• RAI What I See (Node for intelligent image capture, based on heuristics (did anything change since the last time?))
• Extended tests
• CI license checking
• NoMaD transformer based navigation system
• Overall docs improvement
• Global configuration file (config.toml) where one can set the default model that will be used across RAI's modules
• Local ASR (Whisper)
• CI has been extended to ROS 2 Humble
• Pydantic V2 compatibility with latest Langchain version

What's Changed

• fix: check status badge by @rachwalk in #173
• hri streaming and led strip publishing by @wsiekierska in #102
• chore: remove use-case specific code by @maciejmajek in #174
• remove build badge until jenkins is setup by @rachwalk in #179
• Implementing license header checking in CI by @john-science in #184
• Update poetry dependencies by @github-actions in #185
• tests: extended coverage by @maciejmajek in #190
• chore(licensechecker.yaml): check license on pr only by @maciejmajek in #193
• ci: add support for running tests on ROS Humble and Jazzy by @maciejmajek in #192
• chore: move rai_grounding_dino to rai_extensions by @maciejmajek in #195
• docs: RAI diagram by @adamdbrw in #197
• feat(rai_cli): improved UX by @maciejmajek in #189
• fix: demo repo dir name by @pijaro in #199
• docs improvements by @adamdbrw in #200
• docs: What is rai by @adamdbrw in #198
• docs: describe development environment setup by @boczekbartek in #201
• chore: remove corrupted file by @maciejmajek in #206
• refactor (human-robot-interface): various enhancements by @maciejmajek in #180
• feat: support multiple shells in the setup script by @rachwalk in #216
• docs(README.md): fix setup section & add informations about global configuration file by @maciejmajek in #210
• Update poetry dependencies by @github-actions in #211
• Refactor of Rosbot XL demo documantation by @wsiekierska in #217
• fix: remove web uri image preprocess test by @maciejmajek in #220
• chore: update tts_clients.py by @eltociear in #221
• chore: fix typos by @maciejmajek in #223
• feat: Add NoMaD extension by @knicked in #218
• refactor: HMI Node by @maciejmajek in #143
• chore: update models' config by @maciejmajek in #226
• docs: update on openVLA by @MagdalenaKotynia in #229
• docs(voice_interface.md): fix typo in docker run command for OpenTTS by @maciejmajek in #222
• chore: Update poetry dependencies (pydantic v2) by @github-actions in #228
• First version of whatisee node by @adamdbrw in #219

New Contributors

Thank you for your contributions!

• @john-science made their first contribution in #184
• @eltociear made their first contribution in #221
• @knicked made their first contribution in #218

Full Changelog: 0.8.1-beta...0.9.0-beta

0.8.1-beta

Changelog

Highlights

• Cleanup and refactors: Various improvements, including the general cleanup, as well as changes to make the project easier to navigate.
• New ROSbot-XL Running Example: Documentation now includes a running example for the ROSbot-XL, enhancing the developer experience. It also describes the usage of simulation binary for faster startup.
• Community and Developer Documentation: The project now features a developer guide, code of conduct, link to a discord server, and community section, improving accessibility and fostering community involvement.
• Automatic Dependency Updates: A new CI workflow has been added to automatically update dependencies using Poetry, ensuring that the project stays up-to-date with the latest dependencies.

What's Changed

• Create pull_request_template.md by @adamdbrw in #137
• docs: add rosbot-xl running example by @maciejmajek in #139
• chore: update rosbot xl example gif by @maciejmajek in #141
• fix: move pr template to lower directory by @maciejmajek in #145
• fix: correct license in pyproject, add description by @rachwalk in #146
• feat(ci): add workflow for automatic dependency updates using poetry by @maciejmajek in #144
• dev docs, community section by @adamdbrw in #147
• chore: add ROS 2 Humble badges by @maciejmajek in #151
• chore: cleanup by @maciejmajek in #149
• fix: removed old reference to husarion_whoami package in README. by @pijaro in #155
• describe usage of rosbot demo with o3de binary by @boczekbartek in #157
• docs: add code of conduct by @rachwalk in #152
• chore: add discord to relevant documentation by @rachwalk in #160
• Update poetry dependencies by @github-actions in #159
• chore: update discord link to permalink by @rachwalk in #161
• docs: developer guide by @maciejmajek in #158

New Contributors

• @pijaro made their first contribution in #155
• @github-actions made their first contribution in #159

Full Changelog: 0.8.0-beta...0.8.1-beta

First beta release

First public release, beta version

Contributors:

@maciejmajek
@boczekbartek
@adamdbrw
@wsiekierska
@rachwalk
@MagdalenaKotynia
@Goldob