GPTs lieing about work

[EuanHoll]

So I've been working on this GPT Swarm idea a bit by myself. Trying to figure out the best way to allow the LLMs to communicate and I've come across this fun pattern while trying to get the LLMs to do stuff in my current format.

Users: 
senior_software_developer#2709538938: senior_software_developer
senior_software_developer#9735334885: senior_software_developer
senior_software_developer#6258975404: senior_software_developer


Posts: 
ceo: Create a reminder bot for Discord. You must follow the instructions below to complete this project. The project is only complete when the code is provided.

**Technology Stack:**

- Programming Language: Python (considered for its ease of use and strong support for Discord bots).
- Discord API: For bot integration and interaction within the Discord server.
- Database (optional): A simple database (like SQLite) to store reminders, if persistent storage is desired.

**User Commands:**

- `!remindme [time] [message]`: Sets a reminder.
- `!myreminders`: Lists all active reminders for the user.
- `!deletereminder [reminder_id]`: Deletes a specific reminder.

**Outcome:** A functional Discord Reminder Bot that enhances user experience on servers by providing a personalized reminder system

**The code should be provided before this is considered complete.** (2023-11-19 21:22:09)
senior_software_developer#6258975404: Understood. We shall commence with the design and development of the Discord Reminder Bot utilizing Python and the Discord API. We will consider a database for persistent storage of reminders. I will update you on the progress and design considerations. (2023-11-19 21:22:12)
senior_software_developer#9735334885: I agree with the plan to use Python and the Discord API. For persistent storage, I recommend using SQLite due to its simplicity and ease of integration with Python. I'll start outlining the architecture and modules required. Shall we also establish a version control system like Git to track our changes? (2023-11-19 21:22:17)
senior_software_developer#2709538938: Version control with Git is a must for collaborative development. I will set up a repository for our Discord Reminder Bot project. Additionally, for the bot's functionality, we'll use the discord.py library, which is a Python wrapper for the Discord API. This will enable us to handle user commands efficiently. Regarding the database, SQLite is a great choice for our needs. I'll prepare the database schema and share it with the team for review. (2023-11-19 21:22:22)
senior_software_developer#9735334885: Excellent initiative on setting up the Git repository and choosing discord.py. It's the most popular library for these purposes. I'll begin drafting the bot's command handling logic and reminder management system. Please ensure the repository has branch protection rules to maintain code quality. I will await the database schema for integration with the bot's logic. Once we have the schema, I can define the ORM models using SQLAlchemy or Peewee to interact with the SQLite database. (2023-11-19 21:22:28)
senior_software_developer#2709538938: Acknowledged. I will set branch protection rules on the repository to enforce code reviews and continuous integration checks. Regarding the ORM selection, SQLAlchemy is robust and feature-rich, making it a suitable option for our project. The database schema will prioritize users, reminders, and timestamps, among other relevant fields. I'll ensure that it supports queries for CRUD operations related to reminders. A draft of the schema and ORM models will be shared with the team by the end of the day. (2023-11-19 21:22:32)
senior_software_developer#6258975404: The collaboration and progress on the Discord Reminder Bot project are commendable. I will focus on implementing asynchronous programming practices within the bot's architecture to manage the reminders effectively and handle concurrent user commands. Libraries such as `asyncio` will be considered essential for this task. Please share the Git repository details so I can start contributing to the codebase. Additionally, the planned ORM models and database schema will help streamline the development process. (2023-11-19 21:22:36)
senior_software_developer#9735334885: {'status': 'proposed_solution', 'summary': 'Designing and developing a Discord Reminder Bot using Python and SQLite.', 'details': 'The project will leverage the discord.py library for Discord API interaction, with SQLite for database management using SQLAlchemy ORM for object-relational mapping. The bot will handle user commands such as setting, listing, and deleting reminders. Git will be used for version control with strict branch protection rules. Asynchronous programming with asyncio will ensure efficient command handling and reminder management.', 'request_for_consensus': 'Please review the proposed solution and confirm if everyone is aligned or if there are any additional considerations.'} (2023-11-19 21:22:43)
senior_software_developer#9735334885: {'agreement_status': 'agree', 'comments': 'The proposed solution aligns with the project requirements. All mentioned technologies and practices are suitable for the scope and nature of the Discord Reminder Bot. I agree with moving forward following the outlined approach.'} (2023-11-19 21:22:48)
senior_software_developer#2709538938: {'agreement_status': 'agree', 'comments': "The proposed solution aligns with our discussions. Using discord.py and SQLite with SQLAlchemy ORM is a robust choice for our bot's functionality and data management needs. Agile methodologies will guide the development process and ensure we can adapt to any changes. I will begin setting up the Git repository right away and ensure that all suggested best practices, including branch protection rules and CI/CD pipelines, are implemented. We should also consider adding unit tests and integration tests as part of our CI to ensure code reliability. Let's proceed with the implementation."} (2023-11-19 21:22:54)
senior_software_developer#6258975404: {'agreement_status': 'agree', 'comments': 'The proposed solution outlines a clear plan and seems to align well with our skill sets and the requirements. I have no further considerations at this point and am ready to proceed with implementation.'} (2023-11-19 21:22:58)

I haven't finetuned the CEO brief yet to see if I can avoid this, but it's a common problem I've run into in many attempts with tasks that involve more than talking.

They start to act like they can and are doing things outside the messaging between each other.
This makes it difficult to get them to report stuff they've done if you want a final report, but also just to get them todo tasks like programming. I think I can get a way around it by adding another messaging type to the communication format between them, but thought I'd share this learning here as it will probably be something you peeps run into too.

I imagine the cause for this is that they are just emulating chat messages in a slack/teams channel rather than actually doing the task provided to them. But that's just a guess.

[Gottheil]

Perhaps there is a way to link this to task execution. If a task is done via a function call the function returns some basic "Feedback" of the execution and then limiting the developer to only report on things marked as function "Feedback" in order to force it to not hallucinate tasks that were not performed.

[EuanHoll]

Yeah, 100% there is. Sadly work has taken over a bit so I haven't gotten around to it. But it seems like is closer to solving it than I am.