Summary
This paper attempts to address a dilemma in leveraging large-language models (LLMs) for solving complex tasks in a collaborative setting: the question of oft-needed human intervention in the equation. More specifically, the authors have come up with an intuitive and novel cooperative agent framework called role-playing that supports effective task completions by collaboration dialogues between agents (LLMs) without extensive human interventions except at inception. Their framework also offers a scalable way to investigate and refine the collaborative capacities of multi- agent systems and they provide detailed analysis and resolution strategies for challenges that come up in such a to- and-fro LLM-instruction scenario. They evaluate their agents exhaustively with state-of-the-art LLMs like GPT 4 as well as with human intelligence. Moreover, they demonstrate task-specific emergence capabilities of smaller-sized LLMs like Llama using their generated user-instruction datasets for various scenarios and domains.
Contributions:
Datasets/Libraries
1. Their publicly available library provides modular functionality and includes implementations of different agents, examples of well-crafted prompts, and data explorers.
2. Two large conversational, task-oriented, and instruction-following datasets: AI Society and Code.
3. Math and Science dataset (QA) and Misalignment dataset (contains simulations of potential risks of such an
uncontrolled autonomous system)
4. These datasets will help investigate other larger language models, allowing such LLMs to communicate more
effectively with human agents.
Strengths
The proposed method (inception prompting) is intuitive, novel, and well-motivated for a novel collaborative task-solving using LLM-agents.
The paper is mostly easy to follow. For instance, Fig. 2 is pretty detailed when it comes to roles and task assignments.
The supplementary material, appendices, and the libraries provided can be crucial for future works in this direction.
The methods section is scientifically sound with effective strategies being discussed for resolving the unaligned idea flows from a role perspective.
The proposed framework can be used to evaluate collaborative problem-solving in crucial domains like classroom learning and education.
Weaknesses
1. Role/task alignment: For the specific task of building an app for stock trading via analyzing sentiments of certain stocks, it seems that the role assigned to the AI user (stock trader) and the message it generates seems counterintuitive since you wouldn’t generally expect stock traders to know environment variables being the first step towards solving this specific task. Instead, a role (like say tech lead/ tech supervisor) seems more fit for the AI user in that example.
2. Fig. 2 confusion: Fig.2 is a little confusing regarding which agent receives the task-specifier prompt (i.e., at the inception level). If I am reading correctly, the multi-agent scenario seems to include two LLMs, but it is not clear who received the starting ‘task-specifier’ prompt immediately. It’ll perhaps improve the readability if the authors can provide some clarity regarding this either in sec. 3.2 or Fig 2
3. Long-distance memory issues: in section 4.1, the authors provide a set of termination conditions that brute- force the collaborative mutual dialogues between the agents. Is it not entirely clear what exactly the authors mean when they claim 40 to be the max-limit of messages to ensure enough length in the conversation history. Was it chosen purely from a pricing perspective? I think the paper can benefit from having some more analysis from a cost/compute perspective. Also, did the authors come across any cases where the agents tended to effectively forget the previous thread of instruction flow (thus leading to sub-optimized task results) because of long-range memory issues that tend to affect such LLM-based agents?
Questions
(Also suggestions)
1. Sec 3.2 makes note of cases of role-switching being observed between the user and the assistant. Are those cases of LLM hallucination anyway correlated with the framing of the prompt? Does it affect certain tasks more than others or is it observed usually at specific points in the sequence of collaborative dialogues?
2. The authors precisely point out challenges such as instruction repetition, flake replies, and infinite loops of messages with examples in the appendices. However, one way of improving the analysis of the paper would be to have a plot/diagram with more details about the distribution of such cases (frequency, places where they tend to occur in the sequence of dialogues, etc). Also, what methods were used to stop/terminate such cases of looping/role-flipping, was it human intervention or did the authors use flags similar to the task termination conditions?
3. On section 5.2, which explains the methods for evaluating ‘emergence’ capacities in smaller LLMs like Llama, what was the motivation behind the sequence of various domains (math, science etc) being a specific way and not any other? Moreover, Table 1 can also benefit from some clarification about what exactly Model 1 and Model 2 are. Although the authors have pointed to sec 5.1 for the evaluation in sec 5.2, it is unclear which one is Llama variant. Also, there might be a case for further experiments with other relatively smaller-sized instruction-based LLMs like T0 [3], FLAN [2] or InstructGPT [3]
Rating
7: Accept: Technically solid paper, with high impact on at least one sub-area, or moderate-to-high impact on more than one areas, with good-to-excellent evaluation, resources, reproducibility, and no unaddressed ethical considerations.
Confidence
4: You are confident in your assessment, but not absolutely certain. It is unlikely, but not impossible, that you did not understand some parts of the submission or that you are unfamiliar with some pieces of related work.
Limitations
The authors have explicitly mentioned the limitations and have provided reasonable strategies to avoid any harmful (pricing/social or otherwise) consequences of their work. However, the paper might benefit from a cost- compute analysis in generating the collaborative datasets using LLMs, perhaps as a paragraph in the main paper.