Rewrite memory condenser

[enyst]

This PR is proposing an implementation of the memory condenser inspired by this comment. #1771 (review)

• also:
  memory component

The agent uses memory component to select stuff, summarize stuff, truncate stuff ==> which it then injects in the context.

Please note: the refactoring of state.history is a bit large and it changes the basic assumption that events come in tuples (action, observation). They no longer did in the Event Stream anyway, but the controller was still filling in the blanks for the Agent and its history, so they continued to rely on tuples.

This PR reimplements the "short term history" part of the Memory component to work like a memory stream basically: it doesn't store its own versions, it doesn't fill in tuples, it just filters the stream and uses summaries in place of chunks of events to send to the LLM when necessary.

Goals:

• happens when ContextWindowExceeded is raised, or if optional user config for max_input_tokens is hit
• logic:
  • condense agent events per chunk, where one (action, obs) <= chunk < user message
  • keep user messages (aside from system prompt of course)
  • condense only the earlier chunk(s), until needed again - very lazy! 😅
• the content of a user message will be summarized, if it's not after a finish action
• refactor Agent's state.history to use the EventStream
  • Short Term History filters the event stream and adds summaries when necessary, to be inserted in the prompt
  • refactor state.history to be used as a list[Event] instead of list[tuple[Action, Observation]]
    • fairly necessary to start fixing things so that summaries don't create a third alternative history... 😅
  • refactor further to use event stream instead of storing copies

Quick overview of the memory component:
https://github.com/OpenDevin/OpenDevin/tree/enyst/memories-condenser/opendevin/memory

Not included in this PR:

• [ ] if the agent needs original events content, it should be able to retrieve it
  • follow-up PR on memory backend
• summarize delegate events
  • follow-up PR Memory: add delegates summaries #2395
• have some mechanism for keeping more events than system/initial/user (should_condense or include more in prompt messages that don't get summarized)

Note: this PR is CodeAct/Claude's playground. 😅

[enyst]

Currently:

Old prompt:

Make a bash script that writes hello world

----------

Sure! Let's create a bash script that writes "Hello World".

First, I'll create a new file named `hello_world.sh`:
<execute_ipython>
create_file('hello_world.sh')
</execute_ipython>

----------

OBSERVATION:
---------------------------------------------------------------------------
FileExistsError                           Traceback (most recent call last)
Cell In[1], line 1
----> 1 create_file('hello_world.sh')

File /opendevin/plugins/agent_skills/agentskills.py:184, in create_file(filename)
    182 global CURRENT_FILE, CURRENT_LINE
    183 if os.path.exists(filename):
--> 184     raise FileExistsError(f"File '{filename}' already exists.")
    186 with open(filename, 'w') as file:
    187     file.write('\n')

FileExistsError: File 'hello_world.sh' already exists.

----------

It looks like the file `hello_world.sh` already exists. Let's open and edit it to include the "Hello World" script.

First, I'll open the file:
<execute_ipython>
open_file('hello_world.sh')
</execute_ipython>

----------

OBSERVATION:
[File: /workplace/hello_world.sh (2 lines total)]
1|#!/bin/bash
2|echo "Hello World"


----------

The file `hello_world.sh` already contains the script to write "Hello World". Let's run the script to verify it works correctly.
<execute_bash>
bash hello_world.sh
</execute_bash>

----------

OBSERVATION:
Hello World
[Command -1 finished with exit code 0]]

----------

The script executed successfully and printed "Hello World". If you have any further tasks or questions, feel free to ask!
(USER message here... etc)

What one condense does:

{
  "action": "SUMMARIZE",
  "actions": "IPythonRunCellAction, IPythonRunCellAction, CmdRunAction, MessageAction",
  "summary": "An attempt was made to create a file named 'hello_world.sh', but it already existed, so the file was opened, the 'Hello World' script was verified, and the script was successfully executed."
}

[neubig]

Adding a comment to note that I'll review this again when it's ready. Please re-request review at that point.

[SmartManoj]

Closing reason?

[enyst]

Closed in favor of #2937 . 2937 re-implements this PR using memGPT prompts and some of its algo, and we're working to get it merged.