[Bug]: constantly get timeout error due to "opy__4.3 && echo 'activate successful' && pip install -e .[test]' returned non-zero exit status 1.\r\n" #2427
Comments
Which commit? |
|
the latest commit for codeact1.3_swebench branch It would happen only when I continue from the previous run. Do you have any idea why when continuing running would cause such a problem? |
|
https://github.com/opendevin/OpenDevin/pkgs/container/eval-swe-bench/216318508?tag=full-v1.0 Same happens in latest version? |
|
yes, I use docker pull ghcr.io/opendevin/eval-swe-bench:full-v1.0 to run. I think it is an instance-specific issue? This woul be triggered specifically to one instance around 170 in swe-agent-lite. |
Seems the code is not present in the latest version. Could you provide the logs for the latest version for scikit? |
|
but I want to reproduce the number in codeact1.3. Shouldn't I use the old version of docker? Is this type of error specifically related to scikit? |
|
I face two types of errors and I am not sure whether it would affect the final performance of opendevin or not. |
|
Here is the detailed log: 05:27:01 - opendevin:INFO: run_infer.py:209 - Starting evaluation for instance pylint-dev__pylint-7993. |
|
Failed to retrieve repository path. Tests may not have passed or output was not as expected.\r\n' and "opy__5.1 && echo 'activate successful' && pip install -e .[test]' returned non-zero exit status 1.\r\n" |
You should. It should be easy to fix if the same happens in the latest version and patching it to 1.3. The newest version should be the priority. Right? |
|
yeah, but I actually do not understand why there will be these errors. Could you provide some insights? I am still not familar with Opendevin and wants to learn more. |
|
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. |
|
Could you connect to that instance via SSH and run that command? |
|
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. |
|
This issue was closed because it has been stalled for over 30 days with no activity. |
Is there an existing issue for the same bug?
Describe the bug
I switched to codeact1.3 and came across the error constantly when running swe-bench:
0%| | 0/120 [00:00<?, ?it/s]13:12:35 - opendevin:INFO: run_infer.py:384 - Using 4 workers for evaluation.
13:12:35 - opendevin:INFO: run_infer.py:387 - Skipping workspace mount: True
13:12:44 - opendevin:INFO: run_infer.py:204 - Starting evaluation for instance scikit-learn__scikit-learn-13142.
LOG: tail -f evaluation/evaluation_outputs/outputs/swe_bench/CodeActAgent/gpt-4o_maxiter_50_N_v1.3/logs/instance_scikit-learn__scikit-learn-13142.log
13:12:44 - opendevin:INFO: run_infer.py:204 - Starting evaluation for instance scikit-learn__scikit-learn-10508.
LOG: tail -f evaluation/evaluation_outputs/outputs/swe_bench/CodeActAgent/gpt-4o_maxiter_50_N_v1.3/logs/instance_scikit-learn__scikit-learn-10508.log
13:12:44 - opendevin:INFO: run_infer.py:204 - Starting evaluation for instance astropy__astropy-12907.
LOG: tail -f evaluation/evaluation_outputs/outputs/swe_bench/CodeActAgent/gpt-4o_maxiter_50_N_v1.3/logs/instance_astropy__astropy-12907.log
13:12:44 - opendevin:INFO: run_infer.py:204 - Starting evaluation for instance scikit-learn__scikit-learn-13779.
LOG: tail -f evaluation/evaluation_outputs/outputs/swe_bench/CodeActAgent/gpt-4o_maxiter_50_N_v1.3/logs/instance_scikit-learn__scikit-learn-13779.log
13:13:47 - opendevin:INFO: run_infer.py:204 - Starting evaluation for instance scikit-learn__scikit-learn-10949.
LOG: tail -f evaluation/evaluation_outputs/outputs/swe_bench/CodeActAgent/gpt-4o_maxiter_50_N_v1.3/logs/instance_scikit-learn__scikit-learn-10949.log
1%|█▎ | 1/120 [01:12<2:23:03, 72.13s/it]ERROR:concurrent.futures:exception calling callback for <Future at 0x18c647010 state=finished raised EOF>
concurrent.futures.process._RemoteTraceback:
"""
Traceback (most recent call last):
File "/Users/haofeiyu/anaconda3/envs/opendevin-3.11/lib/python3.11/concurrent/futures/process.py", line 261, in _process_worker
r = call_item.fn(*call_item.args, **call_item.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/github_repo/OpenDevin/evaluation/swe_bench/run_infer.py", line 220, in process_instance
sandbox = SWEBenchSSHBox.get_box_for_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/github_repo/OpenDevin/evaluation/swe_bench/swe_env_box.py", line 78, in get_box_for_instance
sandbox = cls(
^^^^
File "/Users/haofeiyu/github_repo/OpenDevin/evaluation/swe_bench/swe_env_box.py", line 47, in init
exit_code, output = self.execute('source /swe_util/swe_entry.sh', timeout=1200)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/github_repo/OpenDevin/opendevin/runtime/docker/ssh_box.py", line 376, in execute
success = self.ssh.prompt(timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/Library/Caches/pypoetry/virtualenvs/opendevin-3Pkb7UKZ-py3.11/lib/python3.11/site-packages/pexpect/pxssh.py", line 506, in prompt
i = self.expect([self.PROMPT, TIMEOUT], timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/Library/Caches/pypoetry/virtualenvs/opendevin-3Pkb7UKZ-py3.11/lib/python3.11/site-packages/pexpect/spawnbase.py", line 354, in expect
return self.expect_list(compiled_pattern_list,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/Library/Caches/pypoetry/virtualenvs/opendevin-3Pkb7UKZ-py3.11/lib/python3.11/site-packages/pexpect/spawnbase.py", line 383, in expect_list
return exp.expect_loop(timeout)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/Library/Caches/pypoetry/virtualenvs/opendevin-3Pkb7UKZ-py3.11/lib/python3.11/site-packages/pexpect/expect.py", line 179, in expect_loop
return self.eof(e)
^^^^^^^^^^^
File "/Users/haofeiyu/Library/Caches/pypoetry/virtualenvs/opendevin-3Pkb7UKZ-py3.11/lib/python3.11/site-packages/pexpect/expect.py", line 122, in eof
raise exc
pexpect.exceptions.EOF: End Of File (EOF). Empty string style platform.
<pexpect.pxssh.pxssh object at 0x18bed8910>
command: /usr/bin/ssh
args: [b'/usr/bin/ssh', b'-q', b'-p', b'55378', b'-l', b'root', b'localhost']
buffer (last 100 chars): ''
before (last 100 chars): "opy__4.3 && echo 'activate successful' && pip install -e .[test]' returned non-zero exit status 1.\r\n"
after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True
pid: 39502
child_fd: 34
closed: False
timeout: 120
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None
logfile_read: None
logfile_send: None
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 0.1
delayafterterminate: 0.1
searcher: searcher_re:
0: re.compile('\[PEXPECT\][\$\#] ')
1: TIMEOUT
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/Users/haofeiyu/anaconda3/envs/opendevin-3.11/lib/python3.11/concurrent/futures/_base.py", line 340, in _invoke_callbacks
callback(self)
File "/Users/haofeiyu/github_repo/OpenDevin/evaluation/swe_bench/run_infer.py", line 374, in update_progress
output = future.result()
^^^^^^^^^^^^^^^
File "/Users/haofeiyu/anaconda3/envs/opendevin-3.11/lib/python3.11/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/Users/haofeiyu/anaconda3/envs/opendevin-3.11/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
pexpect.exceptions.EOF: End Of File (EOF). Empty string style platform.
<pexpect.pxssh.pxssh object at 0x18bed8910>
command: /usr/bin/ssh
args: [b'/usr/bin/ssh', b'-q', b'-p', b'55378', b'-l', b'root', b'localhost']
buffer (last 100 chars): ''
before (last 100 chars): "opy__4.3 && echo 'activate successful' && pip install -e .[test]' returned non-zero exit status 1.\r\n"
after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True
pid: 39502
child_fd: 34
closed: False
timeout: 120
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None
logfile_read: None
logfile_send: None
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 0.1
delayafterterminate: 0.1
searcher: searcher_re:
0: re.compile('\[PEXPECT\][\$\#] ')
1: TIMEOUT
I am wondering what is the potential issue that causes
before (last 100 chars): "opy__4.3 && echo 'activate successful' && pip install -e .[test]' returned non-zero exit status 1.\r\n"Additionally, I successfully got an interactive environment by running
poetry run python evaluation/swe_bench/swe_env_box.pyCurrent OpenDevin version
Installation and Configuration
Model and Agent
No response
Operating System
No response
Reproduction Steps
No response
Logs, Errors, Screenshots, and Additional Context
No response
The text was updated successfully, but these errors were encountered: