Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(tools): Terminal command returns stdout but not stderr after error detected #4482

Merged
merged 1 commit into from
Mar 16, 2025

Conversation

chezsmithy
Copy link
Contributor

@chezsmithy chezsmithy commented Mar 5, 2025

Description

Fixes #4503

Some terminal commands like running cucumber tests seem to result in an error, but the results are returned to stdout vs stderr. This causes the terminal tool to not see the cucumber failures and is unable to fix the errors automatically.

Checklist

  • The relevant docs, if any, have been updated or created
  • The relevant tests, if any, have been updated or created

Screenshots

[ For visual changes, include screenshots. ]

Testing instructions

Run cucumber tests using javascript command npm run cucumber. The tests fail, and no results are observed in the tools terminal call. When setting a breakpoint stderr is empty but stdout is populated.

Curious if we should somehow concat the results so that the LLM can can see all the terminal content to process it to resolve issues.

Copy link

netlify bot commented Mar 5, 2025

Deploy Preview for continuedev ready!

Name Link
🔨 Latest commit e740278
🔍 Latest deploy log https://app.netlify.com/sites/continuedev/deploys/67c7cec7d0ee0b00081f3af6
😎 Deploy Preview https://deploy-preview-4482--continuedev.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@chezsmithy chezsmithy changed the title fix-stdout-terminal fix(tools): Terminal command returns stdout but not stderr after error detected Mar 5, 2025
@chezsmithy
Copy link
Contributor Author

@sestinj thoughts on this PR? After enabling tools for bedrock noticing it's a pretty significant barrier to tools coding with some of the test frameworks.

@sestinj
Copy link
Contributor

sestinj commented Mar 16, 2025

This is great @chezsmithy , and if you are finding other barriers please let me know. We're starting to focus a lot on tool use

@sestinj sestinj merged commit 81c71d8 into continuedev:main Mar 16, 2025
32 checks passed
@chezsmithy
Copy link
Contributor Author

@sestinj the terminal refactor you are working on should keep this work in place as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Terminal Tool doesn’t include stdout content on error
2 participants