Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(featureDev): add two new metrics to track startConversation and createUploadUrl issues #645

Merged
merged 4 commits into from
Dec 12, 2023

Conversation

sannicm
Copy link
Contributor

@sannicm sannicm commented Dec 11, 2023

Problem

The two api operations mentioned do not have a specific metric tracking so they are lost.

Solution

Adding two new metrics to track the api issues and other related to the operations.

License

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@sannicm sannicm requested a review from a team as a code owner December 11, 2023 11:20
{
"name": "amazonq_startConversationInvoke",
"description": "Captures startConversation process",
"metadata": []
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add amazonqConversationId, with flag required: false

@sannicm sannicm force-pushed the sannicm/featureDev/add_metrics branch from 2e62b47 to 831d0ec Compare December 11, 2023 11:32
"name": "amazonq_createUploadUrl",
"description": "Captures createUploadUrl process",
"metadata": [
{ "type": "amazonqConversationId" }
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we also want to capture how long create upload url took?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we? I think that all performance metrics specific to the api are tracked already in the backend operations themselves. toolkit performance metrics should be based in other concepts rather than api latency.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm going to add though repository size for uploadCode though and converastionId in the startConversation (if succeeded)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh whoops, I meant tracking the time on how long it takes to upload the code, not actually how long it takes to create the createUploadUrl. Having the performance metrics on the toolkits telemetry gives us insight onto how long a request takes from a user's perspective which can give us insight if we need to scope down upload size, etc

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not really relevant in the scope of this task though

@nkomonen-amazon
Copy link
Contributor

/retryBuilds

@@ -2771,6 +2771,19 @@
{ "type": "amazonqGenerateApproachLatency" }
]
},
{
"name": "amazonq_startConversationInvoke",
"description": "Captures startConversation process",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the description doesn't tell me anything useful.

how does this differ from amazonq_startChat (which still mentions "/dev", is that correct)?

and the description on amazonq_endChat mentions "end of the conversation".

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This one is specifically related to invoking the api, I will update. It is more evident in this work in progress PR aws/aws-toolkit-vscode#4157

@justinmk3
Copy link
Contributor

please rebase, the failing CI should be fixed by #646

@sannicm sannicm force-pushed the sannicm/featureDev/add_metrics branch from 00581a0 to 015a977 Compare December 12, 2023 09:54
@justinmk3
Copy link
Contributor

/retrybuild

@justinmk3 justinmk3 merged commit ebe8313 into aws:main Dec 12, 2023
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants