-
Notifications
You must be signed in to change notification settings - Fork 306
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[MLOB-1524] feat(llmobs): Introduce LLM Observability SDK #4742
Commits on Sep 18, 2024
-
[MLOB-1540] add llmobs configuration to global tracer config (#4696)
add llmobs config
Configuration menu - View commit details
-
Copy full SHA for 54c8eec - Browse repository at this point
Copy the full SHA 54c8eecView commit details
Commits on Sep 25, 2024
-
[MLOB-1555] LLM Observability writers (#4699)
LLM Observability writers
Configuration menu - View commit details
-
Copy full SHA for 5b215f6 - Browse repository at this point
Copy the full SHA 5b215f6View commit details
Commits on Sep 26, 2024
-
[MLOB-1556] LLM Observability tagger (#4718)
LLM Observability tagger
Configuration menu - View commit details
-
Copy full SHA for feeeb89 - Browse repository at this point
Copy the full SHA feeeb89View commit details -
Merge branch 'master' of github.com:DataDog/dd-trace-js into sabrenne…
…r/llmobs-sdk-release
Configuration menu - View commit details
-
Copy full SHA for bddfa3d - Browse repository at this point
Copy the full SHA bddfa3dView commit details
Commits on Oct 9, 2024
-
[MLOB-1560] LLMObs Span Processor (#4738)
* span processor * tests * remove agent exporter log and do not stringify tags * remove llmobs from exporter tests * add in default unserializable value * review comments * warning log for metric * todo-ify * remove some duplicate logic * decouple llmobs span processing with a channel * use a static weakmap to store llmobs tags/annotations instead of span tags * do not register span in map if it does not have an llmobs span kind * span is passed on an object from sp publisher * re-clarify TODOs * only send span in publish * log multiple warnings and return conditional undefined * update error logic
Configuration menu - View commit details
-
Copy full SHA for 38225ed - Browse repository at this point
Copy the full SHA 38225edView commit details
Commits on Oct 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 7ba7ab8 - Browse repository at this point
Copy the full SHA 7ba7ab8View commit details -
Configuration menu - View commit details
-
Copy full SHA for b6452ad - Browse repository at this point
Copy the full SHA b6452adView commit details
Commits on Oct 24, 2024
-
[MLOB-1561] LLM Observability SDK API (#4773)
* wip * type definitions * active + try/catch eval metric writer append * test ts * use tagger map and processor as a channel subscriber * change decorate and add in dev changes * try some api changes * add decorate to noop * fix breaking proxy tests * experimental decorators for TS docs * api changes, fix unit + e2e tests * try removing global log mocks * add some util tests * remove logger mocks * add module tests + do not enable when not specified * fix eval metric integration test * wip * memoize getFunctionArguments * move any subscriber and global writer to the module enablement level instead of sdk * should fix TS tests * add ts integration test and fix decorator * devex for ts versions * add noop typescript test * remove startSpan * remove unneeded change * dedup decorator code * Update index.d.ts Co-authored-by: Yun Kim <35776586+Yun-Kim@users.noreply.github.com> * map metrics names * change validKind to validateKind and throw * tagger for metrics follow-up * review feedback * add some tests for not auto-annotating in certain cases --------- Co-authored-by: Yun Kim <35776586+Yun-Kim@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 7e8e0f7 - Browse repository at this point
Copy the full SHA 7e8e0f7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4370228 - Browse repository at this point
Copy the full SHA 4370228View commit details -
Configuration menu - View commit details
-
Copy full SHA for a76f5ad - Browse repository at this point
Copy the full SHA a76f5adView commit details -
Configuration menu - View commit details
-
Copy full SHA for 96aa49a - Browse repository at this point
Copy the full SHA 96aa49aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d1ee649 - Browse repository at this point
Copy the full SHA d1ee649View commit details
Commits on Oct 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 18b0491 - Browse repository at this point
Copy the full SHA 18b0491View commit details -
Configuration menu - View commit details
-
Copy full SHA for adf8d67 - Browse repository at this point
Copy the full SHA adf8d67View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b4f88b - Browse repository at this point
Copy the full SHA 5b4f88bView commit details
Commits on Oct 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 05533cb - Browse repository at this point
Copy the full SHA 05533cbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ac9172 - Browse repository at this point
Copy the full SHA 9ac9172View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e6945b - Browse repository at this point
Copy the full SHA 3e6945bView commit details -
Configuration menu - View commit details
-
Copy full SHA for cc6fec5 - Browse repository at this point
Copy the full SHA cc6fec5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 845c840 - Browse repository at this point
Copy the full SHA 845c840View commit details