Releases: comet-ml/opik
Releases · comet-ml/opik
1.7.7
What's Changed
- Use metadata cost as a fallback to compute cost and support anthropic_vertexai provider by @BorisTkachenko in #1867
Full Changelog: 1.7.6...1.7.7
1.7.6
What's Changed
- removing a skip mark by @AndreiCautisanu in #1852
- NA: Remove containers after use by @thiagohora in #1854
- NA: Update change log by @thiagohora in #1855
- NO-JIRA: Add generate OpenAPI workflow by @andrescrz in #1853
- Update OpenAPI spec and Fern code by @github-actions in #1857
- Fix usage tracking for Anthropic models hosted on VertexAI by @Lothiraldan in #1856
- NA: Fix docker image versions by @thiagohora in #1860
- Update span cost from LiteLLM by @github-actions in #1850
Full Changelog: 1.7.5...1.7.6
1.7.5
What's Changed
- [NA] Update bayesian optimizer API and scripts by @alexkuzmik in #1833
- Optimizer: add Opik's callback to dspy/LiteLLM by @dsblank in #1832
- Update span cost from LiteLLM by @github-actions in #1835
- [OPIK-1421] experiment feedback scores UX improvements by @awkoy in #1827
- Bump opentelmetry.version from 2.14.0 to 2.15.0 in /apps/opik-backend by @dependabot in #1838
- [OPIK-1371] guardrails column in trace list table by @awkoy in #1795
- NO-JIRA: Add Opik optimizer CODEOWNERS by @andrescrz in #1840
- [NA] Add version restriction to orderly_set by @alexkuzmik in #1839
- Improve the robustness of metrics by @jverre in #1746
- [NA] Add dereferencing logic for default workspace by @alexkuzmik in #1574
- [OPIK-1377] add guardrails to trace by @idoberko2 in #1736
- [OPIK-1433] Improving OnlineScoring performance by @ldaugusto in #1829
- [OPIK-1372] guardrail span type by @awkoy in #1841
- [OPIK-1455] base64 validation fix by @awkoy in #1842
- [OPIK-1361] Add opik-guardrails-backend to docker compose and update the routing by @Lothiraldan in #1780
- Update faq.mdx by @anmorgan24 in #1843
- Revert "[OPIK-1361] Add opik-guardrails-backend to docker compose and update the routing" by @Lothiraldan in #1849
Full Changelog: 1.7.4...1.7.5
1.7.4
What's Changed
- Add documentation for new ADK integration by @Lothiraldan in #1819
- Fix link to ADK OpikTracer by @Lothiraldan in #1820
- Fix version of google-adk for doc building by @Lothiraldan in #1821
- Update span cost from LiteLLM by @github-actions in #1824
- OPIK-1393: Reduce result before join (Find Spans) by @thiagohora in #1818
- NA: Fix feedback score order to push no value to the end by @thiagohora in #1813
- [NA] Fix issue with DebounceInput canceling when onValueChange property changes every render by @andriidudar in #1825
- [OPIK-1414] [FE] [Base64 performance] - Trace sidebar performance by @andriidudar in #1811
- OPIK-1448: Fix create experiment unexpected 404 by @andrescrz in #1828
- [FE] [Base64 performance] - Trace sidebar performance by @andriidudar in #1830
Full Changelog: 1.7.2...1.7.4
1.7.2
What's Changed
- NA: Fixing python-backend metrics collection to support Prometheus by @ldaugusto in #1808
- feat: metaprompt based agentoptimizer and SDK improvements by @vincentkoc in #1807
- [OPIK-1386] guardrails ingestion by @idoberko2 in #1718
- OPIK-1393: Reduce result before join by @thiagohora in #1806
- [NA] Update Bayesian optimizer, add halu-eval example script by @alexkuzmik in #1809
- [OPIK-1388] Modify projects endpoints to support public projects by @BorisTkachenko in #1796
- [NA] Add opik_optimizer.demo.get_or_create_dataset() function, update exam… by @alexkuzmik in #1814
- [NA] Update demo dataset name by @alexkuzmik in #1817
- Fix test version of crewai: by @Lothiraldan in #1815
- Add new Agent Development Kit integration by @Lothiraldan in #1812
Full Changelog: 1.7.1...1.7.2
1.7.1
What's Changed
- NA: safer default otel propagators for python backend by @ldaugusto in #1787
- Update span cost from LiteLLM by @github-actions in #1785
- [OPIK-1387] Modify authentication filter to support public projects endpoints by @BorisTkachenko in #1758
- Add support for LlamaIndex streaming by @Lothiraldan in #1769
- [OPIK-1211] [FR][FE]: Add sorting to columns of experiment items table by @andriidudar in #1789
- Update kubernetes.mdx by @liyaka in #1790
- [NA] Alexkuzmik/few shot examples optimizer by @alexkuzmik in #1791
- [NA] Add new property to prompt template by @alexkuzmik in #1792
- [OPIK-1396] Security tests for Python OnlineEval DockerExecutor by @ldaugusto in #1776
- Added dspy optimizers by @dsblank in #1793
- Wrong Dataset for type checking by @dsblank in #1794
- [NA] Opik optimizer project structure refactor by @alexkuzmik in #1799
- Update Opik Optimizer README by @dsblank in #1798
- OPIK-1439: Migrate Opik backend to Amazon Linux 2023 by @andrescrz in #1797
- Alexkuzmik/add optimization result by @alexkuzmik in #1801
- Optimizer refinements by @dsblank in #1802
- OPIK-1432 SDK contribution guide clarity changes by @AndreiCautisanu in #1786
- OPIK-1412 - automation improvements by @NatZol in #1788
- skipping docs tests in main runs by @AndreiCautisanu in #1804
- [OPIK-667] GitHub Actions workflow for Python backend tests by @ldaugusto in #1800
- Update span cost from LiteLLM by @github-actions in #1803
- NA: Follow from log issue on Online scoring by @thiagohora in #1750
Full Changelog: 1.7.0...1.7.1
1.7.0
What's Changed
- [NA] Fix typo for attachment endpoint documentation by @BorisTkachenko in #1772
- [OPIK-1327] [FE] [Attachments] Add attachments section to trace sidebar by @andriidudar in #1766
- Update test_docs_links.yml by @AndreiCautisanu in #1774
- Update custom_metric.mdx by @SrBliss in #1767
- [NA] Autogenerated code 08-04-2025 by @BorisTkachenko in #1775
- [OPIK-1082] [FE] Implement sorting for traces table by @andriidudar in #1779
- [NA] Alexkuzmik/agent optimizer by @alexkuzmik in #1778
- [OPIK-1370] add guardrails column in project list table by @awkoy in #1777
- Update docs by @jverre in #1783
- [OPIK-1208]: [SDK] Implement AggregatedMetric by @yaricom in #1738
- Update Readme links by @jverre in #1784
- [OPIK-906] Updates to support clickhouse replications by @liyaka in #1400
Full Changelog: 1.6.14...1.7.0
1.6.14
What's Changed
- [OPIK-803] Update Automation Rules FE to support Python scoring by @andriidudar in #1703
- OPIK-1225: Add feedback scores sorting for find spans by @thiagohora in #1705
- [OPIK-1325] add search to syntaxhighlighter by @awkoy in #1702
- NA: Lazy loading executor strategy by @thiagohora in #1710
- add serviceMonitor template disabled by default by @liyaka in #1709
- [OPIK-1246] [SDK] Stop putting usage into span metadata if metadata was not passed at all by @yaricom in #1708
- Implements ROUGE score with unit tests and documentation by @rohithmsr in #1691
- [NA] Fix import in rouge_scorer by @alexkuzmik in #1717
- NA: Fixing @config serialization problem in AutomationRuleEvaluatorServiceImpl by @ldaugusto in #1720
- Update OpikTracer to log ChatModels span inputs in their native format by @Lothiraldan in #1711
- OPIK-1379: Add installation report by @thiagohora in #1713
- [OPIK-1365] Workflow to update span cost daily by @BorisTkachenko in #1721
- [OPIK-1331] create sdk methods for guardrails creation usage by @alexkuzmik in #1653
- NA: Fix search error message response by @thiagohora in #1724
- OPIK-1119: Add stream experiments by name endpoint by @andrescrz in #1723
- NO-JIRA: Increased Python backend Docker daemon wait by @andrescrz in #1727
- [NA] Fix Span cost update workflow by @BorisTkachenko in #1725
- Update span cost from LiteLLM by @github-actions in #1732
- OPIK-1119: Add stream experiments to OpenAPI spec and code by @andrescrz in #1733
- [OPIK-1354] add span type
guardrail
by @idoberko2 in #1726 - OPIK-1313 - threads test by @NatZol in #1714
- fix servicemonitoring labels by @liyaka in #1735
- [OPIK-666] opik-python-backend generating service metrics by @ldaugusto in #1734
- NO-JIRA: Fix Online Scoring Sampler logs by @andrescrz in #1739
- Add default authorization for LiteLLM Proxy example by @Lothiraldan in #1742
- NO-JIRA: Fix online scoring MDC propagation issue by @thiagohora in #1740
- [OPIK-1401] Add isPublic flag to projects by @BorisTkachenko in #1737
- [OPIK-1391] langchain integration as package by @awkoy in #1715
- [ISSUE-1744] [Bug]: No data state when navigating between traces from the experiment page by @andriidudar in #1745
- [OPIK-1399]: fix feedback scores with dots; by @aadereiko in #1719
- NO-JIRA: Fix Online consumer overflown by @andrescrz in #1749
- Parameterize the standard wait-for-clickhouse initContainer by @CRThaze in #1748
- Update docs by @jverre in #1754
- OPIK-1346 Automated tests for checking the docs for broken links by @AndreiCautisanu in #1707
- Update span cost from LiteLLM by @github-actions in #1755
- [NA] refactors preparing for guardrails by @idoberko2 in #1753
- Bump io.netty:netty-bom from 4.1.118.Final to 4.2.0.Final in /apps/opik-backend by @dependabot in #1756
- [OPIK-1392] add readme Langchain Integration JS by @awkoy in #1759
- [OPIK-1420]: label the build mode for FE images; by @aadereiko in #1761
- [OPIK-1415] User in AppStore by @awkoy in #1760
- [OPIK-1289] Integration with open a is new response api by @alexkuzmik in #1722
- Update evaluate_your_llm.mdx by @SrBliss in #1762
- Add timeout by @jverre in #1765
- [OPIK-866] [SDK] Implement stream-based spans search by @japdubengsub in #1633
- [OPIK-1010] fix
Error while processing scores batch
error in log by @idoberko2 in #1764 - [OPIK-1369] Set a guardrail modal by @awkoy in #1747
- [OPIK-1418] Langchain trace output fix by @awkoy in #1763
- NO-JIRA: Disable python evaluator by @andrescrz in #1771
New Contributors
- @yaricom made their first contribution in #1708
- @rohithmsr made their first contribution in #1691
- @github-actions made their first contribution in #1732
- @NatZol made their first contribution in #1714
Full Changelog: 1.6.13...1.6.14
1.6.13
What's Changed
- [OPIK-1018] add OpenAPI spec for the
projectName
field of Span by @idoberko2 in #1678 - [ISSUE-1677] [FR]: Remember pretty/JSON/YAML preference for experiment item view by @andriidudar in #1681
- [OPIK-1350] double scroll fix by @awkoy in #1682
- [OPIK-1276] replace base64 values inside input/output by @awkoy in #1676
- OPIK-1212: Add sorting for experiments by @thiagohora in #1684
- Updated changelog by @jverre in #1693
- [OPIK-729] Delete attachments by @BorisTkachenko in #1667
- Update with async instructions for evaluate function by @jverre in #1689
- Pydantic AI docs by @jverre in #1621
- Refresh model cost from LiteLLM by @Lothiraldan in #1679
- Bump org.jdbi:jdbi3-stringtemplate4 from 3.48.0 to 3.49.0 in /apps/opik-backend by @dependabot in #1694
- NO-OPIK add timeouts to installation tests and update step names by @AndreiCautisanu in #1696
- NO-JIRA: Fixing Python Evaluator URI and service by @andrescrz in #1697
- feat(python-sdk): use jinja2 prompt types by @klcd in #1618
- [OPIK-1240] Extending Python Online Eval for docker or process spawning by @ldaugusto in #1680
- OPIK-1130: Add Otel resource to Open API by @andrescrz in #1698
- [OPIK-1240] Bringing in modifications from OPIK-1697 by @ldaugusto in #1699
- NA: Changing python backend default to processes by @ldaugusto in #1700
- OPIK-1225: Implement sorting for feedback score by @thiagohora in #1690
- docs: Added README in JP, CN and KO by @vincentkoc in #1701
- [OPIK-1239] Adding flags disabling Online Scoring Python metrics by @ldaugusto in #1686
- [OPIK-1277]: price retention banner init; by @aadereiko in #1683
- OPIK-1225: Implement sorting for feedback scores on find traces endpoint by @thiagohora in #1692
- NA: Fix sorting serialization by @thiagohora in #1704
New Contributors
Full Changelog: 1.6.12...1.6.13
1.6.12
What's Changed
- [OPIK-1220] Langchain Javascript integration by @awkoy in #1668
- [NA]: sashaa/add type sdk by @aadereiko in #1675
Full Changelog: 1.6.11...1.6.12