Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: move parsers quivr core #2884

Merged
merged 14 commits into from
Jul 22, 2024
Merged

feat: move parsers quivr core #2884

merged 14 commits into from
Jul 22, 2024

Conversation

AmineDiro
Copy link
Collaborator

@AmineDiro AmineDiro commented Jul 19, 2024

Description

  • Moved quivr-api parser to quivr_core.processor.implementations by Dynamically creating classes on the fly that inherit from ProcessorBase
  • Defined a priority based based system to automagically register the "important" processor that we can import at runtime
  • Wrote extensive tests for the registry
  • Added support file extensions

Next steps

  • Find a way to have correct LSP autocomplete on the dynamically generated processors
  • Test that processor are imported correctly based on the installed packages in environment ( using tox) ?

Copy link

vercel bot commented Jul 19, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
quivrapp ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jul 19, 2024 4:23pm

@dosubot dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. area: backend Related to backend functionality or under the /backend directory labels Jul 19, 2024
"EpubProcessor", UnstructuredEPubLoader, [FileExtension.epub]
)
BibTexProcessor = _build_processor(
"BibTexProcessor", BibtexLoader, [FileExtension.epub]
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fix bad extension

@StanGirard StanGirard merged commit d3c53e6 into main Jul 22, 2024
8 checks passed
@StanGirard StanGirard deleted the feat/move-parsers-quivr-core branch July 22, 2024 08:09
AmineDiro pushed a commit that referenced this pull request Jul 22, 2024
🤖 I have created a release *beep* *boop*
---


##
[0.0.11](core-0.0.10...core-0.0.11)
(2024-07-22)


### Features

* move parsers quivr core
([#2884](#2884))
([d3c53e6](d3c53e6))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
StanGirard added a commit that referenced this pull request Jul 22, 2024
🤖 I have created a release *beep* *boop*
---


## 0.0.285 (2024-07-22)

## What's Changed
* fix(frontend): select line when click on knowledge option by @Zewed in
#2879
* fix(frontend): selected item on mention list by @Zewed in
#2881
* fix(frontend): logo color on dark mode by @Zewed in
#2882
* fix: Refacto & update dropbox refresh by @chloedia in
#2875
* feat: quivr core brain info + processors registry + by @AmineDiro in
#2877
* chore(main): release core 0.0.10 by @StanGirard in
#2872
* feat: move parsers quivr core by @AmineDiro in
#2884
* fix(frontend): default icon for knowledge without extension by @Zewed
in #2887
* chore(main): release core 0.0.11 by @StanGirard in
#2886
* feat(frontend): add knowledge icon when integration by @Zewed in
#2888
* fix: google conversion by @chloedia in
#2891
* fix(frontend): remove thoughts button by @Zewed in
#2892
* feat: add integration and integration link to Sources class by
@StanGirard in #2893
* feat(azure): changed auth method by @StanGirard in
#2890
* feat(frontend): new inputs by @Zewed in
#2894
* fix(frontend): menu on mobile by @Zewed in
#2895
* feat(api): add logging for inactive subscriptions by @StanGirard in
#2897


**Full Changelog**:
v0.0.284...v0.0.285

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Dream528 added a commit to Dream528/quivr that referenced this pull request Jul 28, 2024
🤖 I have created a release *beep* *boop*
---


##
[0.0.11](QuivrHQ/quivr@core-0.0.10...core-0.0.11)
(2024-07-22)


### Features

* move parsers quivr core
([#2884](QuivrHQ/quivr#2884))
([d3c53e6](QuivrHQ/quivr@d3c53e6))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Dream528 added a commit to Dream528/quivr that referenced this pull request Jul 28, 2024
🤖 I have created a release *beep* *boop*
---


## 0.0.285 (2024-07-22)

## What's Changed
* fix(frontend): select line when click on knowledge option by @Zewed in
QuivrHQ/quivr#2879
* fix(frontend): selected item on mention list by @Zewed in
QuivrHQ/quivr#2881
* fix(frontend): logo color on dark mode by @Zewed in
QuivrHQ/quivr#2882
* fix: Refacto & update dropbox refresh by @chloedia in
QuivrHQ/quivr#2875
* feat: quivr core brain info + processors registry + by @AmineDiro in
QuivrHQ/quivr#2877
* chore(main): release core 0.0.10 by @StanGirard in
QuivrHQ/quivr#2872
* feat: move parsers quivr core by @AmineDiro in
QuivrHQ/quivr#2884
* fix(frontend): default icon for knowledge without extension by @Zewed
in QuivrHQ/quivr#2887
* chore(main): release core 0.0.11 by @StanGirard in
QuivrHQ/quivr#2886
* feat(frontend): add knowledge icon when integration by @Zewed in
QuivrHQ/quivr#2888
* fix: google conversion by @chloedia in
QuivrHQ/quivr#2891
* fix(frontend): remove thoughts button by @Zewed in
QuivrHQ/quivr#2892
* feat: add integration and integration link to Sources class by
@StanGirard in QuivrHQ/quivr#2893
* feat(azure): changed auth method by @StanGirard in
QuivrHQ/quivr#2890
* feat(frontend): new inputs by @Zewed in
QuivrHQ/quivr#2894
* fix(frontend): menu on mobile by @Zewed in
QuivrHQ/quivr#2895
* feat(api): add logging for inactive subscriptions by @StanGirard in
QuivrHQ/quivr#2897


**Full Changelog**:
QuivrHQ/quivr@v0.0.284...v0.0.285

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: backend Related to backend functionality or under the /backend directory size:XL This PR changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants