Code

Restructure package (cont.)#36

Code

Merged

tonywu71 merged 83 commits intomainilluin-tech/colpali:mainfrom fix-restructured-packageilluin-tech/colpali:fix-restructured-packageCopy head branch name to clipboardSep 10, 2024

+981-586

Commits

Commits on Sep 9, 2024

• fix: fix wrong PIL import

  tonywu71

  committed
  fa9a4ea

  Copy full SHA for fa9a4ea

• feat: add cast for better typing

  tonywu71

  committed
  339f841

  Copy full SHA for 339f841

• feat: clean CustomCollator (mostly style edits)

  tonywu71

  committed
  ca2094b

  Copy full SHA for ca2094b

• style: clean colpali_processing_utils and add better typing

  tonywu71

  committed
  33ad4cd

  Copy full SHA for 33ad4cd

• feat: factorize the ColPali processing utils in CustomCollator

  tonywu71

  committed
  568fb2e

  Copy full SHA for 568fb2e

• feat: factorize the ColIdefics processing utils in CustomCollator

  tonywu71

  committed
  bb38f89

  Copy full SHA for bb38f89

• feat: restructure the models module

  tonywu71

  committed
  f9444a2

  Copy full SHA for f9444a2

• feat: big refacto of the collator classes

  tonywu71

  committed
  0ef2fdf

  Copy full SHA for 0ef2fdf

• style: tweak bi-encoder losses

  tonywu71

  committed
  5b16c2e

  Copy full SHA for 5b16c2e

• feat: add ColPaliConfig

  tonywu71

  committed
  146fa42

  Copy full SHA for 146fa42

• doc: tweaks

  tonywu71

  committed
  dd91476

  Copy full SHA for dd91476

• build: remove all import *

  tonywu71

  committed
  7d413fc

  Copy full SHA for 7d413fc

• feat: deprecate TextRetrieverCollator

  tonywu71

  committed
  4e535e0

  Copy full SHA for 4e535e0

• feat: remove redundant tokenizer attribute from BaseVisualRetrieverProcessor

  tonywu71

  committed
  7036623

  Copy full SHA for 7036623

• fix: address Manu's comments

  tonywu71

  committed
  164dc2f

  Copy full SHA for 164dc2f

• fix: fix typos in ColIdefics2Processor

  tonywu71

  committed
  f5baaa3

  Copy full SHA for f5baaa3

• fix: fix HardNegCollator + style tweaks

  tonywu71

  committed
  5519e34

  Copy full SHA for 5519e34

• doc: tweak

  tonywu71

  committed
  a1e0d91

  Copy full SHA for a1e0d91

• feat: deprecate HardNegDocmatixCollator

  tonywu71

  committed
  50dbebd

  Copy full SHA for 50dbebd

• feat: revert removing abstract attribute tokenizer from BaseVisualRetrieverProcessor

  tonywu71

  committed
  6171222

  Copy full SHA for 6171222

• doc: fix typos

  tonywu71

  committed
  04c3579

  Copy full SHA for 04c3579

• feat: update __init__.py files

  tonywu71

  committed
  0c0734f

  Copy full SHA for 0c0734f

• feat: fix typing for ColPaliProcessor.from_pretrained

  tonywu71

  committed
  0ece045

  Copy full SHA for 0ece045

• feat: add better typing and remove prints from CustomEvaluator

  tonywu71

  committed
  7838caf

  Copy full SHA for 7838caf

• feat: rename CustomEvaluator to CustomRetrievalEvaluator

  tonywu71

  committed
  3dde6ba

  Copy full SHA for 3dde6ba

• feat: tweak get_torch_device

  tonywu71

  committed
  46c43c6

  Copy full SHA for 46c43c6

• feat: turn main_input_name into ClassVar in ColPali

  tonywu71

  committed
  4a4c8c8

  Copy full SHA for 4a4c8c8

• feat: better from_pretrained methods

  tonywu71

  committed
  2700391

  Copy full SHA for 2700391

• feat: use PaliGemma tokenizer in process_queries

  tonywu71

  committed
  c123156

  Copy full SHA for c123156

• feat: modify the processor classes

  tonywu71

  committed
  08b3521

  Copy full SHA for 08b3521

• feat: deprecate ColPaliConfig

  tonywu71

  committed
  991ccfb

  Copy full SHA for 991ccfb

• feat: rename ColPaliProcessor init arg

  tonywu71

  committed
  dc0616c

  Copy full SHA for dc0616c

• feat: better CustomRetrievalEvaluator

  tonywu71

  committed
  33d8fa8

  Copy full SHA for 33d8fa8

• feat: move CustomRetrievalEvaluator in evaluation module

  tonywu71

  committed
  227ded6

  Copy full SHA for 227ded6

• feat: add input length guardrail in CustomRetrievalEvaluator

  tonywu71

  committed
  a21f133

  Copy full SHA for a21f133

• feat: add tests for ColPali

  tonywu71

  committed
  bc37da8

  Copy full SHA for bc37da8

• feat: add hf_token arg to ColPaliProcessor

  tonywu71

  committed
  2704576

  Copy full SHA for 2704576

• Revert "feat: use PaliGemma tokenizer in process_queries"

  Show description for 7ef02f0
  tonywu71

  committed
  7ef02f0

  Copy full SHA for 7ef02f0

• feat: reduce mock images's size

  tonywu71

  committed
  700de7b

  Copy full SHA for 700de7b

• build: remove .vscode/

  tonywu71

  committed
  2ced7b1

  Copy full SHA for 2ced7b1

• feat: revert embedding_dim attribute to dim in ColPali

  tonywu71

  committed
  7caffd4

  Copy full SHA for 7caffd4

• feat: put all model directories in 1st level of models module

  tonywu71

  committed
  81835db

  Copy full SHA for 81835db

• build: update module path for models in config files

  tonywu71

  committed
  c69f6f5

  Copy full SHA for c69f6f5

• feat: sort models module by vlm backbone

  tonywu71

  committed
  cc2c645

  Copy full SHA for cc2c645

• fix: fix imports in tests

  tonywu71

  committed
  18948a4

  Copy full SHA for 18948a4

• feat: rename all Idefics* classes to Idefics2*

  tonywu71

  committed
  8cea6fb

  Copy full SHA for 8cea6fb

• feat: add missing processors for Bi* models

  tonywu71

  committed
  20d661c

  Copy full SHA for 20d661c

• untested: processor is inherited directly

  ManuelFay

  committed
  2c433a4

  Copy full SHA for 2c433a4

• feat: inherit processor directly in ColIdefics2Processor

  tonywu71

  committed
  9ea85dc

  Copy full SHA for 9ea85dc

• doc: update docstrings in processor classes

  tonywu71

  committed
  d674ffa

  Copy full SHA for d674ffa

• build: loosen dev deps

  tonywu71

  committed
  cd01d52

  Copy full SHA for cd01d52

• fix: add missing casts in processor tests

  tonywu71

  committed
  9bd67a9

  Copy full SHA for 9bd67a9

• feat: restructure test file structure

  tonywu71

  committed
  2c3a996

  Copy full SHA for 2c3a996

• fix: fix wrong init in Bi* processors

  tonywu71

  committed
  57b1b90

  Copy full SHA for 57b1b90

• rename

  ManuelFay

  committed
  d74f1f5

  Copy full SHA for d74f1f5

• fix: add texts query to list

  ManuelFay

  committed
  240475c

  Copy full SHA for 240475c

• fix: ruff

  ManuelFay

  committed
  faec8d1

  Copy full SHA for faec8d1

• feat: remove unused __future__ imports

  tonywu71

  committed
  bed9d6c

  Copy full SHA for bed9d6c

• build: move pytest conifg to pyproject

  tonywu71

  committed
  f11732d

  Copy full SHA for f11732d

• feat: add logging in get_torch_device

  tonywu71

  committed
  b9e074d

  Copy full SHA for b9e074d

• feat: set default device to cpu in test_retrieval_evaluator.py

  tonywu71

  committed
  3270858

  Copy full SHA for 3270858

• build: add "Ruff" and "Test" CI pipelines

  tonywu71

  committed
  8a9beb0

  Copy full SHA for 8a9beb0

• build: add missing pillow dep

  tonywu71

  committed
  240a5b9

  Copy full SHA for 240a5b9

• build: update ruff config in pyproject

  tonywu71

  committed
  b016c01

  Copy full SHA for b016c01

• build: move mteb to compulsory deps + format pyproject

  tonywu71

  committed
  6f04cf1

  Copy full SHA for 6f04cf1

• build: tweak project details in pyproject

  tonywu71

  committed
  3af0b77

  Copy full SHA for 3af0b77

Commits on Sep 10, 2024

• build: remove black and use ruff formatter instead

  tonywu71

  committed
  d4d29c5

  Copy full SHA for d4d29c5

• build: add missing HF_TOKEN secret in test CI

  tonywu71

  committed
  a3f7b64

  Copy full SHA for a3f7b64

• feat: remove all | for python 3.9 compatibility

  tonywu71

  committed
  b3b7a70

  Copy full SHA for b3b7a70

• feat: tweak ColPaliProcessor test

  tonywu71

  committed
  a4a6805

  Copy full SHA for a4a6805

• feat: add test for ColPali collator

  tonywu71

  committed
  1e47628

  Copy full SHA for 1e47628

• build: remove .python-version

  tonywu71

  committed
  fae60cc

  Copy full SHA for fae60cc

• fix: fix typo in compute_hardnegs.py

  tonywu71

  committed
  6ff8e6b

  Copy full SHA for 6ff8e6b

• build: unfreeze the numpy dep and make it compulsory

  tonywu71

  committed
  c759752

  Copy full SHA for c759752

• feat: deprecate mteb metrics and remove mteb dep

  tonywu71

  committed
  d2f3181

  Copy full SHA for d2f3181

• feat: tweak CustomRetrievalEvaluator.evaluate

  tonywu71

  committed
  222c040

  Copy full SHA for 222c040

• feat: rename CustomRetrievalEvaluator to RetrievalScorer + tweaks

  tonywu71

  committed
  f1f4cb8

  Copy full SHA for f1f4cb8

• feat: add CustomRetrievalEvaluator as a mteb wrapper + update ColModelTraining

  tonywu71

  committed
  ec32192

  Copy full SHA for ec32192

• chore: update CHANGELOG

  tonywu71

  committed
  d8f3665

  Copy full SHA for d8f3665

• Add scorer in processor (#46)

  Show description for f4ca2f7
  ManuelFay

  authored
  f4ca2f7

  Copy full SHA for f4ca2f7

• style: lint

  tonywu71

  committed
  4228dd7

  Copy full SHA for 4228dd7

• fix: fix wrong typing in processor classes

  tonywu71

  committed
  2fc0835

  Copy full SHA for 2fc0835

• fix: fix wrong score method override in processors

  tonywu71

  committed
  3e8f32e

  Copy full SHA for 3e8f32e