Code

Tokenizers dispatch in vectorizers#53

Code

Merged

rth merged 16 commits intomasterrth/vtext:masterfrom tokenizer-dyn-dispatchrth/vtext:tokenizer-dyn-dispatchCopy head branch name to clipboardJun 7, 2019

Commits

Commits on May 1, 2019

• Add Tokenizer trait to RegexpTokenizer

  rth

  committed
  5ef640b

  Copy full SHA for 5ef640b

• Use Tokenizer traits for all tokenizers

  rth

  committed
  2c2ae35

  Copy full SHA for 2c2ae35

• Implement dynamic dispatch for RegexpTokenizer

  rth

  committed
  d9ffc90

  Copy full SHA for d9ffc90

• Finalize tokenizer dynamic dispatch for CountVectorizer

  rth

  committed
  1c11025

  Copy full SHA for 1c11025

• Lint

  rth

  committed
  33304bc

  Copy full SHA for 33304bc

• Add vectorization example

  rth

  committed
  db5c966

  Copy full SHA for db5c966

• Use lifetimes in python wrappers

  rth

  committed
  99fdd17

  Copy full SHA for 99fdd17

• Merge branch 'master' into customize-tokenizer-vectorizer

  rth

  authored
  2e27476

  Copy full SHA for 2e27476

Commits on May 3, 2019

• Merge branch 'master' into customize-tokenizer-vectorizer

  rth

  authored
  ba87223

  Copy full SHA for ba87223

• Merge branch 'master' into tokenizer-dyn-dispatch

  rth

  committed
  6657501

  Copy full SHA for 6657501

Commits on Jun 6, 2019

• Merge branch 'master' into tokenizer-dyn-dispatch

  rth

  authored
  c1fc5ad

  Copy full SHA for c1fc5ad

• Fix merge conflicts

  rth

  committed
  8e0887c

  Copy full SHA for 8e0887c

• Merge branch 'master' into tokenizer-dyn-dispatch

  rth

  committed
  89a9bdd

  Copy full SHA for 89a9bdd

Commits on Jun 7, 2019

• Try to fix send issues

  rth

  committed
  c191b0d

  Copy full SHA for c191b0d

• Static dispatch in rust lib

  rth

  committed
  45657db

  Copy full SHA for 45657db

• Fix python wrappe

  rth

  committed
  a9bc3cd

  Copy full SHA for a9bc3cd