Changelog

v0.0.10

• Basically working dependency parsing
• Bug fixes/improvements
  • Fix critical issue using stem when singularised should be used
• Bit of project cleanup
  • Move benchmark folder to test/
  • Remove find utility (use grep!)

v0.0.9

• Improved token PoS tagging (+0.8% on Penn treebank!):
  • Order of detectors changed
  • Better management of composed words
• First step of scaffolding for dependency parsing feature

v0.0.8

• All regular verbs now conjugated (and/or conjugable)
• PoS tagging for verbs greatly improved
• Better packing of verbs and nationalities (-2ko)
• Better filtering of lexicon (-1ko)
• Reorganised a bit the project
  • Lexicon data files moved to src/lexicon
  • Compendium data files moved to src/dictionaries
• Lot of news tests (isSingular, verbs, lexicon...)
• Refactored detectors API so it's a bid less verbose

v0.0.7

• Better sentiment profiling for mixed sentiment, in particular when using multiple adverbs
• Politeness, dirtiness scores
• Synonyms feature for tokens normalization
  • Used by PoS tagger in case no other method returned a tag

v0.0.6

• Add interrogative and exclamatory sentence types
• Fix low confidence for obvious PoS tagging (CD, SYM...)
• [Gulpfile] Add test run on live rebuild

v0.0.5

• Statistics skips punctuation tokens
• Improve verb inflector
• Better sentiment profiling
• Better breakpoint detection