Skip to content

Latest commit

 

History

History
127 lines (89 loc) · 6.44 KB

README.md

File metadata and controls

127 lines (89 loc) · 6.44 KB

😋 Optical Character Recognition (OCR)

Check the CHANGELOG file to have a global overview of the latest modifications ! 😋

Project structure

├── custom_architectures
│   ├── crnn_arch.py        : defines the CRNN main architecture for OCR (with CTC decoding)
│   ├── generation_utils.py : inference methods for CRNN with attention model *
│   ├── east_arch.py        : defines EAST text detector architecture
│   └── yolo_arch.py        : defines the YOLOv2 architecture
├── custom_layers
├── custom_train_objects
├── loggers
├── models
│   ├── detection           : used to detect texts in images (with the EAST detector)
│   ├── ocr
│   │   ├── base_ocr.py     : abstract class for OCR models
│   │   └── crnn.py         : main CRNN class (OCR)
├── pretrained_models
│   └── yolo_backend        : directory where to save the yolo_backend weights
├── unitests
├── utils
├── example_crnn.ipynb
└── pcr.ipynb

* This architecture is still experimental. Pretrained models / examples will be provided in the next update

Check the main project for more information about the unextended modules / structure / main classes.

Check the detection project for more information about the detection module and the EAST Scene-Text Detection model.

Available features

  • OCR (module models.ocr) :
Feature Fuction / class Description
OCR ocr Performs OCR on the given image(s)

You can check the ocr notebook for a concrete demonstration

Available models

Model architectures

Available architectures :

Model weights

Classes Dataset Architecture Trainer Weights

Models must be unzipped in the pretrained_models/ directory !

The pretrained CRNN models come from the EasyOCR library. Weights are automatically downloaded given the language or the model name, and converted in keras ! The easyocr is therefore not required, while pytorch is required for weights loading (for convertion).

The pretrained version of EAST can be downloaded from this project. It should be placed in pretrained_models/pretrained_weights/east_vgg16.pth (torch is required to convert the weights : pip install torch).

Installation and usage

Check this installagion guide for the step-by-step instructions !

TO-DO list :

  • Make the TO-DO list
  • Convert the CRNN architecture / weights from the easyocr library to tensorflow
  • Convert the CRNN + attention architecture from this repo to tensorflow
  • Add examples to initialize pretrained models (both EAST and CRNN)
  • Add an example to perform OCR on image (with text detection)
  • Add an example to perform OCR on camera
  • Allow to combine texts in lines / paragraphs (as EAST detects individual words)
  • Take into account the text rotation in the combination procedure

Contacts and licence

Contacts :

  • Mail : yui-mhcp@tutanota.com
  • Discord : yui0732

Terms of use

The goal of these projects is to support and advance education and research in Deep Learning technology. To facilitate this, all associated code is made available under the GNU Affero General Public License (AGPL) v3, supplemented by a clause that prohibits commercial use (cf the LICENCE file).

These projects are released as "free software", allowing you to freely use, modify, deploy, and share the software, provided you adhere to the terms of the license. While the software is freely available, it is not public domain and retains copyright protection. The license conditions are designed to ensure that every user can utilize and modify any version of the code for their own educational and research projects.

If you wish to use this project in a proprietary commercial endeavor, you must obtain a separate license. For further details on this process, please contact me directly.

For my protection, it is important to note that all projects are available on an "As Is" basis, without any warranties or conditions of any kind, either explicit or implied. However, do not hesitate to report issues on the repository's project, or make a Pull Request to solve it 😄

Citation

If you find this project useful in your work, please add this citation to give it more visibility ! 😋

@misc{yui-mhcp
    author  = {yui},
    title   = {A Deep Learning projects centralization},
    year    = {2021},
    publisher   = {GitHub},
    howpublished    = {\url{https://github.com/yui-mhcp}}
}

Notes and references

The code for the CRNN architecture is highly inspired from the easyocr repo :

Papers and tutorials :

Datasets :

  • COCO Text dataset : an extension of COCO for text detection