Skip to content
This repository was archived by the owner on Jan 10, 2025. It is now read-only.

DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps

License

Notifications You must be signed in to change notification settings

huggingface/tflite-android-transformers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

dcd6da1 Â· Dec 19, 2019

History

38 Commits
Dec 18, 2019
Dec 18, 2019
Dec 18, 2019
Dec 19, 2019
Oct 24, 2019
Dec 18, 2019
Dec 18, 2019
Nov 14, 2019
Nov 14, 2019
Dec 18, 2019
Dec 18, 2019
Dec 18, 2019
Oct 24, 2019
Oct 24, 2019
Dec 18, 2019

Repository files navigation

TensorFlow Lite Transformers w/ Android demos

Convert Transformers models imported from the 🤗 Transformers library and use them on Android. You can also check out our swift-coreml-transformers repo if you're looking for Transformers on iOS.

Demo of the DistilBERT model (97% of BERT’s performance on GLUE) fine-tuned for Question answering on the SQuAD dataset. It provides 48 passages from the dataset for users to choose from.

demo gif

On-device text generation using GPT-2 or DistilGPT2 (same distillation process than DistilBERT, 2x faster and 33% smaller than GPT-2)

demo gif


Models generation

Example scripts used to convert the models are available in the models_generation directory. Please note that they require the nightly version of TensorFlow and might thus be unstable.

License

Apache License 2.0

About

DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published