Repository
tflite-android-transformers
DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps
README
TensorFlow Lite Transformers w/ Android demos
Convert Transformers models
imported from the 🤗 Transformers library
and use them on Android. You can also check out our
swift-coreml-transformers repo
if you're looking for Transformers on iOS.
Question Answering with DistilBERT
Demo of the DistilBERT model
(97% of BERT’s performance on GLUE) fine-tuned for Question answering on the SQuAD dataset.
It provides 48 passages from the dataset for users to choose from.
Text Generation with GPT-2/DistilGPT2
On-device text generation using GPT-2 or DistilGPT2 (same distillation process than DistilBERT, 2x faster and 33% smaller than GPT-2)
Models generation
Example scripts used to convert the models are available in the models_generation directory.
Please note that they require the nightly version of TensorFlow and might thus be unstable.