Conversion Script

#2
by Harish07nov - opened

Thanks a lot for sharing the tflite files, its working pretty well. However I wanna fine tune the whisper models, so I will get a hugging face based model itself. It would be really helpful if you guys could also share the script for converting the hugging face model to tflite. I already have one but some final layers are missing in it when compare to your model and hence the model is hallucinating post conversion.

Hey @Harish07nov , that script is right here!

https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/whisper_tiny_en/export.py
If you want to use your own version, you need to edit https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/whisper_tiny_en/model.py

Please use --help for the full suite of options. You should be able to pass your own weights.

The version above uses the Whisper from the openai-whisper package. If you want to choose a different version from HuggingFace, use this whisper version:
https://github.com/quic/ai-hub-models/tree/main/qai_hub_models/models/whisper_small_v2

korywat changed discussion status to closed

Sign up or log in to comment