dodin

dodin
·

AI & ML interests

None yet

Recent Activity

liked a model 8 days ago
Lightricks/LTX-Video
liked a model 22 days ago
nari-labs/Dia-1.6B
liked a Space 22 days ago
nari-labs/Dia-1.6B
View all activity

Organizations

None yet

dodin's activity

replied to thomwolf's post about 1 year ago
reacted to thomwolf's post with ❤️🔥 about 1 year ago
view post
Post
4944
Is is time for the open-source AI robots revolution 🚀?

With @haixuantao and @Leyo we’ve been playing with a low-cost DJI robot controlled by three local open-source AI models (Whisper, Idefics2, Parler-TTS - all Apache2) and orchestrated by Dora-cs.

Links to find all the hardware/software we used in the demo:
- robot control framework – dora-rs: https://github.com/dora-rs/dora
- speech-to-text model – whisper: openai/whisper-base
- vision-text model – Idefics2: HuggingFaceM4/idefics2-8b-AWQ
- text-to-speech model – ParlerTTS mini: parler-tts/parler_tts_mini_v0.1
- robot: https://dji.com/robomaster-s1
- code gist: https://gist.github.com/haixuanTao/860e1740245dc2c8dd85b496150a9320
- Larger codebase: dora-rs/dora-idefics2
- laptop/pc: any with a recent GPU card (our has a RTX 4090)

Enjoy!
·