Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
pranavupadhyaya52 
posted an update 18 days ago
Post
2164
Hello everyone. I've built a medical AI assistant application.

pranavupadhyaya52/MediWiki_Medical_Assistant

It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).

It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).

Please let me know your thoughts on my project and how I can improve it further. Thank you.

Hello @pranavupadhyaya52 ,

Its an amazing tool, fantastic.

Can you help me to understand how you created this amazing assistant ? if you need any supporting developer on the same, I would love to collaborate

i would like to connect with you.

·

Thank you! I will be making my notebooks related to the model fine-tuning and the application public soon.

I have made this as a research project for an upcoming conference. If you would like to collaborate on the paper, please send me a DM on Instagram. My username on there is pranavupd44

Hey, where can i test this Project? Can i finde the code in github?

·

Hi. I'll be uploading my notebooks to GitHub soon. I'll update here.

I'm currently working on my code, it will be up shortly.