Skip to content

Latest commit

 

History

History
56 lines (36 loc) · 2.03 KB

README.md

File metadata and controls

56 lines (36 loc) · 2.03 KB

MediSynth

Problem Statement

Abstract

This mini project is an innovative fusion of Machine Learning (ML) and Artificial Intelligence (AI) designed to elevate medical education. Featuring two interfaces for patients and aspiring doctors. A pivotal feature introduces an AI-generated patient exhibiting lifelike symptoms and presenting a simulated body temperature. Students should diagnose and prescribe medications, and then they receive real-time feedback with alternative suggestions through a user-friendly interface. The application will take the access of camera and microphone to get the data from students so as to provide an immersive learning experience. Enhancing realism, the AI patient expresses emotions through audio and visual cues. Another noteworthy feature is the Optical Character Recognition (OCR), which scans medicines, providing information on about the medicine and its uses . The project facilitates peer-to-peer interactions and introduces AI-driven consultations for remote patient monitoring through a chatbot. The medicine interface covers both English and Ayurvedic medicines for inclusivity.

Working

Frontend

  • Move to web/client
cd web/client
npm i
npm start

Backend

  • Move to web/api
cd web/api
wget 'https://iiitaphyd-my.sharepoint.com/personal/radrabha_m_research_iiit_ac_in/_layouts/15/download.aspx?share=EdjI7bZlgApMqsVoEUUXpLsBxqXbn5z8VTmoxp55YNDcIA' -O './Wav2Lip/checkpoints/wav2lip_gan.pth'

pip install https://raw.githubusercontent.com/AwaleSajil/ghc/master/ghc-1.0-py3-none-any.whl


wget "https://www.adrianbulat.com/downloads/python-fan/s3fd-619a316812.pth" -O "./Wav2Lip/face_detection/detection/sfd/s3fd.pth"

pip install -q youtube-dl
python server.py

Team