Amarthya7 commited on
Commit
0899835
Β·
verified Β·
1 Parent(s): c9f18eb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -72
README.md CHANGED
@@ -1,73 +1,73 @@
1
- title: Medical Analysis System
2
- emoji: πŸ€–
3
- colorFrom: blue
4
- colorTo: purple
5
- sdk: gradio
6
- sdk_version: 5.20.1
7
- app_file: app.py
8
- pinned: false
9
-
10
- # MediSync: Multi-Modal Medical Analysis System
11
-
12
- MediSync is an AI-powered healthcare solution that combines X-ray image analysis with patient report text processing to provide comprehensive medical insights.
13
-
14
- ## Features
15
-
16
- - **X-ray Image Analysis**: Detects abnormalities in chest X-rays using pre-trained vision models from Hugging Face.
17
- - **Medical Report Processing**: Extracts key information from patient reports using NLP models.
18
- - **Multi-modal Integration**: Combines insights from both image and text data for more accurate diagnosis suggestions.
19
- - **User-friendly Interface**: Simple web interface for uploading images and reports.
20
-
21
- ## Project Structure
22
-
23
- ```
24
- mediSync/
25
- β”œβ”€β”€ app.py # Main application with Gradio interface
26
- β”œβ”€β”€ models/
27
- β”‚ β”œβ”€β”€ image_analyzer.py # X-ray image analysis module
28
- β”‚ β”œβ”€β”€ text_analyzer.py # Medical report text analysis module
29
- β”‚ └── multimodal_fusion.py # Fusion of image and text insights
30
- β”œβ”€β”€ utils/
31
- β”‚ β”œβ”€β”€ preprocessing.py # Data preprocessing utilities
32
- β”‚ └── visualization.py # Result visualization utilities
33
- β”œβ”€β”€ data/
34
- β”‚ └── sample/ # Sample data for testing
35
- └── tests/ # Unit tests
36
- ```
37
-
38
- ## Setup Instructions
39
-
40
- 1. Clone this repository:
41
- ```bash
42
- git clone [repository-url]
43
- cd MediSync
44
- ```
45
-
46
- 2. Install dependencies:
47
- ```bash
48
- pip install -r requirements.txt
49
- ```
50
-
51
- 3. Run the application:
52
- ```bash
53
- python app.py
54
- ```
55
-
56
- 4. Access the web interface at `http://localhost:7860`
57
-
58
- ## Models Used
59
-
60
- - **X-ray Analysis**: facebook/deit-base-patch16-224-medical-cxr
61
- - **Medical Text Analysis**: medicalai/ClinicalBERT
62
- - **Additional Support Models**: Medical question answering and entity recognition models
63
-
64
- ## Use Cases
65
-
66
- - Preliminary screening of chest X-rays
67
- - Cross-validation of radiologist reports
68
- - Educational tool for medical students
69
- - Research tool for studying correlation between visual findings and written reports
70
-
71
- ## Note
72
-
73
  This system is designed as a support tool and should not replace professional medical diagnosis. Always consult with healthcare professionals for medical decisions.
 
1
+ title: Medical Analysis System
2
+ emoji: πŸ€–
3
+ colorFrom: blue
4
+ colorTo: purple
5
+ sdk: gradio
6
+ sdk_version: 5.20.1
7
+ app_file: app.py
8
+ pinned: false
9
+
10
+ # MediSync: Multi-Modal Medical Analysis System
11
+
12
+ MediSync is an AI-powered healthcare solution that combines X-ray image analysis with patient report text processing to provide comprehensive medical insights.
13
+
14
+ ## Features
15
+
16
+ - **X-ray Image Analysis**: Detects abnormalities in chest X-rays using pre-trained vision models from Hugging Face.
17
+ - **Medical Report Processing**: Extracts key information from patient reports using NLP models.
18
+ - **Multi-modal Integration**: Combines insights from both image and text data for more accurate diagnosis suggestions.
19
+ - **User-friendly Interface**: Simple web interface for uploading images and reports.
20
+
21
+ ## Project Structure
22
+
23
+ ```
24
+ mediSync/
25
+ β”œβ”€β”€ app.py # Main application with Gradio interface
26
+ β”œβ”€β”€ models/
27
+ β”‚ β”œβ”€β”€ image_analyzer.py # X-ray image analysis module
28
+ β”‚ β”œβ”€β”€ text_analyzer.py # Medical report text analysis module
29
+ β”‚ └── multimodal_fusion.py # Fusion of image and text insights
30
+ β”œβ”€β”€ utils/
31
+ β”‚ β”œβ”€β”€ preprocessing.py # Data preprocessing utilities
32
+ β”‚ └── visualization.py # Result visualization utilities
33
+ β”œβ”€β”€ data/
34
+ β”‚ └── sample/ # Sample data for testing
35
+ └── tests/ # Unit tests
36
+ ```
37
+
38
+ ## Setup Instructions
39
+
40
+ 1. Clone this repository:
41
+ ```bash
42
+ git clone [repository-url]
43
+ cd MediSync
44
+ ```
45
+
46
+ 2. Install dependencies:
47
+ ```bash
48
+ pip install -r requirements.txt
49
+ ```
50
+
51
+ 3. Run the application:
52
+ ```bash
53
+ python app.py
54
+ ```
55
+
56
+ 4. Access the web interface at `http://localhost:7860`
57
+
58
+ ## Models Used
59
+
60
+ - **X-ray Analysis**: facebook/deit-base-patch16-224-medical-cxr
61
+ - **Medical Text Analysis**: medicalai/ClinicalBERT
62
+ - **Additional Support Models**: Medical question answering and entity recognition models
63
+
64
+ ## Use Cases
65
+
66
+ - Preliminary screening of chest X-rays
67
+ - Cross-validation of radiologist reports
68
+ - Educational tool for medical students
69
+ - Research tool for studying correlation between visual findings and written reports
70
+
71
+ ## Note
72
+
73
  This system is designed as a support tool and should not replace professional medical diagnosis. Always consult with healthcare professionals for medical decisions.