Overview
The Image Analysis feature allows nurses to upload photos of handoff whiteboards, paper documents, or other medical images. Claude’s vision capabilities extract structured information from these images and integrate it seamlessly with electronic patient records.Use Cases
Handoff Whiteboards
Capture information from patient room whiteboards with handwritten notes
Paper Documents
Digitize paper handoff sheets and forms
Vital Signs
Extract vitals from monitor screenshots or flowsheets
Lab Results
Parse printed lab reports and imaging results
Image Upload Workflow
In Patient Detail View
From~/workspace/source/src/components/PatientDetail.jsx:220-284:
Standalone Image Analyzer
A dedicated image analyzer component is available at~/workspace/source/src/components/ImageAnalyzer.jsx with:
- Drag and drop support
- Click to upload functionality
- Real-time preview of uploaded images
- Copy analysis to clipboard
AI Analysis
What Claude Extracts
From~/workspace/source/server/index.js:63-142, the AI analyzes images for:
Patient Overview
Patient Overview
- Patient name and identifiers
- Demographics (age, sex)
- Chief complaint or admission reason
Clinical Status
Clinical Status
- Current condition
- Vital signs (temperature, heart rate, blood pressure, O2 saturation)
- Trends in vital signs over time
Lab & Imaging
Lab & Imaging
- Key lab results
- Imaging findings
- Trends and changes from previous results
Medications & Treatments
Medications & Treatments
- Active medications
- Recent medication changes
- Ongoing treatments or interventions
Task Status
Task Status
- Completed tasks during the shift
- Outstanding tasks with priorities
- Time-sensitive actions needed
Safety Concerns
Safety Concerns
- Allergies
- Fall risk
- Code status (Full Code, DNR, DNI)
- Isolation precautions
Task Status is Very Important - The system specifically looks for and emphasizes completed and outstanding tasks from handoff documents.
Claude Prompt
The AI receives this instruction at~/workspace/source/server/index.js:99-126:
Integration with Patient Records
When an image is analyzed in the patient detail view at~/workspace/source/src/components/PatientDetail.jsx:157-217, the system:
API Endpoint
Analyze Image
~/workspace/source/server/index.js:63-142
File Upload Configuration
The backend uses Multer for file handling at~/workspace/source/server/index.js:19-24:
Supported Formats
The system accepts all standard image formats:- JPEG / JPG
- PNG
- GIF
- WebP
- BMP
- TIFF
~/workspace/source/src/components/ImageAnalyzer.jsx:14-26:
Best Practices
Good Lighting
Ensure whiteboards and documents are well-lit without glare
Clear Focus
Keep camera steady and ensure text is in focus
Full Frame
Capture the entire document or whiteboard in frame
High Resolution
Use highest quality camera setting available
Features
Image Preview
Image Preview
See uploaded image before analysis with option to clear and reupload
Auto-Integration
Auto-Integration
Analysis automatically merges with electronic records in patient detail view
Conflict Resolution
Conflict Resolution
Newer information from images is prioritized and clearly marked
Copy Support
Copy Support
One-click copy of analysis results to clipboard
Error Handling
Error Handling
Clear error messages for invalid files or analysis failures
Next Steps
Patient Handoff
Learn how image analysis integrates with handoff note generation
Claude Integration
Understand how Claude’s vision model processes images
