The Doctor Will See You Now: Machine Learning for Telehealth by Mark Brouch
In this presentation, I will tell the story of how we built a telehealth app in the browser for doctors to see patients virtually during the pandemic, and how we implemented a virtual backgrounds feature so that doctors can always have a professional-looking video background, even when seeing patients from home. I will explain how machine learning in the browser works with , and how to use segmentation models to identify a person in an image with BodyPix. I will also cover how to take ML segmentation data and use it to paint a virtual background behind a person on a video call using HTML Canvas compositing techniques - all in JavaScript. Finally, I will demo this feature with a sample video chat web application running on Twilio.
About Mark
Mark is a Software Engineer for Doximity, working remotely out of Honolulu, HI where he is helping to bring telehealth to the largest professional medical network. Mark is passionate about front-end development and pushing the limits of what’s possible in the browser with Machine Learning, WebRTC, WebAssembly, and other emerging technologies. Mark is involved in the Digital Nomad community and enjoys extensive work-travel. Besides work, Mark enjoys hiking, photography, and learning to cook Mexican dishes. Ask him how to hit a mean cut-shot in air hockey!
1 view
0
0
4 days ago 00:11:26 1
Именно ЭТО скорректирует исход аутоиммунного заболевания🙌
7 days ago 00:02:25 2
Greta’s Anatomy | Redneck AI Country Parody (Grey’s Anatomy)
4 weeks ago 00:22:27 18
#033 Learn Ten Home-Based Exercises and Pain Relief Positions for Lumbar Spinal Stenosis
4 weeks ago 00:01:49 1
Spider-man has big Doc energy - TOON SANDWICH #funny #spiderman #marvel #mcu #doctorstrange
4 weeks ago 00:27:27 1
Alien: Isolation | THE HUNTER! | (Part 7) PC Gameplay Ultra, Walkthrough w/ facecam
1 month ago 00:28:37 1
The Walking Dead | THE ONES YOU LOVE... | Part 4, End (S02 Episode 5) - Playthrough w/ facecam
1 month ago 00:18:08 1
The Walking Dead | THE BETRAYAL! | Part 3 (Season 2 Episode 5) - Gameplay Playthrough w/ facecam
1 month ago 00:32:39 1
The Walking Dead | FIRE AND ICE... | Part 2 (Season 2 Episode 5) - Gameplay Playthrough w/ facecam
1 month ago 00:22:33 1
The Walking Dead | THE AFTERMATH | Part 1 (Season 2 Episode 5) - Gameplay Playthrough w/ facecam
1 month ago 00:19:03 1
The Walking Dead | PULLING TRIGGERS | Part 5, End (S02 Episode 4) - Playthrough w/ facecam
1 month ago 00:18:19 1
The Walking Dead | OH BABY BABY! | Part 4 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
1 month ago 00:23:38 1
The Walking Dead | ARVO... | Part 3 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
1 month ago 00:29:12 1
“ PROFILE OF A PROBLEM DRINKER “ 1957 ALCOHOLISM AWARENESS, TREATMENT & EDUCATION FILM CC10125
1 month ago 00:21:22 1
The Walking Dead | SNAP OUT OF IT! | Part 2 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
1 month ago 00:18:14 1
The Walking Dead | KENNY’S RAGE! | Part 1 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
1 month ago 01:26:26 16
Bob Dylan Mix
2 months ago 00:22:59 1
The Walking Dead | TILL DEATH DO US PART | Part 4, End (S02 Episode 3) - Playthrough w/ facecam
2 months ago 00:26:26 1
The Walking Dead | THE ESCAPE PLAN | Part 3 (Season 2 Episode 3) - Gameplay Playthrough w/ facecam
2 months ago 00:24:52 1
The Walking Dead | TENSION OVERLOAD! | Part 2 (Season 2 Episode 3) - Gameplay Playthrough w/ facecam
2 months ago 00:23:47 1
The Walking Dead | THE NEW CREW | Part 1 (Season 2 Episode 3)- Gameplay Playthrough w/ facecam
2 months ago 00:25:41 1
The Walking Dead (Season 2 Episode 2), Part 4 | TRUTH OR DARE... | Gameplay Playthrough /w facecam
2 months ago 00:13:52 1
The Walking Dead (Season 2 Episode 2), Part 3 | YOU?!... | Gameplay Playthrough /w facecam
2 months ago 00:20:14 1
The Walking Dead (Season 2 Episode 2), Part 2 | BRIDGE OF DEATH | Gameplay Playthrough /w facecam
2 months ago 00:22:33 1
The Walking Dead (Season 2 Episode 2), Part 1 | INTRUDER | Gameplay Playthrough /w facecam