The Doctor Will See You Now: Machine Learning for Telehealth by Mark Brouch
In this presentation, I will tell the story of how we built a telehealth app in the browser for doctors to see patients virtually during the pandemic, and how we implemented a virtual backgrounds feature so that doctors can always have a professional-looking video background, even when seeing patients from home. I will explain how machine learning in the browser works with , and how to use segmentation models to identify a person in an image with BodyPix. I will also cover how to take ML segmentation data and use it to paint a virtual background behind a person on a video call using HTML Canvas compositing techniques - all in JavaScript. Finally, I will demo this feature with a sample video chat web application running on Twilio.
About Mark
Mark is a Software Engineer for Doximity, working remotely out of Honolulu, HI where he is helping to bring telehealth to the largest professional medical network. Mark is passionate about front-end development and pushing the limits of what’s possible in the browser with Machine Learning, WebRTC, WebAssembly, and other emerging technologies. Mark is involved in the Digital Nomad community and enjoys extensive work-travel. Besides work, Mark enjoys hiking, photography, and learning to cook Mexican dishes. Ask him how to hit a mean cut-shot in air hockey!
1 view
0
0
4 days ago 00:22:27 12
#033 Learn Ten Home-Based Exercises and Pain Relief Positions for Lumbar Spinal Stenosis
7 days ago 00:01:49 0
Spider-man has big Doc energy - TOON SANDWICH #funny #spiderman #marvel #mcu #doctorstrange
1 week ago 00:27:27 0
Alien: Isolation | THE HUNTER! | (Part 7) PC Gameplay Ultra, Walkthrough w/ facecam
1 week ago 00:28:37 0
The Walking Dead | THE ONES YOU LOVE... | Part 4, End (S02 Episode 5) - Playthrough w/ facecam
1 week ago 00:18:08 0
The Walking Dead | THE BETRAYAL! | Part 3 (Season 2 Episode 5) - Gameplay Playthrough w/ facecam
1 week ago 00:32:39 0
The Walking Dead | FIRE AND ICE... | Part 2 (Season 2 Episode 5) - Gameplay Playthrough w/ facecam
1 week ago 00:22:33 0
The Walking Dead | THE AFTERMATH | Part 1 (Season 2 Episode 5) - Gameplay Playthrough w/ facecam
2 weeks ago 00:19:03 0
The Walking Dead | PULLING TRIGGERS | Part 5, End (S02 Episode 4) - Playthrough w/ facecam
2 weeks ago 00:18:19 0
The Walking Dead | OH BABY BABY! | Part 4 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
2 weeks ago 00:23:38 0
The Walking Dead | ARVO... | Part 3 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
2 weeks ago 00:29:12 0
“ PROFILE OF A PROBLEM DRINKER “ 1957 ALCOHOLISM AWARENESS, TREATMENT & EDUCATION FILM CC10125
2 weeks ago 00:21:22 0
The Walking Dead | SNAP OUT OF IT! | Part 2 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
2 weeks ago 00:18:14 0
The Walking Dead | KENNY’S RAGE! | Part 1 (Season 2 Episode 4) - Gameplay Playthrough w/ facecam
3 weeks ago 01:26:26 13
Bob Dylan Mix
4 weeks ago 00:22:59 0
The Walking Dead | TILL DEATH DO US PART | Part 4, End (S02 Episode 3) - Playthrough w/ facecam
4 weeks ago 00:26:26 0
The Walking Dead | THE ESCAPE PLAN | Part 3 (Season 2 Episode 3) - Gameplay Playthrough w/ facecam
4 weeks ago 00:24:52 0
The Walking Dead | TENSION OVERLOAD! | Part 2 (Season 2 Episode 3) - Gameplay Playthrough w/ facecam
4 weeks ago 00:23:47 0
The Walking Dead | THE NEW CREW | Part 1 (Season 2 Episode 3)- Gameplay Playthrough w/ facecam
1 month ago 00:25:41 0
The Walking Dead (Season 2 Episode 2), Part 4 | TRUTH OR DARE... | Gameplay Playthrough /w facecam
1 month ago 00:13:52 0
The Walking Dead (Season 2 Episode 2), Part 3 | YOU?!... | Gameplay Playthrough /w facecam
1 month ago 00:20:14 0
The Walking Dead (Season 2 Episode 2), Part 2 | BRIDGE OF DEATH | Gameplay Playthrough /w facecam
1 month ago 00:22:33 0
The Walking Dead (Season 2 Episode 2), Part 1 | INTRUDER | Gameplay Playthrough /w facecam
1 month ago 00:00:36 0
Israel Intensifies Gaza Assault as Hamas Offers New Ceasefire Proposal