There’s some fairly serious mathematics behind this sort of videographic analysis.
The machine learning algorithm needed to be trained to identify the relevant parts of surgical videos. To do this, the laparoscopic surgeries being investigated were split up into distinct stages, each relating to a different part of the surgical process. Researchers would then watch recordings of prior surgeries and mark the start of each stage. This data was used to train the model which was then used to sift through other recordings to capture the key moments of each surgery.
The time-saving advantages of such technology could be applied to a great many fields – such an algorithm could be put to great use to sort through hours of uneventful security footage looking for anomalies, or rapidly cut together holiday footage so you only have to see the good parts. We’d love to see the researchers release footage showing the algorithm’s work – thus far, all we have to go off is the project paper.
If you’re thirsty for more machine learning knowledge, read up on the state of working with neural networks in 2017.
Filed under: Medical hacks