Surgical Tools annotation

Annotation of Surgical Instruments & Tools for Computer-Assisted Interventions (CAI)​

Annotation of Surgical Instruments & Tools for Computer-Assisted Interventions (CAI)

Overview

Image Annotation of different types of surgical tools to be used in building an AI Model to aid in autonomous detection of different types of surgical tools

Surgical Tools annotation

Image Annotation of different types of surgical tools to be used in building an AI Model to aid in autonomous detection of different types of surgical tools

The Problem

Locating an instrument’s contour within a surgical scene is a generic problem in Computer-Assisted Interventions (CAI). Solving this with the help of AI would help many key clinical applications in Surgical Data Science.

Solution

Use of annotated data for machine learning model, aiding the detection of tools autonomously during an event of surgery

Process

STEP 1

Identifying a range of boundary conditions for the instrument images

STEP 2

Manual annotation of the surgical tools by an expert workforce

STEP 3

Various different types of labeling done for specific instruments like classifying the body elements of the tools

STEP 1

Identifying a range of boundary conditions for the instrument images

STEP 2

Manual annotation of the surgical tools by an expert workforce

STEP 3

Various different types of labeling done for specific instruments like classifying the body elements of the tools

Achievement

Fascilitated surgical tool classification in real-time enabling computerized assistance to the surgeons in conducting different operations

Provisioned large datasets and the emergence of convolutional neural networks (CNN) that have paved the way for the development of different image related processes

Insights

Annotation enhances surgeons’ efficiency and safety of patients, with minimally invasive surgery (MIS). The goal for annotating tools is to design efficient solutions for surgical workflow analysis, with potential applications in report generation, surgical training, and even real-time decision support.