What is Intersection over Union in object detection?
Object detection is a technique in computer vision used to identify as well as locate objects in digital images or videos. It detects a targeted object in the image or video.
It refers to the assignment of an object to an image. In other words, finding which classes of objects are present in an image or a video.
It seeks to locate the most visible object in an image or video. Usually, it is centered within a tightly cropped bounding box. It easily ascertains the location of an image object.
It describes the level of overlapping between two boxes, that is the predicting box and the actual bounding box. The greater the overlap, the greater the IOU.
In object detection,Intersection of Union is a unit of measurement for checking the level of overlap between an object's predicted box and its actual bounding box in a particular dataset. Its symbol is $IoU$.
The predicting box and the actual bounding box are usually most unlikely going to be the same. This is where Intersection over Union is needed. It measures the overlap between both boxes, and as such determines the level of accuracy of the object detector.
David Lowe is the originator of SIFT. It uses scale and rotation invariants to detect the local features of an image also known as its key points. Image size and orientation do not affect it. There are four main steps in the SIFT process.
This ensures the scale independence of features.
This is where the features of the image are identified.
This is where we ensure that the invariance of key points are rotated.
This is where a unique fingerprint is assigned to every key point
SURF is a patented object detector first introduced by Herbert Bay at 2006 European Conference on Computer Vision. It has three main areas:
It uses the blob detector, which bases on the Hessian matrix to find interest points. The calculated Hessian matrix is the measure of change of the interest point and the maximum value of determinant points which are selected.
Here, it provides unique descriptions of an image feature. It fixes an orientation that is reproducible based on information received from the circular region around the point of interest.
Here we find pairs that match with the use of descriptor comparison accessed from different images.
It is a method of corner detection with computational efficiency, introduced by Tom Drummond and Edward Rosten. It provides corner points which are used as key points. It is good for real-time video processing applications due to a high speed performance. However, it is unable to detect corners on images with coordinates which are computer-generated. It assigns a segment per pixel in a circle of 16 pixels around the pixel.
YOLO detects different image objects in real-time through the use of neutral networks. A single logarithm run in yellow is enough for image detection.
The formula for calculating Intersection over Union is called The Jaccard Index. The area of intersection for the two boxes is calculated. Afterwards it is divided by the area of the Union of the two boxes. That means the intersection area is divided by the union area.
IoU= (ANB)÷ (AUB) or (I) ÷(U)
Object detection draws a bounding box around a detected object, that allows the specific object location to be detected, or alternatively how they move in a particular scene.
Its accuracy measure is a bit questionable. This is because its formula does not really reflect whether the two bounding boxes are in proximity or far from one another.
This is in fact the case in projects like iToBoS, where AI technology, with a mix between technology and Human-in-the-loop technics, is used to accurately detect melanoma. This article digs into the the isahit annotation process and workflow that we applied to iToBoS, enlightening our pivotal role as a data labeling services company, in producing quality annotations and driving successful outcomes.
A complete state of the art where we review how computer vision works, the different techniques used, the main multi-sector use cases and the challenges ahead.
In order to please customers and increase profits, post and parcel businesses were already looking towards more efficient and affordable delivery systems before COVID-19. Find out in this article How Computer Vision recognizes objects for safer package deliveries
We have a wide range of solutions and tools that will help you train your algorithms. Click below to learn more!