{"id":19722,"date":"2023-06-09T17:05:00","date_gmt":"2023-06-09T11:35:00","guid":{"rendered":"https:\/\/www.mygreatlearning.com\/blog\/viola-jones-algorithm\/"},"modified":"2024-09-02T17:01:39","modified_gmt":"2024-09-02T11:31:39","slug":"viola-jones-algorithm","status":"publish","type":"post","link":"https:\/\/www.mygreatlearning.com\/blog\/viola-jones-algorithm\/","title":{"rendered":"Face Detection using Viola Jones Algorithm"},"content":{"rendered":"\n

In the realm of computer vision, face detection stands as a fundamental and captivating task. Detecting and locating faces within images or video streams forms the cornerstone of numerous applications, from facial recognition systems to digital image processing. Among the many algorithms developed to tackle this challenge, the Viola-Jones algorithm has emerged as a groundbreaking approach renowned for its speed and accuracy.<\/p>\n\n\n\n

The Viola-Jones algorithm, pioneered by Paul Viola and Michael Jones in 2001, revolutionized the field of face detection. Its efficient and robust methodology opened doors to a wide range of applications that rely on accurately identifying and analyzing human faces. By harnessing the power of Haar-like features, integral images, machine learning, and cascades of classifiers, the Viola-Jones algorithm showcases the synergy between computer science and image processing.<\/p>\n\n\n\n

In this blog, we will delve into the intricacies of the Viola-Jones algorithm, unraveling its underlying mechanisms and exploring its applications. From its training process to its implementation in real-world scenarios, we will unlock the power of face detection and witness firsthand the transformative capabilities of the Viola-Jones algorithm.<\/p>\n\n\n

\"Viola
Detecting face and eyes <\/figcaption><\/figure>\n\n\n\n
    \n
  1. What is face detection?<\/a><\/li>\n\n\n\n
  2. What is Viola Jones algorithm?<\/a>\n
      \n
    1. What are Haar-Like Features?<\/a><\/li>\n\n\n\n
    2. What are Integral Images?<\/a><\/li>\n\n\n\n
    3. How is AdaBoost used in viola jones algorithm?<\/a><\/li>\n\n\n\n
    4. What are Cascading Classifiers?<\/a><\/li>\n<\/ol>\n<\/li>\n\n\n\n
    5. Using a Viola Jones Classifier to detect faces in a live webcam feed<\/a><\/li>\n<\/ol>\n\n\n\n
      \"computer<\/a><\/figure>\n\n\n\n

      What is face detection?<\/strong><\/h2>\n\n\n\n

      Object detection is one of the computer technologies that is connected to image processing and computer vision<\/a>. It is concerned with detecting instances of an object such as human faces, buildings, trees, cars, etc. The primary aim of face detection algorithms is to determine whether there is any face in an image or not.<\/p>\n\n\n\n

      In recent years, we have seen significant advancement of technologies that can detect and recognise faces. Our mobile cameras are often equipped with such technology where we can see a box around the faces. Although there are quite advanced face detection algorithms, especially with the introduction of deep learning, the introduction of viola jones algorithm in 2001 was a  breakthrough in this field. Now let us explore the viola jones algorithm in detail.
      <\/p>\n\n\n\n

      What is Viola Jones algorithm?<\/strong><\/h2>\n\n\n\n

      Viola Jones algorithm is named after two computer vision researchers who proposed the method in 2001, Paul Viola and Michael Jones in their paper, \"Rapid Object Detection using a Boosted Cascade of Simple Features\". Despite being an outdated framework, Viola-Jones is quite powerful, and its application has proven to be exceptionally notable in real-time face detection. This algorithm is painfully slow to train but can detect faces in real-time with impressive speed.<\/p>\n\n\n\n

      Given an image(this algorithm works on grayscale image), the algorithm looks at many smaller subregions and tries to find a face by looking for specific features in each subregion. It needs to check many different positions and scales because an image can contain many faces of various sizes. Viola and Jones used Haar-like features to detect faces in this algorithm.<\/p>\n\n\n\n

      The Viola Jones algorithm has four main steps, which we shall discuss in the sections to follow:<\/p>\n\n\n\n

        \n
      1. Selecting Haar-like features<\/li>\n\n\n\n
      2. Creating an integral image<\/li>\n\n\n\n
      3. Running AdaBoost training<\/li>\n\n\n\n
      4. Creating classifier cascades<\/li>\n<\/ol>\n\n\n\n
        \n
        \n
        \n
        <\/div>\n Texas McCombs, UT Austin<\/span>\n <\/div>\n

        \n Post Graduate Program in AI & Machine Learning: Business Applications<\/a>\n <\/p>\n

        Master in-demand AI and machine learning skills with this executive-level AI course\u2014designed to transform professionals into strategic tech leaders.<\/p>\n

        \n
        \n
        <\/div>\n Duration: 7 months<\/span>\n <\/div>\n
        \n
        <\/div>\n 4.72\/5 Rating<\/span>\n <\/div>\n <\/div>\n \n Take your First Step\n
        <\/div>\n <\/a>\n <\/div>\n <\/div>\n\n\n\n

        What are Haar-Like Features?<\/strong><\/h2>\n\n\n\n

        In the 19th century a Hungarian mathematician, Alfred Haar gave the concepts of Haar wavelets, which are a sequence of rescaled \"square-shaped\" functions which together form a wavelet family or basis. Voila and Jones adapted the idea of using Haar wavelets and developed the so-called Haar-like features. <\/p>\n\n\n\n

        Haar-like features are digital image features used in object recognition. All human faces share some universal properties of the human face like the eyes region is darker than its neighbour pixels, and the nose region is brighter than the eye region.
        <\/p>\n\n\n\n

        A simple way to find out which region is lighter or darker is to sum up the pixel values of both regions and compare them. The sum of pixel values in the darker region will be smaller than the sum of pixels in the lighter region. If one side is lighter than the other, it may be an edge of an eyebrow or sometimes the middle portion may be shinier than the surrounding boxes, which can be interpreted as a nose This can be accomplished using Haar-like features and with the help of them, we can interpret the different parts of a face. <\/p>\n\n\n\n

        There are 3 types of Haar-like features that Viola and Jones identified in their research:<\/p>\n\n\n\n

          \n
        1. Edge features<\/li>\n\n\n\n
        2. Line-features<\/li>\n\n\n\n
        3. Four-sided features<\/li>\n<\/ol>\n\n\n\n

          Edge features and Line features are useful for detecting edges and lines respectively. The four-sided features are used for finding diagonal features.<\/p>\n\n\n\n

          The value of the feature is calculated as a single number: the sum of pixel values in the black area minus the sum of pixel values in the white area. The value is zero for a plain surface in which all the pixels have the same value, and thus, provide no useful information. 
          <\/p>\n\n\n\n

          Since our faces are of complex shapes with darker and brighter spots, a Haar-like feature gives you a large number when the areas in the black and white rectangles are very different. Using this value, we get a piece of valid information out of the image.<\/p>\n\n\n\n

          To be useful, a Haar-like feature needs to give you a large number, meaning that the areas in the black and white rectangles are very different. There are known features that perform very well to detect human faces:<\/p>\n\n\n\n

          For example, when we apply this specific haar-like feature to the bridge of the nose, we get a good response. Similarly, we combine many of these features to understand if an image region contains a human face.
          <\/p>\n\n\n\n

          What are Integral Images?<\/strong><\/h2>\n\n\n\n

          In the previous section, we have seen that to calculate a value for each feature, we need to perform computations on all the pixels inside that particular feature. In reality, these calculations can be very intensive since the number of pixels would be much greater when we are dealing with a large feature. 
          <\/p>\n\n\n\n

          The integral image plays its part in allowing us to perform these intensive calculations quickly so we can understand whether a feature of several features fit the criteria.<\/p>\n\n\n\n

          An integral image (also known as a summed-area table) is the name of both a data structure and an algorithm used to obtain this data structure. It is used as a quick and efficient way to calculate the sum of pixel values in an image or rectangular part of an image.<\/p>\n\n\n\n

          How is AdaBoost used in viola jones algorithm?<\/strong><\/h2>\n\n\n\n

          Next, we use a Machine Learning algorithm known as AdaBoost. But why do we even want an algorithm?
          <\/p>\n\n\n\n

          The number of features that are present in the 24x24 detector window is nearly 160,000, but only a few of these features are important to identify a face. So we use the AdaBoost algorithm to identify the best features in the 160,000 features. 
          <\/p>\n\n\n\n

          In the Viola-Jones algorithm, each Haar-like feature represents a weak learner. To decide the type and size of a feature that goes into the final classifier, AdaBoost checks the performance of all classifiers that you supply to it.
          <\/p>\n\n\n\n

          To calculate the performance of a classifier, you evaluate it on all subregions of all the images used for training. Some subregions will produce a strong response in the classifier. Those will be classified as positives, meaning the classifier thinks it contains a human face. Subregions that don\u2019t provide a strong response don\u2019t contain a human face, in the classifiers opinion. They will be classified as negatives.
          <\/p>\n\n\n\n

          The classifiers that performed well are given higher importance or weight. The final result is a strong classifier, also called a boosted classifier, that contains the best performing weak classifiers.
          <\/p>\n\n\n\n

          So when we\u2019re training the AdaBoost to identify important features, we\u2019re feeding it information in the form of training data and subsequently training it to learn from the information to predict. So ultimately, the algorithm is setting a minimum threshold to determine whether something can be classified as a useful feature or not.<\/p>\n\n\n\n

          \n
          \n
          \n
          <\/div>\n Advance Data Science with MIT<\/span>\n <\/div>\n

          \n MIT Data Science and Machine Learning Course<\/a>\n <\/p>\n

          Unlock the power of data. Build hands-on data science and machine learning skills to drive innovation in your career.<\/p>\n

          \n
          \n
          <\/div>\n Duration: 12 weeks<\/span>\n <\/div>\n
          \n
          <\/div>\n 4.62\/5 Rating<\/span>\n <\/div>\n <\/div>\n \n Discover the Program\n
          <\/div>\n <\/a>\n <\/div>\n <\/div>\n\n\n\n

          What are Cascading Classifiers?<\/strong><\/h2>\n\n\n\n

          Maybe the AdaBoost will finally select the best features around say 2500, but it is still a time-consuming process to calculate these features for each region. We have a 24x24 window which we slide over the input image, and we need to find if any of those regions contain the face. The job of the cascade is to quickly discard non-faces, and avoid wasting precious time and computations. Thus, achieving the speed necessary for real-time face detection.<\/p>\n\n\n\n

          We set up a cascaded system in which we divide the process of identifying a face into multiple stages. In the first stage, we have a classifier which is made up of our best features, in other words, in the first stage, the subregion passes through the best features such as the feature which identifies the nose bridge or the one that identifies the eyes. In the next stages, we have all the remaining features.
          <\/p>\n\n\n\n

          When an image subregion enters the cascade, it is evaluated by the first stage. If that stage evaluates the subregion as positive, meaning that it thinks it\u2019s a face, the output of the stage is maybe.
          <\/p>\n\n\n\n

          When a subregion gets a maybe, it is sent to the next stage of the cascade and the process continues as such till we reach the last stage.<\/p>\n\n\n\n

          If all classifiers approve the image, it is finally classified as a human face and is presented to the user as a detection.
          <\/p>\n\n\n\n

          Now how does it help us to increase our speed? Basically, If the first stage gives a negative evaluation, then the image is immediately discarded as not containing a human face. If it passes the first stage but fails the second stage, it is discarded as well. Basically, the image can get discarded at any stage of the classifier
          <\/p>\n\n\n\n

          Using a Viola-Jones Classifier to detect faces in a live webcam feed<\/strong><\/h2>\n\n\n\n

          In this section, we are going to implement the Viola-Jones algorithm using OpenCV and detect faces in our webcam feed in real-time. We will also use the same algorithm to detect the eyes of a person too. This is quite simple and all you need is to install OpenCV and Python on your PC. You can refer to this<\/a> article to know about OpenCV and how to install it<\/p>\n\n\n\n

          <\/p>\n\n\n\n

          In OpenCV, we have several trained Haar Cascade models which are saved as XML files. Instead of creating and training the model from scratch, we use this file. We are going to use \u201chaarcascade_frontalface_alt2.xml\u201d file in this project. Now let us start coding.<\/p>\n\n\n\n

          The first step is to find the path to the \u201chaarcascade_frontalface_alt2.xml\u201d and \"haarcascade_eye_tree_eyeglasses.xml\" files. We do this by using the os module of Python language.<\/p>\n\n\n\n

          import os\ncascPathface = os.path.dirname(\n    cv2.__file__) + \"\/data\/haarcascade_frontalface_alt2.xml\"\ncascPatheyes = os.path.dirname(\n    cv2.__file__) + \"\/data\/haarcascade_eye_tree_eyeglasses.xml\"<\/code><\/pre>\n\n\n\n
           The next step is to load our classifier. We are using two classifiers, one for detecting the face and others for detection eyes. The path to the above XML file goes as an argument to CascadeClassifier() method of OpenCV. <\/p>\n\n\n\n
          faceCascade = cv2.CascadeClassifier(cascPath)\neyeCascade = cv2.CascadeClassifier(cascPatheyes)\n<\/code><\/pre>\n\n\n\n
           After loading the classifier, let us open the webcam using this simple OpenCV one-liner code <\/p>\n\n\n\n
          video_capture = cv2.VideoCapture(0)<\/code><\/pre>\n\n\n\n
           Next, we need to get the frames from the webcam stream, we do this using the read() function. We use the infinite loop to get all the frames until the time we want to close the stream. <\/p>\n\n\n\n
          while True:\n    # Capture frame-by-frame\n    ret, frame = video_capture.read()<\/code><\/pre>\n\n\n\n
          The read() function returns:<\/p>\n\n\n\n
            \n
          1. The actual video frame read (one frame on each loop)<\/li>\n\n\n\n
          2. A return code<\/li>\n<\/ol>\n\n\n\n
            The return code tells us if we have run out of frames, which will happen if we are reading from a file. This doesn\u2019t matter when reading from the webcam since we can record forever, so we will ignore it.<\/p>\n\n\n\n
            For this specific classifier to work, we need to convert the frame into greyscale.<\/p>\n\n\n\n
            gray = cv2.cvtColor(frame, cv2.COLOR_BGR2GRAY)<\/code><\/pre>\n\n\n\n
             The faceCascade object has a method detectMultiScale(), which receives a frame(image) as an argument and runs the classifier cascade over the image. The term MultiScale indicates that the algorithm looks at subregions of the image in multiple scales, to detect faces of varying sizes. <\/p>\n\n\n\n
            faces = faceCascade.detectMultiScale(gray,\n                                         scaleFactor=1.1,\n                                         minNeighbors=5,\n                                         minSize=(60, 60),\n                                         flags=cv2.CASCADE_SCALE_IMAGE)<\/code><\/pre>\n\n\n\n
            Let us go through these arguments of this function:<\/p>\n\n\n\n