cv2 all 人脸特征检测

Question

我有一个程序可以检测眼睛、嘴巴、鼻子和脸，但它非常不准确。这是我的代码：

import numpy as np
import cv2
face_cascade = cv2.CascadeClassifier('face.xml')
mouth_cascade = cv2.CascadeClassifier('mouth.xml')
nose_cascade = cv2.CascadeClassifier('nose.xml')
eye_cascade = cv2.CascadeClassifier('eye.xml')


image = cv2.imread("img.jpg")
grayImage = cv2.cvtColor(image, cv2.COLOR_BGR2GRAY)

face = face_cascade.detectMultiScale(grayImage, minNeighbors=5)
mouth = mouth_cascade.detectMultiScale(grayImage, minNeighbors=5)
nose = nose_cascade.detectMultiScale(grayImage, minNeighbors=5)
eye = eye_cascade.detectMultiScale(grayImage, minNeighbors=5)

print(type(face))

if len(face) == 0:
    print("No faces found")

else:
    print("mouth")
    print(mouth)
    print(mouth.shape)
    print("Number of mouths detected: " + str(mouth.shape[0]))

    print("Face")
    print(face)
    print(face.shape)
    print("Number of faces detected: " + str(face.shape[0]))

    print("nose")
    print(nose)
    print(nose.shape)
    print("Number of noses detected: " + str(nose.shape[0]))

    print("eye")
    print(eye)
    print(eye.shape)
    print("Number of eye detected: " + str(eye.shape[0]))

    for (x,y,w,h) in face:
        cv2.rectangle(image,(x,y),(x+w,y+h),(0,255,0),1)

    for (x,y,w,h) in mouth:
        cv2.rectangle(image,(x,y),(x+w,y+h),(255,0,0),1)

    for (x,y,w,h) in nose:
        cv2.rectangle(image,(x,y),(x+w,y+h),(255,255,255),1)

    for (x,y,w,h) in eye:
        cv2.rectangle(image,(x,y),(x+w,y+h),(255,255,0),1)


cv2.imshow('Image with faces',image)
cv2.waitKey(0)
cv2.destroyAllWindows()

我希望它看起来像 this.

实际结果是this.

我也想把耳朵和头发露出来
最好不要使用 dlib，因为我无法使用它。提前致谢。

Answer 1

OpenCV 现在提供 FaceMark API。您可以使用它来更准确地表示您的应用程序所需的面部标志。不过，这不是获得耳朵和头发分数的解决方案。

我想您将不得不自己标记数据并重新训练面部标记模型，或者使用提取的下巴点进行经典图像处理。

希望对您有所帮助。

这是link：OpenCV FaceMark API

Answer 2

使用以下代码作为起点。您将必须调整参数以获得更好的结果。

image = cv2.imread("sample_face.jpeg")
gray = cv2.cvtColor(image, cv2.COLOR_BGR2GRAY)
face = face_cascade.detectMultiScale(gray, minNeighbors=5)

if len(face) == 0:
    print("No faces found")

else:

    for (x,y,w,h) in face:
        cv2.rectangle(image,(x,y),(x+w,y+h),(0,255,0),2)
        roi_gray = gray[y:y+h, x:x+w]
        roi_color = image[y:y+h, x:x+w]

        eye = eye_cascade.detectMultiScale(roi_gray, 
                                           minSize=(80, 30),
                                           minNeighbors=5)
        for (ex,ey,ew,eh) in eye:
            cv2.rectangle(roi_color,(ex,ey),(ex+ew,ey+eh),(255,255,0),2)


        nose = nose_cascade.detectMultiScale(roi_gray, 
                                             scaleFactor=4.9, 
                                             minNeighbors=4, 
                                             flags=cv2.CASCADE_SCALE_IMAGE)

        for (nx,ny,nw,nh) in nose:
            cv2.rectangle(roi_color,(nx,ny),(nx+nw,ny+nh),(255,255,255),2)

        mouth = mouth_cascade.detectMultiScale(roi_gray, 
                                               scaleFactor=1.1, 
                                               maxSize=(100,150))
        for (mx,my,mw,mh) in mouth:
            cv2.rectangle(roi_color,(mx,my),(mx+mw,my+mh),(255,0,0),2)

此外，请阅读 this 教程，了解如何使用 Haar Feature-based Cascade Classifiers 进行人脸检测。

cv2 all 人脸特征检测

Cv2 all Facial features detection

python

opencv

face-detection