Android?利用OpenCV制作人臉檢測(cè)APP

更新時(shí)間：2021年12月10日 16:33:26 作者：人工智能AI技術(shù)

本篇文章手把手教大家使用OpenCV來實(shí)現(xiàn)一個(gè)能在安卓手機(jī)上運(yùn)行的人臉檢測(cè)APP。其實(shí)不僅僅是能檢測(cè)人臉，還能檢測(cè)鼻子，嘴巴，眼睛和耳朵。需要的朋友可以參考一下

前言

本篇文章手把手教大家使用OpenCV來實(shí)現(xiàn)一個(gè)能在安卓手機(jī)上運(yùn)行的人臉檢測(cè)APP。其實(shí)不僅僅是能檢測(cè)人臉，還能檢測(cè)鼻子，嘴巴，眼睛和耳朵?；瞬簧倬戇@篇文章，希望點(diǎn)贊收藏關(guān)注。

無圖無真相，先把APP運(yùn)行的結(jié)果給大家看看。

如上圖所示，APP運(yùn)行后，點(diǎn)擊“選擇圖片”，從手機(jī)中選擇一張圖片，然后點(diǎn)擊“處理”，APP會(huì)將人臉用矩形給框起來，同時(shí)把鼻子也給檢測(cè)出來了。由于目的是給大家做演示，所以APP設(shè)計(jì)得很簡(jiǎn)單，而且也只實(shí)現(xiàn)了檢測(cè)人臉和鼻子，沒有實(shí)現(xiàn)對(duì)其他五官的檢測(cè)。而且這個(gè)APP也只能檢測(cè)很簡(jiǎn)單的圖片，如果圖片中背景太復(fù)雜就無法檢測(cè)出人臉。

下面我將一步一步教大家如何實(shí)現(xiàn)上面的APP！

第一步：下載并安裝Android studio

為了保證大家能下載到和我相同版本的Android Studio，我把安裝包上傳了到微云。下載地址

下載后，一路點(diǎn)擊下一步就安裝好了。當(dāng)然，安裝過程中要聯(lián)網(wǎng)，所以可能會(huì)中途失敗，如果失敗了，重試幾次，如果還是有問題，那么可能要開啟VPN。

第二步：下載SDK tools

打開Android studio后，點(diǎn)擊“File”->“Settings”

點(diǎn)擊“Appearance & Behavior”->“System Settings”->“Android SDK”->“SDK Tools”。

然后選中“NDK”和“CMake”，點(diǎn)擊“OK”。下載這兩個(gè)工具可能要花一點(diǎn)時(shí)間，如果失敗了請(qǐng)重試或開啟VPN。

第三步：新建一個(gè)Android APP項(xiàng)目

點(diǎn)擊“File”->“New”->“New Project”

選中“Empty Activity”，點(diǎn)擊“Next”

“Language”選擇“Java”，Minimum SDK選擇“API 21”。點(diǎn)擊“Finish”

第四步：下載Opencv

下載地址

下載后解壓。

第五步：導(dǎo)入OpenCV

將opencv-4.5.4-android-sdk\OpenCV-android-sdk下面的sdk復(fù)制到你在第三步創(chuàng)建的Android項(xiàng)目下面。就是第三步圖中的D:\programming\MyApplication下面。然后將sdk文件夾改名為openCVsdk。

選擇“Project”->“settings.gradle”。在文件中添加include ‘:openCVsdk'

選擇“Project”->“openCVsdk”->“build.gradle”。

將apply plugin: 'kotlin-android'改為//apply plugin: ‘kotlin-android'

將compileSdkVersion和minSdkVersion，targetSdkVersion改為31，21，31。

點(diǎn)擊“File”->“Project Structure”

點(diǎn)擊“Dependencies”->“app”->“+”->“Module Dependency”

選中“openCVsdk”，點(diǎn)擊“OK”，以及母窗口的“OK”

在Android項(xiàng)目文件夾的app\src里面創(chuàng)建一個(gè)新文件夾jniLibs，然后把openCV文件夾的opencv-4.5.4-android-sdk\OpenCV-android-sdk\sdk\native\staticlibs里面的東西都copy到j(luò)niLibs文件夾中。

下載分類器。解壓后，將下圖中的文件都復(fù)制到項(xiàng)目文件夾的app\src\main\res\raw文件夾下。

第六步：添加代碼

雙擊“Project”->“app”-》“main”-》“res”下面的“activity_main.xml”。然后點(diǎn)擊右上角的“code”。

然后將里面的代碼都換成下面的代碼

<?xml version="1.0" encoding="utf-8"?>
<LinearLayout xmlns:android="http://schemas.android.com/apk/res/android"
    xmlns:app="http://schemas.android.com/apk/res-auto"
    xmlns:tools="http://schemas.android.com/tools"
    android:layout_width="match_parent"
    android:layout_height="match_parent"
    tools:context=".MainActivity"
    android:orientation="vertical"
    >

    <Button
        android:id="@+id/select_btn"
        android:layout_width="wrap_content"
        android:layout_height="wrap_content"
        android:text="選擇圖片" />
    <Button
        android:id="@+id/process_btn"
        android:layout_width="wrap_content"
        android:layout_height="wrap_content"
        android:text="處理" />

    <ImageView
        android:id="@+id/imageView"
        android:layout_width="wrap_content"
        android:layout_height="wrap_content" />

</LinearLayout>

雙擊“Project”->“app”-》“main”-》“java”-》“com.example…”下面的“MainActivity”。然后把里面的代碼都換成下面的代碼（保留原文件里的第一行代碼）

import androidx.appcompat.app.AppCompatActivity;

import android.os.Bundle;

import android.content.Intent;
import android.graphics.Bitmap;
import android.graphics.BitmapFactory;
import android.net.Uri;
import android.util.Log;
import android.view.View;
import android.widget.Button;
import android.widget.ImageView;

import org.opencv.android.OpenCVLoader;
import org.opencv.android.Utils;
import org.opencv.core.CvType;
import org.opencv.core.Mat;
import org.opencv.core.Point;
import org.opencv.imgproc.Imgproc;

import java.io.File;
import java.io.FileOutputStream;
import java.io.IOException;
import java.io.InputStream;

import org.opencv.core.MatOfRect;
import org.opencv.core.Rect;
import org.opencv.core.Scalar;
import org.opencv.core.Size;
import org.opencv.objdetect.CascadeClassifier;

import android.content.Context;

public class MainActivity extends AppCompatActivity {

    private double max_size = 1024;
    private int PICK_IMAGE_REQUEST = 1;
    private ImageView myImageView;
    private Bitmap selectbp;

    private static final String    TAG                 = "OCVSample::Activity";
    private static final Scalar    FACE_RECT_COLOR     = new Scalar(0, 255, 0, 255);
    public static final int        JAVA_DETECTOR       = 0;
    public static final int        NATIVE_DETECTOR     = 1;

    private Mat                    mGray;
    private File                   mCascadeFile;
    private CascadeClassifier      mJavaDetector,mNoseDetector;

    private int                    mDetectorType       = JAVA_DETECTOR;

    private float                  mRelativeFaceSize   = 0.2f;
    private int                    mAbsoluteFaceSize   = 0;

    @Override
    protected void onCreate(Bundle savedInstanceState) {
        super.onCreate(savedInstanceState);
        setContentView(R.layout.activity_main);
        staticLoadCVLibraries();
        myImageView = (ImageView)findViewById(R.id.imageView);
        myImageView.setScaleType(ImageView.ScaleType.FIT_CENTER);
        Button selectImageBtn = (Button)findViewById(R.id.select_btn);
        selectImageBtn.setOnClickListener(new View.OnClickListener() {
            @Override
            public void onClick(View v) {
                // makeText(MainActivity.this.getApplicationContext(), "start to browser image", Toast.LENGTH_SHORT).show();
                selectImage();
            }

            private void selectImage() {
                Intent intent = new Intent();
                intent.setType("image/*");
                intent.setAction(Intent.ACTION_GET_CONTENT);
                startActivityForResult(Intent.createChooser(intent,"選擇圖像..."), PICK_IMAGE_REQUEST);
            }
        });

        Button processBtn = (Button)findViewById(R.id.process_btn);
        processBtn.setOnClickListener(new View.OnClickListener() {
            @Override
            public void onClick(View v) {
                // makeText(MainActivity.this.getApplicationContext(), "hello, image process", Toast.LENGTH_SHORT).show();
                convertGray();
            }
        });

    }

    private void staticLoadCVLibraries() {
        boolean load = OpenCVLoader.initDebug();
        if(load) {
            Log.i("CV", "Open CV Libraries loaded...");
        }

    }

    private void convertGray() {
        Mat src = new Mat();
        Mat temp = new Mat();
        Mat dst = new Mat();
        Utils.bitmapToMat(selectbp, src);
        Imgproc.cvtColor(src, temp, Imgproc.COLOR_BGRA2BGR);
        Log.i("CV", "image type:" + (temp.type() == CvType.CV_8UC3));
        Imgproc.cvtColor(temp, dst, Imgproc.COLOR_BGR2GRAY);
        Utils.matToBitmap(dst, selectbp);
        myImageView.setImageBitmap(selectbp);

        mGray = dst;
        mJavaDetector = loadDetector(R.raw.lbpcascade_frontalface,"lbpcascade_frontalface.xml");
        mNoseDetector = loadDetector(R.raw.haarcascade_mcs_nose,"haarcascade_mcs_nose.xml");

        if (mAbsoluteFaceSize == 0) {
            int height = mGray.rows();
            if (Math.round(height * mRelativeFaceSize) > 0) {
                mAbsoluteFaceSize = Math.round(height * mRelativeFaceSize);
            }
        }

        MatOfRect faces = new MatOfRect();

        if (mJavaDetector != null) {
            mJavaDetector.detectMultiScale(mGray, faces, 1.1, 2, 2, // TODO: objdetect.CV_HAAR_SCALE_IMAGE
                        new Size(mAbsoluteFaceSize, mAbsoluteFaceSize), new Size());

        }

        Rect[] facesArray = faces.toArray();
        for (int i = 0; i < facesArray.length; i++) {

            Log.e(TAG, "start to detect nose!");

            Mat faceROI = mGray.submat(facesArray[i]);

            MatOfRect noses = new MatOfRect();
            mNoseDetector.detectMultiScale(faceROI, noses, 1.1, 2, 2,
                    new Size(30, 30));

            Rect[] nosesArray = noses.toArray();
            Imgproc.rectangle(src,
                    new Point(facesArray[i].tl().x + nosesArray[0].tl().x, facesArray[i].tl().y + nosesArray[0].tl().y) ,
                    new Point(facesArray[i].tl().x + nosesArray[0].br().x, facesArray[i].tl().y + nosesArray[0].br().y) ,
                    FACE_RECT_COLOR, 3);

            Imgproc.rectangle(src, facesArray[i].tl(), facesArray[i].br(), FACE_RECT_COLOR, 3);
        }

        Utils.matToBitmap(src, selectbp);
        myImageView.setImageBitmap(selectbp);

    }

    private CascadeClassifier loadDetector(int rawID,String fileName) {
        CascadeClassifier classifier = null;
        try {

            // load cascade file from application resources
            InputStream is = getResources().openRawResource(rawID);
            File cascadeDir = getDir("cascade", Context.MODE_PRIVATE);
            mCascadeFile = new File(cascadeDir, fileName);
            FileOutputStream os = new FileOutputStream(mCascadeFile);

            byte[] buffer = new byte[4096];
            int bytesRead;
            while ((bytesRead = is.read(buffer)) != -1) {
                os.write(buffer, 0, bytesRead);
            }
            is.close();
            os.close();

            Log.e(TAG, "start to load file:  " + mCascadeFile.getAbsolutePath());
            classifier = new CascadeClassifier(mCascadeFile.getAbsolutePath());

            if (classifier.empty()) {
                Log.e(TAG, "Failed to load cascade classifier");
                classifier = null;
            } else
                Log.i(TAG, "Loaded cascade classifier from " + mCascadeFile.getAbsolutePath());

            cascadeDir.delete();


        } catch (IOException e) {
            e.printStackTrace();
            Log.e(TAG, "Failed to load cascade. Exception thrown: " + e);
        }
        return classifier;
    }

    @Override
    protected void onActivityResult(int requestCode, int resultCode, Intent data) {
        super.onActivityResult(requestCode, resultCode, data);
        if (requestCode == PICK_IMAGE_REQUEST && resultCode == RESULT_OK && data != null && data.getData() != null) {
            Uri uri = data.getData();
            try {
                Log.d("image-tag", "start to decode selected image now...");
                InputStream input = getContentResolver().openInputStream(uri);
                BitmapFactory.Options options = new BitmapFactory.Options();
                options.inJustDecodeBounds = true;
                BitmapFactory.decodeStream(input, null, options);
                int raw_width = options.outWidth;
                int raw_height = options.outHeight;
                int max = Math.max(raw_width, raw_height);
                int newWidth = raw_width;
                int newHeight = raw_height;
                int inSampleSize = 1;
                if (max > max_size) {
                    newWidth = raw_width / 2;
                    newHeight = raw_height / 2;
                    while ((newWidth / inSampleSize) > max_size || (newHeight / inSampleSize) > max_size) {
                        inSampleSize *= 2;
                    }
                }

                options.inSampleSize = inSampleSize;
                options.inJustDecodeBounds = false;
                options.inPreferredConfig = Bitmap.Config.ARGB_8888;
                selectbp = BitmapFactory.decodeStream(getContentResolver().openInputStream(uri), null, options);

                myImageView.setImageBitmap(selectbp);

            } catch (Exception e) {
                e.printStackTrace();
            }
        }
    }
}