ROS下使用intel Realsense摄像头进行人脸检测

2023-05-16

使用准备条件:

ROS-indigo

intel Realsense摄像头(我使用的依旧是R200)

确保已经正常安装驱动,安装方法见博文

http://blog.csdn.net/may0324/article/details/50981540


1.首先到github下载ros-realsense源码包,该包包含已经定义好的packages和nodes

https://github.com/intel-ros/realsense

2.新建工作区目录,如

mkdir workspace

3.进入创建的工作区目录,病创建文件目录,命名为src

cd workspace
mkdir src
4.进入src目录,并将下载包中的camera解压到此目录内

5.部署完成后就可以编译了,在workspace目录下执行命令

catkin_make
6.编译成功后,执行
source devel/setup.bash
这个自动生成的脚本文件设置了若干环境变量,从而使 ROS 能够找到你创建的功能包和新生成的可执行文件

7.完成后就可以执行包中自带的launch文件打开摄像头了

roslaunch realsense_camera realsense_r200_nodelet_standalone_preset.launch 

启动后发现摄像头灯亮起,表明在工作,然而并没有什么新奇的东西发生,这是为什么呢?

其实是因为该节点只是在不断的发布消息(就是不同形式的图像信息,如RGB,红外,深度,点云等),但是并没有节点订阅该消息,所以为了观看摄像头拍摄的图像,我们需要再写一个节点订阅该消息,并将图像显示出来,接着再进行人脸检测等后续功能。为了以后功能拓展方便,我们直接写个新的功能包(package)。

这里我们定义的场景是,该功能节点订阅realsense发布的图像消息,解码并显示出来,同时调用OpenCV的haar分类器进行人脸检测,并将检测到的人脸封装成消息发布出去,所以这个节点本身是个订阅者(subscriber),同时也是个发布者(publisher)。

1.进入workspace的src目录内,创建包目录

catkin_create_pkg client std_msgs rospy roscpp
这里面 std_msgs rospy roscpp 是我们通常一个最基本的C++包之中需要的依赖项。后面这些依赖项均可以通过配置 package.xml 进行更改

2.进入创建的包client目录中,创建msg文件夹,并创建需要发布的人脸消息文件facebox.msg和faces.msg:

facebox.msg

uint16 top
uint16 left
uint16 width
uint16 height

faces.msg

facebox[] face_boxes
uint16 image_width
uint16 image_height

3. 进入client/src目录中,创建主程序文件client.cpp,并写入如下内容

#include <ros/ros.h>
#include <image_transport/image_transport.h>
#include <cv_bridge/cv_bridge.h>
#include <sensor_msgs/image_encodings.h>
#include <opencv2/objdetect/objdetect.hpp>
#include <opencv2/imgproc/imgproc.hpp>
#include <opencv2/highgui/highgui.hpp>
#include <std_msgs/String.h>

#include <client/faces.h>
#include <client/facebox.h>

using namespace std;
using namespace cv ;

CascadeClassifier face_cascade ;
bool showResult = true ;
ros::Publisher pub;
int frame_id = 0 ;

vector<Rect> detectFaces(Mat frame) {
    vector<Rect> faces;
    Mat bufferMat;
    cvtColor(frame, bufferMat, COLOR_BGR2GRAY);
    equalizeHist(bufferMat, bufferMat);
    face_cascade.detectMultiScale(bufferMat, faces, 1.1, 2, 0 | CV_HAAR_SCALE_IMAGE, Size(30, 30));
    return faces;
}

void imageCB(const sensor_msgs::ImageConstPtr& msg) {
    cv_bridge::CvImagePtr cvPtr;
    try {
        cvPtr = cv_bridge::toCvCopy(msg, sensor_msgs::image_encodings::BGR8);
    } catch (cv_bridge::Exception& e) {
        ROS_ERROR("cv_bridge exception: %s", e.what());
        return;
    }

    vector<Rect> faces = detectFaces(cvPtr->image);
    client::faces faces_msg;
    client::facebox _facebox;
    faces_msg.image_width = cvPtr->image.cols;
    faces_msg.image_height = cvPtr->image.rows;

    for (int i = 0; i < faces.size(); i++) {
        _facebox.top = faces[i].y;
        _facebox.left = faces[i].x;
        _facebox.width = faces[i].width;
        _facebox.height = faces[i].height;
        faces_msg.face_boxes.push_back(_facebox);
        if (showResult)
            rectangle(cvPtr->image, faces[i], CV_RGB(100, 100, 255), 1);
    } 
    
    frame_id++ ;

    pub.publish(faces_msg);
    if (showResult) {
        imshow("Live Feed", cvPtr->image);
        waitKey(3);
    }
}


int main(int argc, char **argv) {
   face_cascade.load("/usr/share/opencv/haarcascades/haarcascade_frontalface_alt.xml");
    ros::init(argc, argv, "client");
    ros::NodeHandle nh;
    nh.param("/client/showResult", showResult, true);
    pub = nh.advertise<client::faces>("/faces", 5);
    ros::Subscriber sub = nh.subscribe("/camera/color/image_raw", 1, imageCB);
    ros::spin();
}

4.修改package.xml,添加所需依赖项

<buildtool_depend>catkin</buildtool_depend>
<build_depend>roscpp</build_depend>
<build_depend>rospy</build_depend>
<build_depend>std_msgs</build_depend>
<build_depend>cv_bridge</build_depend>
<build_depend>image_transport</build_depend>
<build_depend>message_generation</build_depend>
<build_depend>sensor_msgs</build_depend>
<build_depend>realsense_camera</build_depend>
<run_depend>cv_bridge</run_depend>
<run_depend>image_transport</run_depend>
<run_depend>roscpp</run_depend>
<run_depend>rospy</run_depend>
<run_depend>std_msgs</run_depend>
<run_depend>sensor_msgs</run_depend>
<run_depend>message_runtime</run_depend>
<run_depend>realsense_camera</run_depend>
其中的realsense_camera就是我们要依赖的realsen_camera库

5.修改CMakeLists.txt,文件内容如下

cmake_minimum_required(VERSION 2.8.3)
project(client)

## Find catkin macros and libraries
## if COMPONENTS list like find_package(catkin REQUIRED COMPONENTS xyz)
## is used, also find other catkin packages
find_package(catkin REQUIRED COMPONENTS
  cv_bridge
  image_transport
  roscpp
  rospy
  std_msgs
  sensor_msgs
  message_generation
  realsense_camera
)
find_package(OpenCV REQUIRED)
## System dependencies are found with CMake's conventions
# find_package(Boost REQUIRED COMPONENTS system)


## Uncomment this if the package has a setup.py. This macro ensures
## modules and global scripts declared therein get installed
## See http://ros.org/doc/api/catkin/html/user_guide/setup_dot_py.html
# catkin_python_setup()

################################################
## Declare ROS messages, services and actions ##
################################################

## To declare and build messages, services or actions from within this
## package, follow these steps:
## * Let MSG_DEP_SET be the set of packages whose message types you use in
##   your messages/services/actions (e.g. std_msgs, actionlib_msgs, ...).
## * In the file package.xml:
##   * add a build_depend tag for "message_generation"
##   * add a build_depend and a run_depend tag for each package in MSG_DEP_SET
##   * If MSG_DEP_SET isn't empty the following dependency has been pulled in
##     but can be declared for certainty nonetheless:
##     * add a run_depend tag for "message_runtime"
## * In this file (CMakeLists.txt):
##   * add "message_generation" and every package in MSG_DEP_SET to
##     find_package(catkin REQUIRED COMPONENTS ...)
##   * add "message_runtime" and every package in MSG_DEP_SET to
##     catkin_package(CATKIN_DEPENDS ...)
##   * uncomment the add_*_files sections below as needed
##     and list every .msg/.srv/.action file to be processed
##   * uncomment the generate_messages entry below
##   * add every package in MSG_DEP_SET to generate_messages(DEPENDENCIES ...)

## Generate messages in the 'msg' folder
 add_message_files(
   FILES
#   Message1.msg
   facebox.msg
   faces.msg
 )

## Generate services in the 'srv' folder
# add_service_files(
#   FILES
#   Service1.srv
#   Service2.srv
# )

## Generate actions in the 'action' folder
# add_action_files(
#   FILES
#   Action1.action
#   Action2.action
# )

## Generate added messages and services with any dependencies listed here
 generate_messages(
   DEPENDENCIES
   std_msgs
   geometry_msgs
 )

################################################
## Declare ROS dynamic reconfigure parameters ##
################################################

## To declare and build dynamic reconfigure parameters within this
## package, follow these steps:
## * In the file package.xml:
##   * add a build_depend and a run_depend tag for "dynamic_reconfigure"
## * In this file (CMakeLists.txt):
##   * add "dynamic_reconfigure" to
##     find_package(catkin REQUIRED COMPONENTS ...)
##   * uncomment the "generate_dynamic_reconfigure_options" section below
##     and list every .cfg file to be processed

## Generate dynamic reconfigure parameters in the 'cfg' folder
# generate_dynamic_reconfigure_options(
#   cfg/DynReconf1.cfg
#   cfg/DynReconf2.cfg
# )

###################################
## catkin specific configuration ##
###################################
## The catkin_package macro generates cmake config files for your package
## Declare things to be passed to dependent projects
## INCLUDE_DIRS: uncomment this if you package contains header files
## LIBRARIES: libraries you create in this project that dependent projects also need
## CATKIN_DEPENDS: catkin_packages dependent projects also need
## DEPENDS: system dependencies of this project that dependent projects also need
catkin_package(
  #INCLUDE_DIRS include
  #LIBRARIES client
  #CATKIN_DEPENDS roscpp rospy std_msgs
  #DEPENDS system_lib
  CATKIN_DEPENDS message_runtime
)

###########
## Build ##
###########

## Specify additional locations of header files
## Your package locations should be listed before other locations
# include_directories(include)
include_directories(
  ${catkin_INCLUDE_DIRS}
  ${OpenCV_INCLUDE_DIRS}
)

## Declare a C++ library
# add_library(client
#   src/${PROJECT_NAME}/client.cpp
# )

## Add cmake target dependencies of the library
## as an example, code may need to be generated before libraries
## either from message generation or dynamic reconfigure
# add_dependencies(client ${${PROJECT_NAME}_EXPORTED_TARGETS} ${catkin_EXPORTED_TARGETS})

## Declare a C++ executable
# add_executable(client_node src/client_node.cpp)

## Add cmake target dependencies of the executable
## same as for the library above
# add_dependencies(client_node ${${PROJECT_NAME}_EXPORTED_TARGETS} ${catkin_EXPORTED_TARGETS})

## Specify libraries to link a library or executable target against
# target_link_libraries(client_node
#   ${catkin_LIBRARIES}
# )

#############
## Install ##
#############

# all install targets should use catkin DESTINATION variables
# See http://ros.org/doc/api/catkin/html/adv_user_guide/variables.html

## Mark executable scripts (Python etc.) for installation
## in contrast to setup.py, you can choose the destination
# install(PROGRAMS
#   scripts/my_python_script
#   DESTINATION ${CATKIN_PACKAGE_BIN_DESTINATION}
# )

## Mark executables and/or libraries for installation
# install(TARGETS client client_node
#   ARCHIVE DESTINATION ${CATKIN_PACKAGE_LIB_DESTINATION}
#   LIBRARY DESTINATION ${CATKIN_PACKAGE_LIB_DESTINATION}
#   RUNTIME DESTINATION ${CATKIN_PACKAGE_BIN_DESTINATION}
# )

## Mark cpp header files for installation
# install(DIRECTORY include/${PROJECT_NAME}/
#   DESTINATION ${CATKIN_PACKAGE_INCLUDE_DESTINATION}
#   FILES_MATCHING PATTERN "*.h"
#   PATTERN ".svn" EXCLUDE
# )

## Mark other files for installation (e.g. launch and bag files, etc.)
# install(FILES
#   # myfile1
#   # myfile2
#   DESTINATION ${CATKIN_PACKAGE_SHARE_DESTINATION}
# )

#############
## Testing ##
#############

## Add gtest based cpp test target and link libraries
# catkin_add_gtest(${PROJECT_NAME}-test test/test_client.cpp)
# if(TARGET ${PROJECT_NAME}-test)
#   target_link_libraries(${PROJECT_NAME}-test ${PROJECT_NAME})
# endif()

## Add folders to be run by python nosetests
# catkin_add_nosetests(test)

add_executable(
	client
	src/client.cpp
)
target_link_libraries(
	client
	${catkin_LIBRARIES}
	${OpenCV_LIBS}
)
6.最后最重要的是修改realsense的camera目录下的CMakeLists.txt文件,因为原文件并没有生成别的功能包所能使用的库,所以如果不修改,由于功能包间是独立的,client功能包将找不到realsense_camera功能包,从而编译错误。红字为添加的部分

find_package(PkgConfig REQUIRED)

add_service_files(
  FILES
  cameraConfiguration.srv
)

#add dynamic reconfigure api
generate_dynamic_reconfigure_options(
  cfg/camera_params.cfg
)

#此段很重要,表明要生成别的功能包所能使用的库
catkin_package(
#  INCLUDE_DIRS include
  LIBRARIES ${PROJECT_NAME}
)


include_directories(
  ${catkin_INCLUDE_DIRS}
)

add_library(realsense_camera src/realsense_camera_nodelet.cpp)
target_link_libraries(realsense_camera
  ${catkin_LIBRARIES}
  /usr/local/lib/librealsense.so
)
add_dependencies(realsense_camera realsense_camera_generate_messages_cpp ${PROJECT_NAME}_gencfg)

7.全部修改完成后,编译。在client目录中新建launch目录,并在该目录中新建一个.launch文件,名字随便起,内容则是同时启动realsense_camera的节点和client的节点,内容如下:

<launch>

	<arg name="mode" default="preset" />
	<arg name="enable_depth" default="true" />
	<arg name="enable_color" default="true" />
	<arg name="enable_pointcloud" default="true" />
	<arg name="enable_tf" default="true" />		
	
  	<node pkg="nodelet" type="nodelet" name="standalone_nodelet"  args="manager" output="screen"/>
  	
    <node pkg="nodelet" type="nodelet" name="RealsenseNodelet"
        args="load realsense_camera/RealsenseNodelet standalone_nodelet">
        <param name="mode"              type="str"  value="$(arg mode)" />
        <param name="enable_depth"      type="bool" value="$(arg enable_depth)" />
        <param name="enable_color"      type="bool" value="$(arg enable_color)" />
        <param name="enable_pointcloud" type="bool" value="$(arg enable_pointcloud)" />
        <param name="enable_tf"         type="bool" value="$(arg enable_tf)" />
    </node>

  	<node pkg="client" type="client" name="clientnode"  output="screen">
          <param name="showResult" value="true"/> 
        </node>
</launch> 
8.最后别忘了source devel/setup.bash。然后就可以启动啦
roslaunch client detectface.launch


本文内容由网友自发贡献,版权归原作者所有,本站不承担相应法律责任。如您发现有涉嫌抄袭侵权的内容,请联系:hwhale#tublm.com(使用前将#替换为@)

ROS下使用intel Realsense摄像头进行人脸检测 的相关文章

  • SSL单向认证详细流程

    SSL 单向认证流程如下 xff1a 1 拿到申请到的证书后 xff0c 需要安装到服务器中 3 客户端向服务器发送接入请求 4 服务器将证书发送给客户端 5 客户端开始对证书进行认证 xff0c 认证过程如下 在证书中获取证书的颁发机构字

随机推荐

  • 《自己动手写Docker》书摘之三---Union File System介绍

    Union File System UnionFS unionfs是一种为Linux xff0c FreeBSD和NetBSD操作系统设计的把其他文件系统联合到一个联合挂载点的文件系统服务 它使用branch把不同文件系统的文件和目录 透明
  • 【无人机】基于Matlab实现复杂三维地形的无人机路径规划问题

    作者简介 xff1a 热爱科研的Matlab仿真开发者 xff0c 修心和技术同步精进 xff0c matlab项目合作可私信 x1f34e 个人主页 xff1a Matlab科研工作室 x1f34a 个人信条 xff1a 格物致知 更多M
  • 【LSTM分类】基于卷积神经网络结合长短时记忆LSTM实现数据分类含Matlab源码

    作者简介 xff1a 热爱科研的Matlab仿真开发者 xff0c 修心和技术同步精进 xff0c matlab项目合作可私信 x1f34e 个人主页 xff1a Matlab科研工作室 x1f34a 个人信条 xff1a 格物致知 更多M
  • ardupilot飞控源码框架认识

    ardupilot飞控源码框架认识 转载 xff1a https blog csdn net csshuke article details 78850898 希望对更多的人有帮助 此篇blog的目的是对px4工程有一个整体认识 xff0c
  • 使用VSCode打造APM飞控的编译+烧录+调试一体的终极开发环境

    版权声明 xff1a 本文为博主原创文章 xff0c 遵循 CC 4 0 BY SA 版权协议 xff0c 转载请附上原文出处链接和本声明 本文链接 xff1a https blog csdn net loveuav article det
  • APM-mavlink添加消息和命令

    Mavlink资源 https mavlink io en url 61 git github com ArduPilot mavlink 事先准备好消息和命令内容 1 DO OPEN SPRAY 33002 命令实例 字段 数据类型 值
  • APM多旋翼参数

    持续更新中 ABPS AB点模式 ABPS ENABLE 1 ABPS LINE NUM 1 ABPS SPRAYER EN 1 ABPS WP DELAY 1 ACRO Acro特技模式 ACRO RP P 4 5 ACRO Y EXPO
  • APM-MP日志分析参数索引

    MP日志分析参数索引 通过 ctrl 43 F 查找获取需要对应参数信息 AP Logger 64 LoggerMessage ADSB ADSB 64 Description Automatic Dependent Serveillanc
  • 百度2014校园招聘研发工程师笔试题+答案

    一 xff0c 简答题 30分 1 xff0c 当前计算机系统一般会采用层次结构存储数据 xff0c 请介绍下典型计算机存储系统一般分为哪几个层次 xff0c 为什么采用分层存储数据能有效提高程序的执行效率 xff1f 10分 xff08
  • 教大家看官方技术文档(一)- Spring MVC

    每当学习一门新技术时候 xff0c 大部分人直接就是百度Bing搜索 xff0c 借鉴别人的博客例子等 我也是一样 xff0c 但是我经常想 xff0c 这些牛人的例子如何写出来的 xff0c 如何深入扩展其它功能等等 所以 xff0c 我
  • OpenCv学习笔记(二)--Mat矩阵(图像容器)的创建及CV_8UC1,CV_8UC2等参数详解

    xff08 一 xff09 Mat矩阵 图像容器 创建时CV 8UC1 CV 8UC2等参数详解 1 Mat不但是一个非常有用的图像容器类 同时也是一个通用的矩阵类 2 创建一个Mat对象的方法很多 我们现在先看一下Mat矩阵 图像容器类在
  • IP地址和MAC地址的作用和相互关系

    IP地址和MAC地址的作用和相互关系 关于IP地址和MAC地址相互关系以及数据包在网络中的寻址过程 xff0c 这两天盘了一下 xff0c 十多年前的计算机网络课程 xff0c 还是没有完全忘记的 概念说明 xff1a MAC地址 xff1
  • git commit –amend命令修改comment

    当git commit m your comment 后 xff0c 想修改提交后的comment xff0c 可以使用git commit amend命令 1 git commit amend xff0c 会出现上一次提交时的commen
  • php 设置允许跨域请求

    php 设置允许跨域请求 跨域 xff0c 指的是浏览器不能执行其他网站的脚本 它是由浏览器的同源策略造成的 xff0c 是浏览器施加的安全限制 同源策略 xff1a 是指域名 xff0c 协议 xff0c 端口均相同 xff0c 有任一不
  • TortoiseGit-git工具

    git小乌龟 git工具 xff0c 贼好用 下载地址 Download TortoiseGit Windows Shell Interface to Git
  • FAST-LIO, ikd-Tree, FAST-LIO2, FASTER-LIO论文总结

    目录 一 FAST LIO 本文的三个创新点 xff1a FAST LIO框架 二 ikd Tree 三 FAST LIO2 四 FASTER LIO 一 FAST LIO FAST LIO三个创新点 xff1a 将IMU和雷达点特征点紧耦
  • Realsense D435i运行ORB-SLAM3

    ORB SLAM3 根目录下的CMakeList txt opencv版本改为3 xff0c 目的是与ROS下的CMakeList txt指定的opencv版本相同 xff0c 都为3 否则会段错误 build sh build ros s
  • VINS-Fusion运行相关

    如何安装VINS Fusion 根据网址安装 xff1a https github com HKUST Aerial Robotics VINS Fusion 先装ceres xff08 网址中的改成 xff1a sudo make ins
  • jetson xavier nx 上 bash: nvcc: command not found

    jetson Xavier nx上已经默认安装好了cuda cuda 10 2和cudnn等 出现这个问题是因为 我们需要把cuda目录下的bin文件添加到环境变量中 解决方案 vim bashrc 按 i 进入输入模式 xff0c 在最后
  • ROS下使用intel Realsense摄像头进行人脸检测

    使用准备条件 xff1a ROS indigo intel Realsense摄像头 xff08 我使用的依旧是R200 xff09 确保已经正常安装驱动 xff0c 安装方法见博文 http blog csdn net may0324 a