使用C#对华为IPC摄像头二次开发(一)

使用C#对华为IPC摄像头二次开发(二)请访问:https://www.cnblogs.com/wdw984/p/13572644.html

开发环境:

操作系统:Win10 x64专业版2004

开发工具:VS2019 16.7.2

目标平台:x86,因为要操作内存,所以要打开允许非安全代码(项目属性==》生成==》勾选允许不安全代码)

首先去下载IPC SDK(点击下载,需要华为授权账户。)

新建一个WPF的项目,Framework版本为4.7

把下载的sdk压缩包中的windows\output32目录中的HWPuSDK.dll和lib目录中的所有文件,都复制到项目的bin/debug目录中(和生成的exe同级),华为的这个SDK对64位支持不好,使用64位遇到不少问题,最终还是先采用32位的DLL。

项目中对图像的手动处理,经过对比,在Emgu CV和OpenCVSharp4中采用了OpenCVSharp4,个人感觉OpenCVSharp4使用起来更简洁方便。

项目中对视频流的回调手动处理展示,采用WriteableBitmap(参考吕毅大神的《WPF 高性能位图渲染 WriteableBitmap 及其高性能用法示例》),本来想采用D3D这种显卡加速的方法,无奈没有找到相关文章和资料,如果哪位大神有资料,还望告知一下。谢谢!

项目中引用了以下组件

在本次开发中,我们先实现自动预览摄像头视频和手动对摄像头视频流进行处理。

因为SDK自动播放需要传入一个控件的句柄,而WPF中窗体上所有控件的句柄都是窗体本身,所以我们还需要使用WindowsFromHost来使用Winform的一些控件来实现播放句柄的传入。

项目中引用WindowsFromsIntegeration

在项目的MainWindow.xaml中添加三个按钮、两个RadioButton、一个Winform的PictureBox和一个WPF的Image控件。大致布局如下:

详细的xaml代码:

<Window x:Class="HuaWeiCamera.MainWindow"
        xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
        xmlns:d="http://schemas.microsoft.com/expression/blend/2008"
        xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
        xmlns:mc="http://schemas.openxmlformats.org/markup-compatibility/2006"
        xmlns:wf="clr-namespace:System.Windows.Forms;assembly=System.Windows.Forms"
        mc:Ignorable="d"
        WindowStartupLocation="CenterScreen"
        Loaded="MainWindow_OnLoaded"
        Title="MainWindow" Height="800" Width="1200" Closed="MainWindow_OnClosed">
    <Grid Margin="0,0,2,0">
        <Grid.RowDefinitions>
            <RowDefinition Height="60"></RowDefinition>
            <RowDefinition Height="*"></RowDefinition>
        </Grid.RowDefinitions>
        <WrapPanel VerticalAlignment="Center">
            <StackPanel Margin="30,5,0,0" VerticalAlignment="Center">
                <Button Content="预览摄像头" HorizontalAlignment="Center" VerticalAlignment="Center" Width="75" Height="30" Click="ButtonView_OnClick" />
                <WrapPanel Margin="0,5,0,0">
                    <RadioButton Content="自动处理" VerticalAlignment="Center" IsChecked="True" GroupName="PlayMode" x:Name="RadioButtonAuto" />
                    <RadioButton Content="手动处理" VerticalAlignment="Center" GroupName="PlayMode" x:Name="RadioButtonManual" Margin="10,0,0,0" />
                </WrapPanel>
            </StackPanel>
            <Button x:Name="ButtonSaveOne" Content="抓拍一张" HorizontalAlignment="Left" VerticalAlignment="Center" Margin="30,0,0,0" Width="75" Height="30" IsEnabled="False" Click="ButtonSave_OnClick" />
<Button Content="人脸抓拍" HorizontalAlignment="Left" VerticalAlignment="Center" Margin="30,0,0,0" Width="75" Height="30" />
</WrapPanel> <WrapPanel Grid.Row="1"> <WindowsFormsHost HorizontalAlignment="Center" Width="1200" Height="700" VerticalAlignment="Center" x:Name="FormsHostVideo"> <wf:PictureBox x:Name="ImagePlay"></wf:PictureBox> </WindowsFormsHost> <Image VerticalAlignment="Center" HorizontalAlignment="Center" x:Name="CanvaVideo" Stretch="Fill" Source="{Binding Path=VideoWriteableBitmap}" /> </WrapPanel> </Grid> </Window>

在App.cs中定义下日志记录类

    public partial class App : Application
    {
        public static NLog.Logger NewNLog;
        private void App_OnStartup(object sender, StartupEventArgs e)
        {
            DispatcherUnhandledException += App_DispatcherUnhandledException;
            NewNLog = NLog.LogManager.GetLogger("HuaWeiCameraLoger");
        }
    }

根据华为的《SDC 8.0.1 SDK开发指南》,我们要实现摄像头预览,需要先定义以下几个struct和enum:

sturct:PU_REAL_PLAY_INFO_S(视频实时预览结构体)、PU_TIME_S(时间结构体)

enum:PU_PROTOCOL_TYPE(传输协议类型)、PU_STREAM_TYPE(码流类型)、PU_VIDEO_TYPE(数据流类型)、PU_MEDIA_CRYPTO_TYPE(加密类型)、PU_MEDIA_CALLBACK_TYPE(回调类型)

using System;
using System.Runtime.InteropServices;
using HuaWeiCamera.Enums;
using HuaWeiCamera.Enums.Media;
using HuaWeiCamera.Enums.Video;

namespace HuaWeiCamera.Struct
{
    /// <summary>
    /// 视频实时预览结构体,http://www.cnblogs.com/wdw984
    /// </summary>
    [StructLayout(LayoutKind.Sequential, CharSet = CharSet.Ansi, Pack = 1)]
    public struct PU_REAL_PLAY_INFO_S
    {
        /// <summary>
        /// 设备通道号,一般为101。
        /// </summary>
        public uint ulChannelId;
        /// <summary>
        /// 播放窗口句柄,为IntPtr.Zero表示用户自己处理视频数据流,不自动播放视频流
        /// </summary>
        public IntPtr hPlayWnd;
        /// <summary>
        /// 码流类型,主码流、子码
        /// </summary>
        public PU_STREAM_TYPE enStreamType;
        /// <summary>
        /// 流类型:视频流、音频流、复合流、录 像流、元数据
        /// </summary>
        public PU_VIDEO_TYPE enVideoType;
        /// <summary>
        /// 传输协议类型,UDP,TCP
        /// </summary>
        public PU_PROTOCOL_TYPE enProtocolType;
        /// <summary>
        /// 回调类型:0:RTP解密1:RTP不解密 2:Frame 3:YUV
        /// </summary>
        public PU_MEDIA_CALLBACK_TYPE enMediaCallbackType;
        /// <summary>
        /// 请求端IP,第三方平台可以不填,SDK会 自动获取
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 16)]
        public string szLocalIp;
        /// <summary>
        /// 是否保活
        /// </summary>
        public bool bKeepLive;
        /// <summary>
        /// 请求预录、录像开始时间(本地时 间)。 
        /// </summary>
        public PU_TIME_S stStartTime;
        /// <summary>
        /// 请求预录、录像结束时间(本地时 间)。 
        /// </summary>
        public PU_TIME_S stEndTime;
        /// <summary>
        /// 加密类型,只支持AES加密。
        /// </summary>
        public PU_MEDIA_CRYPTO_TYPE enMediaCryptoType;
        /// <summary>
        /// 加密密钥
        /// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 44)]
        public string szMediaCrypto;
        /// <summary>
        /// szReserved[0-15]表示组播IP地址
        /// szReserved[16-19]表示组播端口
        /// szReserved[22]表示智能分析数据打包 格式 0:XML,1:元数据
        /// szReserved[23]表示元数据请求类型,取值参考枚举 PU_METADATA_REQUEST_TYPE_E定义
        /// </summary>
        [MarshalAs(UnmanagedType.ByValArray, SizeConst = 32)]
        public byte[] szReserved;
    }
}
namespace HuaWeiCamera.Enums
{
    /// <summary>
    /// 视频流类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_STREAM_TYPE
    {
        /// <summary>
        /// 视频主码流
        /// </summary>
        PU_VIDEO_MAIN_STREAM=0,
        /// <summary>
        /// 视频子码流
        /// </summary>
        PU_VIDEO_SUB_STREAM1,
        /// <summary>
        /// 视频子码流2(VWareC01 不支持)
        /// </summary>
        PU_VIDEO_SUB_STREAM2,
        /// <summary>
        /// 视频子码流3(VWareC01 不支持)
        /// </summary>
        PU_VIDEO_SUB_STREAM3,
        /// <summary>
        /// 视频子码流4
        /// </summary>
        PU_VIDEO_SUB_STREAM4,
        /// <summary>
        /// 视频子码流5
        /// </summary>
        PU_VIDEO_SUB_STREAM5,
        /// <summary>
        /// 预留值
        /// </summary>
         PU_VIDEO_STREAM_MAX
    }
}
namespace HuaWeiCamera.Enums.Video
{
    /// <summary>
    /// 码流类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_VIDEO_TYPE
    {
        /// <summary>
        /// 视频流
        /// </summary>
        PU_VIDEO_TYPE_VIDEO = 0,
        /// <summary>
        /// 音频流
        /// </summary>
        PU_VIDEO_TYPE_AUDIO,
        /// <summary>
        /// 复合流
        /// </summary>
        PU_VIDEO_TYPE_MUX, 
        /// <summary>
        /// 录像流
        /// </summary>
        PU_VIDEO_TYPE_RECORD, 
        /// <summary>
        /// 元数据流
        /// </summary>
        PU_VIDEO_TYPE_META, 
        /// <summary>
        /// 视频+元数据流
        /// </summary>
        PU_VIDEO_TYPE_VIDEO_META, 
        /// <summary>
        /// 预留值
        /// </summary>
        PU_VIDEO_TYPE_MAX
    }
}
namespace HuaWeiCamera.Enums
{
    /// <summary>
    /// 数据传输类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_PROTOCOL_TYPE
    {
        /// <summary>
        /// UDP
        /// </summary>
        PU_PROTOCOL_TYPE_UDP = 0, 
        /// <summary>
        /// TCP
        /// </summary>
        PU_PROTOCOL_TYPE_TCP,
        /// <summary>
        /// 组播方式
        /// </summary>
        PU_PROTOCOL_TYPE_MULTICAST,
        /// <summary>
        /// 预留值
        /// </summary>
        PU_PROTOCOL_TYPE_MAX
    }
}
namespace HuaWeiCamera.Enums.Media
{
    /// <summary>
    /// 媒体回调类型,http://www.cnblogs.com/wdw984
    /// </summary>
    public enum PU_MEDIA_CALLBACK_TYPE
    {
        /// <summary>
        /// RTP包方式
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_RTP = 0, 
        /// <summary>
        /// RTP包形式,不解密
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_RTP_CRYPTO, 
        /// <summary>
        /// 帧回调方式
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_FRAME, 
        /// <summary>
        /// YUV方式,Linux不支持
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_YUV, 
        /// <summary>
        /// 把RTP包回调给控件方处理方式,Linux不支持
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_FOR_STORAGE, 
        /// <summary>
        /// 智能元数据方式
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_META_FRAME, 
        /// <summary>
        /// 预留值
        /// </summary>
        PU_MEDIA_CALLBACK_TYPE_MAX
    }
}
using System.Runtime.InteropServices;

namespace HuaWeiCamera.Struct
{
    /// <summary>
    /// 时间结构体,http://www.cnblogs.com/wdw984
    /// </summary>
    [StructLayout(LayoutKind.Sequential, CharSet = CharSet.Ansi, Pack = 1)]
    public struct PU_TIME_S
    {
        /// <summary>
        ////// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 5)]
        public string szYear;
        /// <summary>
        ////// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szMonth;
        /// <summary>
        ////// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szDay;
        /// <summary>
        ////// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szHour;
        /// <summary>
        ////// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szMinute;
        /// <summary>
        ////// </summary>
        [MarshalAs(UnmanagedType.ByValTStr, SizeConst = 3)]
        public string szSecond;
    }
}

定义一个静态类,用来实现调用SDK和摄像头交互(HuaWeiSDKHelper)

using System;
using System.Runtime.InteropServices;
using HuaWeiCamera.Enums;
using HuaWeiCamera.Enums.SnapShot;
using HuaWeiCamera.Struct;

namespace HuaWeiCamera.Class
{
    /// <summary>
    /// 华为HoloSens SDC二次开发使用,http://www.cnblogs.com/wdw984
    /// </summary>
    public static class HuaWeiSdkHelper
    {
        private const string SdkPath= "HWPuSDK.dll";
        #region 初始化和登录

        /// <summary>
        /// 初始化设备
        /// </summary>
        /// <param name="ulLinkMode">0自动 1手动 3混合模式</param>
        /// <param name="szLocalIp">本地IP</param>
        /// <param name="ulLocalPort">本地端口</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Init", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern bool IVS_Pu_Init(uint ulLinkMode, string szLocalIp, uint ulLocalPort);
        /// <summary>
        /// 远程登录设备
        /// </summary>
        /// <param name="szLoginIp">设备IP</param>
        /// <param name="ulLoginPort">设备端口 6060</param>
        /// <param name="szUserName">登录名 ApiAdmin</param>
        /// <param name="szPasswd">登录密码 HuaWei123</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Login", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern uint IVS_PU_Login(string szLoginIp, uint ulLoginPort, string szUserName, string szPasswd);

        /// <summary>
        /// 初始化和登录设备
        /// </summary>
        /// <param name="sdcIp">SDC设备IP</param>
        /// <param name="sdcPort">SDC设备端口</param>
        /// <param name="sdcUser">SDC登录用户名</param>
        /// <param name="sdcPwd">SDC登录密码</param>
        /// <param name="errMsg">失败时的错误信息</param>
        /// <param name="ulIdentifyId">登录成功后返回登录句柄</param>
        public static void InitAndLogin(string sdcIp,uint sdcPort,string sdcUser,string sdcPwd,out uint ulIdentifyId,out string errMsg)
        {
            ulIdentifyId = 0;
            errMsg = "";
            //要开启TLS的情况时:初始化调用IVS_PU_InitEx接口,登录调用IVS_PU_Login 接口时端口号设置为6061
            if (!IVS_Pu_Init(1, "192.168.2.144", 6060))
            {
                errMsg=($"设备初始化失败,{GetLastErrorInfo()}");
                return;
            }
            ulIdentifyId = IVS_PU_Login(sdcIp, sdcPort, sdcUser, sdcPwd);
            if (ulIdentifyId == 0)
            {
                errMsg=$"设备登录失败,{GetLastErrorInfo()}";
            }
        }

        #endregion

        #region 预览相关
        /// <summary>
        /// 实时预览
        /// </summary>
        /// <param name="ulIdentifyId">登录成功后返回的用户编号</param>
        /// <param name="pstRealPlayInfo">播放结构体</param>
        /// <param name="fRealDataCallBack">回调实现播放</param>
        /// <param name="pUsrData">传入码流数据 回调函数作为参数</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_RealPlay")]
        public static extern uint IVS_PU_RealPlay(uint ulIdentifyID, PU_REAL_PLAY_INFO_S[] pstRealPlayInfo, PfRealDataCallBack fRealDataCallBack, ref IntPtr pUsrData);

        public delegate void PfRealDataCallBack(IntPtr szBuffer, int lSize, IntPtr pUsrData);
        /// <summary>
        /// 停止实时预览
        /// </summary>
        /// <param name="ulIdentifyId">登录成功后返回的用户编号</param>
        /// <param name="ulRealHandle">实时播放句柄</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_StopRealPlay", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern uint IVS_PU_StopRealPlay(uint ulIdentifyId, uint ulRealHandle);
        #endregion

        #region 错误信息相关

        /// <summary>
        /// 获取最后一次错误代码
        /// </summary>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_GetLastError", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        private static extern int IVS_PU_GetLastError();

        /// <summary>
        /// 根据错误代码返回错误信息
        /// </summary>
        /// <param name="ulErrorNo">错误编号</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_GetErrorMsg", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        private static extern IntPtr IVS_PU_GetErrorMsg(int ulErrorNo);

        /// <summary>
        /// 返回最后一次错误码和错误信息
        /// </summary>
        /// <returns></returns>
        public static string GetLastErrorInfo()
        {
            var lastErrorCode = IVS_PU_GetLastError();
            var lastErrorMsg = Marshal.PtrToStringAnsi(IVS_PU_GetErrorMsg(lastErrorCode));

            return $"错误码:{IVS_PU_GetLastError()},错误信息:{lastErrorMsg}";
        }

        #endregion
        
        #region 退出登录

        /// <summary>
        /// 退出登录
        /// </summary>
        /// <param name="ulIdentifyId">登录成功后返回的句柄编号</param>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Logout", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern bool IVS_PU_Logout(uint ulIdentifyId);
        /// <summary>
        /// 反注册设备,退出时进行设备释放
        /// </summary>
        /// <returns></returns>
        [DllImport(SdkPath, EntryPoint = "IVS_PU_Cleanup", CharSet = CharSet.Ansi, SetLastError = true, PreserveSig = true, CallingConvention = CallingConvention.StdCall)]
        public static extern bool IVS_PU_Cleanup();

        #endregion

    }
}

定义一个继承了INotifyPropertyChanged的Model,用来实现刷新Image控件

    public class VideoYuvModelView : INotifyPropertyChanged
    {
        public event PropertyChangedEventHandler PropertyChanged;

        private WriteableBitmap bitmapImage { get; set; }

        public WriteableBitmap VideoWriteableBitmap
        {
            get => bitmapImage;
            set
            {
                bitmapImage = value;
                PropertyChanged?.Invoke(this,new PropertyChangedEventArgs("VideoBitmapImage"));
            }
        }
    }

在MainWindow.cs中我们需要定义一些变量:

        private uint _ulIdentifyId;//登录摄像头后返回的编号
        private uint _ulRealHandleId;//调用预览SDK返回的结果值
        private static bool _isSave;//是否保存当前帧为图片
        private static bool _isExit;//是否退出
private static HuaWeiSdkHelper.PfRealDataCallBack _fedRealPlayCallbackWithYUV;//手动处理摄像头回调时的委托事件
private const uint ByteLength = 1920 * 1080 * 4;//位图的大小 private static readonly VideoYuvModelView VideoYuvModelView = new VideoYuvModelView();//Image的数据源,用来手动处理视频时候展示图像 private IntPtr _videoPlayHandle = IntPtr.Zero;//自动预览时的控件句柄 [DllImport("kernel32.dll")] private static extern void CopyMemory(IntPtr destination, IntPtr source, uint length);//用来复制内存中的数据

在窗体初始化和加载事件中,我们来初始化一些数据的绑定

public MainWindow()
        {
            InitializeComponent();
            VideoYuvModelView.VideoWriteableBitmap = new WriteableBitmap(1920, 1800, 96.0, 96.0, PixelFormats.Bgr32, null);//因为摄像头返回的图片大小时1920*1080,所以这里定义的大小要和返回的图片大小一致
        }

        private void MainWindow_OnLoaded(object sender, RoutedEventArgs e)
        {
            CanvaVideo.DataContext = VideoYuvModelView;//手动处理时,Image控件数据源
            _videoPlayHandle = ImagePlay.Handle;//自动处理时,使用Winform的控件句柄
        }

预览摄像头按钮事件,中间根据选中的自动处理和手动处理来分别做出不同的相应

#region 视频预览(自动和手动处理视频流)

        private void ButtonView_OnClick(object sender, RoutedEventArgs e)
        {
            if (0 == _ulIdentifyId)
            {
//这里通过网络登录到摄像头,具体端口、用户名、密码请参考开发手册 HuaWeiSdkHelper.InitAndLogin(
"192.168.2.250", 6060, "ApiAdmin", "HuaWei123", out _ulIdentifyId, out string errMsg); if (0 == _ulIdentifyId) { MessageBox.Show(errMsg); return; } } var prpInfos = new PU_REAL_PLAY_INFO_S[1]; var clientInfo = new PU_REAL_PLAY_INFO_S { ulChannelId = 101, hPlayWnd = _videoPlayHandle, enProtocolType = PU_PROTOCOL_TYPE.PU_PROTOCOL_TYPE_TCP, enStreamType = PU_STREAM_TYPE.PU_VIDEO_MAIN_STREAM, enVideoType = PU_VIDEO_TYPE.PU_VIDEO_TYPE_VIDEO, enMediaCryptoType = PU_MEDIA_CRYPTO_TYPE.PU_MEDIA_CRYPTO_NONE, enMediaCallbackType = PU_MEDIA_CALLBACK_TYPE.PU_MEDIA_CALLBACK_TYPE_RTP, szReserved = new byte[32], bKeepLive = true }; IntPtr pUsrData = (IntPtr)_ulIdentifyId; if (RadioButtonManual.IsChecked == true) { //手动处理视频预览 FormsHostVideo.Visibility = Visibility.Collapsed; CanvaVideo.Visibility = Visibility.Visible; clientInfo.hPlayWnd = IntPtr.Zero; clientInfo.enMediaCallbackType = PU_MEDIA_CALLBACK_TYPE.PU_MEDIA_CALLBACK_TYPE_YUV; prpInfos[0] = clientInfo; _fedRealPlayCallbackWithYUV = FedRealPlayCallbackWithYUV; //手动处理回调 _ulRealHandleId = HuaWeiSdkHelper.IVS_PU_RealPlay(_ulIdentifyId, prpInfos, _fedRealPlayCallbackWithYUV, ref pUsrData); if (0 == _ulRealHandleId) { MessageBox.Show(HuaWeiSdkHelper.GetLastErrorInfo()); } ButtonSaveOne.IsEnabled = true;//点击 抓拍一张 按钮,会把_isSave变量设置为true,从而在回调事件中可以保存当前帧为图片 } else {
ButtonSaveOne.IsEnabled = false; CanvaVideo.Visibility
= Visibility.Collapsed; FormsHostVideo.Visibility = Visibility.Visible; prpInfos[0] = clientInfo; //传入句柄,自动预览 _ulRealHandleId = HuaWeiSdkHelper.IVS_PU_RealPlay(_ulIdentifyId, prpInfos, null, ref pUsrData); if (0 == _ulRealHandleId) { MessageBox.Show(HuaWeiSdkHelper.GetLastErrorInfo()); } } } #region 手动解析YUV数据并展示在界面上 private static void FedRealPlayCallbackWithYUV(IntPtr szBuffer, int lSize, IntPtr pUsrData) { if (_isExit) return; try { Span<byte> nativeSpan; unsafe { nativeSpan = new Span<byte>(szBuffer.ToPointer(), lSize); } if (nativeSpan.Length > 0) { #region 处理视频流YUV图像 Mat yuvImg = new Mat(1080 * 3 / 2, 1920, MatType.CV_8UC1); Mat rgbImg = new Mat(1080, 1920, MatType.CV_8UC1); Marshal.Copy(nativeSpan.ToArray(), 0, yuvImg.Data, nativeSpan.Length); Cv2.CvtColor(yuvImg, rgbImg, ColorConversionCodes.YUV2RGBA_I420); Application.Current.Dispatcher?.InvokeAsync(() => { VideoYuvModelView.VideoWriteableBitmap.Lock(); unsafe { CopyMemory(VideoYuvModelView.VideoWriteableBitmap.BackBuffer, new IntPtr(rgbImg.DataPointer), ByteLength); } VideoYuvModelView.VideoWriteableBitmap.AddDirtyRect(new Int32Rect(0, 0, 1920, 1080)); VideoYuvModelView.VideoWriteableBitmap.Unlock(); }); if (_isSave) { Cv2.ImWrite(Path.Combine($"{AppDomain.CurrentDomain.BaseDirectory}", "jpg",$"{Guid.NewGuid()}.jpg"), rgbImg); _isSave = false; } #endregion } } catch (Exception e) { App.NewNLog.Error($"解析视频流出错:{e}"); } } #endregion #endregion

在程序关闭的时候进行资源释放。

        private void MainWindow_OnClosed(object sender, EventArgs e)
        {
            _isExit = true;if (_ulRealHandleId > 0)
            {
                HuaWeiSdkHelper.IVS_PU_StopRealPlay(_ulIdentifyId, _ulRealHandleId);//停止预览
            }
            if (_ulIdentifyId > 0)
            {
                HuaWeiSdkHelper.IVS_PU_Logout(_ulIdentifyId);//退出登录
            }
            HuaWeiSdkHelper.IVS_PU_Cleanup();//SDK资源释放
        }

具体效果如下:

1、自动预览

2、手动处理

但是这里的YUV回调填充到WriteableBitmap遇到个问题,就是无法填满WriteableBitmap(把WriteableBitmap中的数据保存下来也是和预览的效果一样,估计是填充的算法不对),只能填充一部分,这里涉及到本人的知识盲区,暂时没法解决掉。

3、一帧图像保存为本地图片

 

 

至此我们使用C#初步实现了华为IPC摄像头的预览和数据流处理(也可以把处理类型换成视频流,然后存本地视频文件,因为默认时h265编码格式,播放时使用PotPlayer播放器来播放),算是入门了。

下一章我们将实现调用SDK来实现人脸自动抓拍效果。

posted @ 2020-08-26 11:40  踏平扶桑  阅读(3601)  评论(10编辑  收藏  举报