====== 实时通话 ====== ---- 环信实时通话分为视频通话和语音通话，SDK 提供简单的 API，方便开发者简单的接入实时通话功能。 ==== 实时通话的数据流量 ==== 实时语音和实时视频通话的数据流量如下： * 实时语音：双向 170k bytes/minute * 实时视频：双向 2.5M～3M bytes/minute ==== 配置工程 ==== 1. **在项目中导入库** Hyphenate.framework //包含实时音视频的库 AVFoundation.framework 2. **在项目中导入头文件** #import 3. **配置属性：** 进行音视频之前，设置全局的音视频属性，具体属性有哪些请查看头文件 ***EMCallOptions*** EMCallOptions *options = [[EMClient sharedClient].callManager getCallOptions]; //当对方不在线时，是否给对方发送离线消息和推送，并等待对方回应 options.isSendPushIfOffline = NO; //设置视频分辨率：自适应分辨率、352 * 288、640 * 480、1280 * 720 options.videoResolution = EMCallVideoResolutionAdaptive; //最大视频码率，范围 50 < videoKbps < 5000, 默认0, 0为自适应，建议设置为0 options.maxVideoKbps = 0; //最小视频码率 options.minVideoKbps = 0; //是否固定视频分辨率，默认为NO options.isFixedVideoResolution = NO; [[EMClient sharedClient].callManager setCallOptions:options]; 具体实现可以参考 Demo: DemoCallManager 和 EMCallViewController ==== 发起实时通话 ==== 用户可以调用发起语音或者视频 API 向在线用户发起实时通话。 /*! * 发起实时会话 * * @param aType 通话类型 * @param aRemoteName 被呼叫的用户（不能与自己通话） * @param aExt 通话扩展信息，会传给被呼叫方 * @param aCompletionBlock 完成的回调 */ - (void)startCall:(EMCallType)aType remoteName:(NSString *)aRemoteName ext:(NSString *)aExt completion:(void (^)(EMCallSession *aCallSession, EMError *aError))aCompletionBlock; 示例代码：创建视频通话 void (^completionBlock)(EMCallSession *, EMError *) = ^(EMCallSession *aCallSession, EMError *aError){ //创建通话实例是否成功 //TODO: code }; [[EMClient sharedClient].callManager startCall:EMCallTypeVideo remoteName:aUsername ext:nil completion:^(EMCallSession *aCallSession, EMError *aError) { completionBlock(aCallSession, aError); }]; ==== 被叫方同意实时通话 ==== 接收到通话时调用此 API 同意实时通话。 /*! * 接收方同意通话请求 * * @param aCallId 通话ID * * @result 错误信息 */ - (EMError *)answerIncomingCall:(NSString *)aCallId; //调用: //EMError *error = nil; //error = [[EMClient sharedClient].callManager answerIncomingCall:@"sessionId"]; ==== 结束实时通话 ==== 根据不同场景可以选择结束会话的原因。 例如：拒接选择 EMCallEndReasonDecline，主动挂断选择 EMCallEndReasonHangup。 typedef enum{ EMCallEndReasonHangup = 0, /*! 对方挂断 */ EMCallEndReasonNoResponse, /*! 对方没有响应 */ EMCallEndReasonDecline, /*! 对方拒接 */ EMCallEndReasonBusy, /*! 对方占线 */ EMCallEndReasonFailed, /*! 失败 */ EMCallEndReasonUnsupported, /*! 功能不支持 */ }EMCallEndReason; /*! * 结束通话 * * @param aCallId 通话的ID * @param aReason 结束原因 * * @result 错误 */ - (EMError *)endCall:(NSString *)aCallId reason:(EMCallEndReason)aReason; //调用: //[[EMClient sharedClient].callManager endCall:@"sessionId" reason:aReason]; ==== 创建通话页面 ==== SDK提供了用于显示本地视频的页面类***EMCallLocalView***，显示对方视频的页面类***EMCallRemoteView***，**建议在同意接通视频通话之后再初始化 EMCallRemoteView页面。** //前提：EMCallSession *callSession 存在 CGFloat width = 80; CGFloat height = self.view.frame.size.height / self.view.frame.size.width * width; callSession.localVideoView = [[EMCallLocalView alloc] initWithFrame:CGRectMake(self.view.frame.size.width - 90, CGRectGetMaxY(_statusLabel.frame), width, height)]; [self.view addSubview:callSession.localVideoView]; //同意接听视频通话之后 callSession.remoteVideoView = [[EMCallRemoteView alloc] initWithFrame:CGRectMake(0, 0, self.view.frame.size.width, self.view.frame.size.height)]; //设置视频页面缩放方式 callSession.remoteVideoView.scaleMode = EMCallViewScaleModeAspectFill; [self.view addSubview:_callSession.remoteVideoView]; ==== 扩展功能之 录制和截屏 ==== EMCallSession中录制及截屏接口已废弃，该功能作为音视频的插件之一单独打成了静态库。录制和截屏都必须在通话已经开始进行之后再调用。\\ [[http://downloads.easemob.com/downloads/ios_IM_Hyphenate_RecorderPlugin_3.3.1.zip|点击下载静态库]] 1. **头文件** EMAVPluginRecorder.h 2. **库** libbz2.tbd libHyphenatePluginRecorder.a libffmpeg-ios-full.a 3. **使用教程** **必须在发起通话之前调用[EMVideoRecorderPlugin initGlobalConfig] ，该方法为全局方法，只需要调用一次即可** 示例代码：开始录制（已经开始通话之后再调用） NSString *recordPath = NSHomeDirectory(); recordPath = [NSString stringWithFormat:@"%@/Library/appdata/chatbuffer",recordPath]; NSFileManager *fm = [NSFileManager defaultManager]; if(![fm fileExistsAtPath:recordPath]) { [fm createDirectoryAtPath:recordPath withIntermediateDirectories:YES attributes:nil error:nil]; } [[EMVideoRecorderPlugin sharedInstance] startVideoRecordingToFilePath:recordPath error:nil]; 示例代码：停止录制 EMError *error = nil; [[EMVideoRecorderPlugin sharedInstance] stopVideoRecording:&error]; if (!error) { NSLog(@"录制成功"); }else { NSLog(@"录制失败"); } 示例代码：截屏（已经开始通话之后再调用） NSString *imgPath = NSHomeDirectory(); imgPath = [NSString stringWithFormat:@"%@/Library/appdata/chatbuffer/img.jpeg", imgPath]; [[EMVideoRecorderPlugin sharedInstance] screenCaptureToFilePath:imgPath error:nil]; ==== 实时通话相关 API ==== 暂停恢复实时通话的数据传输相关 API。 /*! * 暂停语音数据传输 * * @result 错误 */ - (EMError *)pauseVoice; /*! * 恢复语音数据传输 * * @result 错误 */ - (EMError *)resumeVoice; /*! * 暂停视频图像数据传输 * * @result 错误 */ - (EMError *)pauseVideo; /*! * 恢复视频图像数据传输 * * @result 错误 */ - (EMError *)resumeVideo; 实时通话前后摄像头切换相关API #pragma mark - Camera /*! * 设置使用前置摄像头还是后置摄像头,默认使用前置摄像头 * * @param aIsFrontCamera 是否使用前置摄像头, YES使用前置, NO使用后置 */ - (void)switchCameraPosition:(BOOL)aIsFrontCamera; ==== 实时通话相关的回调 ==== 注册实时通话回调 //注册实时通话回调 [[EMClient sharedClient].callManager addDelegate:self delegateQueue:nil]; //移除实时通话回调 [[EMClient sharedClient].callManager removeDelegate:self]; 相关回调说明： /*! * 用户A拨打用户B，用户B会收到这个回调 * * @param aSession 会话实例 */ - (void)callDidReceive:(EMCallSession *)aSession; /*! * 通话通道建立完成，用户A和用户B都会收到这个回调 * * @param aSession 会话实例 */ - (void)callDidConnect:(EMCallSession *)aSession; /*! * 用户B同意用户A拨打的通话后，用户A会收到这个回调 * * @param aSession 会话实例 */ - (void)callDidAccept:(EMCallSession *)aSession; /*! * 1. 用户A或用户B结束通话后，对方会收到该回调 * 2. 通话出现错误，双方都会收到该回调 * * @param aSession 会话实例 * @param aReason 结束原因 * @param aError 错误 */ - (void)callDidEnd:(EMCallSession *)aSession reason:(EMCallEndReason)aReason error:(EMError *)aError; /*! * 用户A和用户B正在通话中，用户A中断或者继续数据流传输时，用户B会收到该回调 * * @param aSession 会话实例 * @param aType 改变类型 */ - (void)callStateDidChange:(EMCallSession *)aSession type:(EMCallStreamingStatus)aType; ==== 弱网检测 ==== 通过回调通知应用当前实时通话网络状态。 typedef enum{ EMCallNetworkStatusNormal = 0, /*! 正常 */ EMCallNetworkStatusUnstable, /*! 不稳定 */ EMCallNetworkStatusNoData, /*! 没有数据 */ }EMCallNetworkStatus; /*! * 用户A和用户B正在通话中，用户A的网络状态出现不稳定，用户A会收到该回调 * * @param aSession 会话实例 * @param aStatus 当前状态 */ - (void)callNetworkDidChange:(EMCallSession *)aSession status:(EMCallNetworkStatus)aStatus ==== 离线发推送 ==== 配置属性 EMCallOptions *options = [[EMClient sharedClient].callManager getCallOptions]; //当对方不在线时，是否给对方发送离线消息和推送，并等待对方回应 options.isSendPushIfOffline = NO; [[EMClient sharedClient].callManager setCallOptions:options]; 监听回调 [[EMClient sharedClient].callManager setBuilderDelegate:self]; 处理回调 - (void)callRemoteOffline:(NSString *)aRemoteName { NSString *text = [[EMClient sharedClient].callManager getCallOptions].offlineMessageText; EMTextMessageBody *body = [[EMTextMessageBody alloc] initWithText:text]; NSString *fromStr = [EMClient sharedClient].currentUsername; EMMessage *message = [[EMMessage alloc] initWithConversationID:aRemoteName from:fromStr to:aRemoteName body:body ext:@{@"em_apns_ext":@{@"em_push_title":text}}]; message.chatType = EMChatTypeChat; [[EMClient sharedClient].chatManager sendMessage:message progress:nil completion:nil]; } ==== 自定义视频数据 ==== == 配置属性 == //进行1v1自定义视频之前，必须设置 EMCallOptions.enableCustomizeVideoData=YES EMCallOptions *options = [[EMClient sharedClient].callManager getCallOptions]; options.enableCustomizeVideoData = YES; [[EMClient sharedClient].callManager startCall:aType remoteName:aUsername ext:@"123" completion:^(EMCallSession *aCallSession, EMError *aError) { completionBlock(aCallSession, aError); }]; //进行默认1v1视频之前，必须设置 EMCallOptions.enableCustomizeVideoData=NO EMCallOptions *options = [[EMClient sharedClient].callManager getCallOptions]; options.enableCustomizeVideoData = NO; [[EMClient sharedClient].callManager startCall:aType remoteName:aUsername ext:@"123" completion:^(EMCallSession *aCallSession, EMError *aError) { completionBlock(aCallSession, aError); }]; == 自定义摄像头数据 == 设置 **EMCallOptions.enableCustomizeVideoData=YES;**后，必须设置 **EMCallSession.localVideoView.previewDirectly = NO;** ,并且必须自定义摄像头数据 Demo中相关代码前都添加了“3.3.9 new 自定义视频数据”，可作为参考 == 接口 == /*! * 自定义本地视频数据 * * @param aSampleBuffer 视频采样缓冲区 * @param aCallId 1v1会话实例ID，即[EMCallSession callId] * @param aFormat 视频格式 * @param aRotation 旋转角度0~360，默认0 * @param aCompletionBlock 完成后的回调 */ - (void)inputVideoSampleBuffer:(CMSampleBufferRef)aSampleBuffer callId:(NSString *)aCallId format:(EMCallVideoFormat)aFormat rotation:(int)aRotation completion:(void (^)(EMError *aError))aCompletionBlock; /*! * 自定义本地视频数据 * * @param aPixelBuffer 视频像素缓冲区 * @param aCallId 1v1会话实例ID，即[EMCallSession callId] * @param aFormat 视频格式 * @param aRotation 旋转角度0~360，默认0 * @param aCompletionBlock 完成后的回调 */ - (void)inputVideoPixelBuffer:(CVPixelBufferRef)aPixelBuffer callId:(NSString *)aCallId format:(EMCallVideoFormat)aFormat rotation:(int)aRotation completion:(void (^)(EMError *aError))aCompletionBlock; /*! * 自定义本地视频数据 * * @param aData 视频数据 * @param aCallId 1v1会话实例ID，即[EMCallSession callId] * @param aWidth 宽度 * @param aHeight 高度 * @param aFormat 视频格式 * @param aRotation 旋转角度0~360，默认0 * @param aCompletionBlock 完成后的回调 */ - (void)inputVideoData:(NSData *)aData callId:(NSString *)aCallId widthInPixels:(size_t)aWidth heightInPixels:(size_t)aHeight format:(EMCallVideoFormat)aFormat rotation:(int)aRotation completion:(void (^)(EMError *aError))aCompletionBlock; == 接口调用示例 == 详细示例代码请看Demo #pragma mark AVCaptureVideoDataOutputSampleBufferDelegate - (void)captureOutput:(AVCaptureOutput*)captureOutput didOutputSampleBuffer:(CMSampleBufferRef)sampleBuffer fromConnection:(AVCaptureConnection*)connection { if(!self.callSession || self.videoModel == VIDEO_INPUT_MODE_NONE){ return; } CVImageBufferRef imageBuffer = CMSampleBufferGetImageBuffer(sampleBuffer); if (imageBuffer == NULL) { return ; } CVOptionFlags lockFlags = kCVPixelBufferLock_ReadOnly; CVReturn ret = CVPixelBufferLockBaseAddress(imageBuffer, lockFlags); if (ret != kCVReturnSuccess) { return ; } static size_t const kYPlaneIndex = 0; static size_t const kUVPlaneIndex = 1; uint8_t* yPlaneAddress = (uint8_t*)CVPixelBufferGetBaseAddressOfPlane(imageBuffer, kYPlaneIndex); size_t yPlaneHeight = CVPixelBufferGetHeightOfPlane(imageBuffer, kYPlaneIndex); size_t yPlaneWidth = CVPixelBufferGetWidthOfPlane(imageBuffer, kYPlaneIndex); size_t yPlaneBytesPerRow = CVPixelBufferGetBytesPerRowOfPlane(imageBuffer, kYPlaneIndex); size_t uvPlaneHeight = CVPixelBufferGetHeightOfPlane(imageBuffer, kUVPlaneIndex); size_t uvPlaneBytesPerRow = CVPixelBufferGetBytesPerRowOfPlane(imageBuffer, kUVPlaneIndex); size_t frameSize = yPlaneBytesPerRow * yPlaneHeight + uvPlaneBytesPerRow * uvPlaneHeight; // set uv for gray color uint8_t * uvPlaneAddress = yPlaneAddress + yPlaneBytesPerRow * yPlaneHeight; memset(uvPlaneAddress, 0x7F, uvPlaneBytesPerRow * uvPlaneHeight); if(self.videoModel == VIDEO_INPUT_MODE_DATA){ [[EMClient sharedClient].callManager inputVideoData:[NSData dataWithBytes:yPlaneAddress length:frameSize] callId:self.callSession.callId widthInPixels:yPlaneWidth heightInPixels:yPlaneHeight format:EMCallVideoFormatNV12 rotation:0 completion:nil]; } CVPixelBufferUnlockBaseAddress(imageBuffer, lockFlags); if(self.videoModel == VIDEO_INPUT_MODE_SAMPLE_BUFFER) { [[EMClient sharedClient].callManager inputVideoSampleBuffer:sampleBuffer callId:self.callSession.callId format:EMCallVideoFormatNV12 rotation:0 completion:nil]; } else if(self.videoModel == VIDEO_INPUT_MODE_PIXEL_BUFFER) { [[EMClient sharedClient].callManager inputVideoPixelBuffer:imageBuffer callId:self.callSession.callId format:EMCallVideoFormatNV12 rotation:0 completion:nil]; } } ---- 上一页：[[im:300iosclientintegration:70chatroommgmt|聊天室管理]] 下一页：[[im:300iosclientintegration:202conference|多人实时通话]]