Video Calling

ConnectyCube Video Calling P2P API is built on top of WebRTC protocol and based on top of WebRTC Mesh architecture.

Max people per P2P call is 4.

To get a difference between P2P calling and Conference calling please read our ConnectyCube Calling API comparison blog page.

Required preparations for supported platforms

iOS

Add the following entries to your Info.plist file, located in <project root>/ios/Runner/Info.plist:

<key>NSCameraUsageDescription</key>
<string>$(PRODUCT_NAME) Camera Usage!</string>
<key>NSMicrophoneUsageDescription</key>
<string>$(PRODUCT_NAME) Microphone Usage!</string>

This entries allow your app to access the camera and microphone.

Android

Ensure the following permission is present in your Android Manifest file, located in <project root>/android/app/src/main/AndroidManifest.xml:

<uses-feature android:name="android.hardware.camera" />
<uses-feature android:name="android.hardware.camera.autofocus" />
<uses-permission android:name="android.permission.CAMERA" />
<uses-permission android:name="android.permission.RECORD_AUDIO" />
<uses-permission android:name="android.permission.ACCESS_NETWORK_STATE" />
<uses-permission android:name="android.permission.CHANGE_NETWORK_STATE" />
<uses-permission android:name="android.permission.MODIFY_AUDIO_SETTINGS" />

If you need to use a Bluetooth device, please add:

<uses-permission android:name="android.permission.BLUETOOTH" />
<uses-permission android:name="android.permission.BLUETOOTH_ADMIN" />

The Flutter project template adds it, so it may already be there.

Also you will need to set your build settings to Java 8, because official WebRTC jar now uses static methods in EglBase interface. Just add this to your app level build.gradle:

android {
    //...
    compileOptions {
        sourceCompatibility JavaVersion.VERSION_1_8
        targetCompatibility JavaVersion.VERSION_1_8
    }
}

If necessary, in the same build.gradle you will need to increase minSdkVersion of defaultConfig up to 18 (currently default Flutter generator set it to 16).

macOS

Add the following entries to your *.entitlements files, located in <project root>/macos/Runner:

<key>com.apple.security.network.client</key>
<true/>
<key>com.apple.security.device.audio-input</key>
<true/>
<key>com.apple.security.device.camera</key>
<true/>

This entries allow your app to access the internet, microphone, and camera.

Windows

It does not require any special preparations.

Web

It does not require any special preparations.

Linux

It does not require any special preparations.

P2PClient setup

ConnectyCube Chat API is used as a signaling transport for Video Calling API, so in order to start using Video Calling API you need to connect to Chat.

To manage P2P calls in flutter you should use P2PClient. Please see code below to find out possible functionality.

P2PClient callClient = P2PClient.instance; // returns instance of P2PClient

callClient.init(); // starts listening of incoming calls
callClient.destroy(); // stops listening incoming calls and clears callbacks

// calls when P2PClient receives new incoming call
callClient.onReceiveNewSession = (incomingCallSession) {

};

// calls when any callSession closed
callClient.onSessionClosed = (closedCallSession) {

};

// creates new P2PSession
callClient.createCallSession(callType, opponentsIds);

Create call session

In order to use Video Calling API you need to create a call session object - choose your opponents with whom you will have a call and a type of session (VIDEO or AUDIO). P2PSession creates via P2PClient:

P2PClient callClient; //callClient created somewhere

Set<int> opponentsIds = {};
int callType = CallType.VIDEO_CALL; // or CallType.AUDIO_CALL

P2PSession callSession = callClient.createCallSession(callType, opponentsIds);

Add listeners

Below described main helpful callbacks and listeners:

callSession.onLocalStreamReceived = (mediaStream) {
  // called when local media stream completely prepared

  // display the stream in UI
  // ...
};

callSession.onRemoteStreamReceived = (callSession, opponentId, mediaStream) {
  // called when remote media stream received from opponent
};

callSession.onRemoteStreamRemoved = (callSession, opponentId, mediaStream) {
  // called when remote media was removed
};

callSession.onUserNoAnswer = (callSession, opponentId) {
  // called when did not receive an answer from opponent during timeout (default timeout is 60 seconds)
};

callSession.onCallRejectedByUser = (callSession, opponentId, [userInfo]) {
  // called when received 'reject' signal from opponent
};

callSession.onCallAcceptedByUser = (callSession, opponentId, [userInfo]){
  // called when received 'accept' signal from opponent
};

callSession.onReceiveHungUpFromUser = (callSession, opponentId, [userInfo]){
  // called when received 'hungUp' signal from opponent
};

callSession.onSessionClosed = (callSession){
  // called when current session was closed
};

Initiate a call

Map<String, String> userInfo = {};

callSession.startCall(userInfo);

The userInfo is used to pass any extra parameters in the request to your opponents.

After this, your opponents will receive a new call session in callback:

callClient.onReceiveNewSession = (incomingCallSession) {

};

Accept a call

To accept a call the following code snippet is used:

Map<String, String> userInfo = {}; // additional info for other call members
callSession.acceptCall(userInfo);

After this, you will get a confirmation in the following callback:

callSession.onCallAcceptedByUser = (callSession, opponentId, [userInfo]){

};

Also, both the caller and opponents will get a special callback with the remote stream:

callSession.onRemoteStreamReceived = (callSession, opponentId, mediaStream) {
  // create video renderer and set media stream to it
  RTCVideoRenderer streamRender = RTCVideoRenderer();
  await streamRender.initialize();
  streamRender.srcObject = mediaStream;
  streamRender.objectFit = RTCVideoViewObjectFit.RTCVideoViewObjectFitCover;

  // create view to put it somewhere on screen
  RTCVideoView videoView = RTCVideoView(streamRender);
};

From this point, you and your opponents should start seeing each other.

Receive a call in background

See CallKit section below.

Reject a call

Map<String, String> userInfo = {}; // additional info for other call members

callSession.reject(userInfo);

After this, the caller will get a confirmation in the following callback:

callSession.onCallRejectedByUser = (callSession, opponentId, [userInfo]) {

};

Sometimes, it could a situation when you received a call request and want to reject it, but the call session object has not arrived yet. It could be in a case when you integrated CallKit to receive call requests while an app is in background/killed state. To do a reject in this case, the following snippet can be used:

String callSessionId; // the id of incoming call session
Set<int> callMembers; // the ids of all call members including the caller and excluding the current user
Map<String, String> userInfo = {}; // additional info about performed action (optional)

rejectCall(callSessionId, callMembers, userInfo: userInfo);

End a call

Map<String, String> userInfo = {}; // additional info for other call members

callSession.hungUp(userInfo);

After this, the opponents will get a confirmation in the following callback:

callSession.onReceiveHungUpFromUser = (callSession, opponentId, [userInfo]){

};

Monitor session connections state

To monitor the states of your peer connections (users) you need to implement the RTCSessionStateCallback abstract class:

callSession.setSessionCallbacksListener(this);
callSession.removeSessionCallbacksListener();

/// Called in case when connection with the opponent is started establishing
@override
void onConnectingToUser(P2PSession session, int userId) {}

/// Called in case when connection with the opponent is established
@override
void onConnectedToUser(P2PSession session, int userId) {}

/// Called in case when connection is closed
@override
void onConnectionClosedForUser(P2PSession session, int userId) {}

/// Called in case when the opponent is disconnected
@override
void onDisconnectedFromUser(P2PSession session, int userId) {}

/// Called in case when connection has failed with the opponent
@override
void onConnectionFailedWithUser(P2PSession session, int userId) {}

Mute audio

bool mute = true; // false - to unmute, default value is false
callSession.setMicrophoneMute(mute);

Switch audio output

For iOS/Android platforms use:

bool enabled = false; // true - to switch to sreakerphone, default value is false
callSession.enableSpeakerphone(enable);

For Chrome-based browsers and Desktop platforms use:

if (kIsWeb) {
  remoteRenderers.forEach(renderer) {
    renderer.audioOutput(deviceId);
  });
} else {
  callSession.selectAudioOutput(deviceId);
}

Mute video

bool enabled = false; // true - to enable local video track, default value for video calls is true
callSession.setVideoEnabled(enabled);

Switch video cameras

For iOS/Android platforms use:

callSession.switchCamera().then((isFrontCameraSelected){
  if(isFrontCameraSelected) {
    // front camera selected
  } else {
    // back camera selected
  }
}).catchError((error) {
  // switching camera failed
});

For the Web platform and Desktop platforms use:

callSession.switchCamera(deviceId: deviceId);

Get available cameras list

var cameras = await callSession.getCameras(); // call only after `initLocalMediaStream()`

Get available Audio input devices list

var audioInputs = await callSession.getAudioInputs(); // call only after `initLocalMediaStream()`

Get available Audio output devices list

var audioOutputs = await callSession.getAudioOutputs(); // call only after `initLocalMediaStream()`

Use the custom media stream

MediaStream customMediaStream;

callSession.replaceMediaStream(customMediaStream);

Toggle the torch

var enable = true; // false - to disable the torch

callSession.setTorchEnabled(enable);

The Screen Sharing feature allows you to share the screen from your device to other call members. Currently the Connectycube Flutter SDK supports the Screen Sharing feature for all supported platforms.

For switching to the screen sharing during the call use next code snippet:

P2PSession callSession; // the existing call session

callSession.enableScreenSharing(true, requestAudioForScreenSharing: true); // for switching to the screen sharing

callSession.enableScreenSharing(false); // for switching to the camera streaming

Android specifics of targeting the `targetSdkVersion` to the version 31 and above

After updating the targetSdkVersion to the version 31 you can encounter an error:

java.lang.SecurityException: Media projections require a foreground service of type ServiceInfo.FOREGROUND_SERVICE_TYPE_MEDIA_PROJECTION

To avoid it do the next changes and modifications in your project:

1. Connect the flutter_background plugin to your project using:

flutter_background: ^x.x.x

2. Add to the file app_name/android/app/src/main/AndroidManifest.xml to section manifest next permissions:

<uses-permission android:name="android.permission.WAKE_LOCK" />
<uses-permission android:name="android.permission.FOREGROUND_SERVICE"/>
<uses-permission android:name="android.permission.REQUEST_IGNORE_BATTERY_OPTIMIZATIONS" />

3. Add to the file app_name/android/app/src/main/AndroidManifest.xml to section application next service:

<service
    android:name="de.julianassmann.flutter_background.IsolateHolderService"
    android:foregroundServiceType="mediaProjection"
    android:enabled="true"
    android:exported="false"/>

4. Create the next function somewhere in your project:

Future<bool> initForegroundService() async {
    final androidConfig = FlutterBackgroundAndroidConfig(
      notificationTitle: 'App name',
      notificationText: 'Screen sharing is in progress',
      notificationImportance: AndroidNotificationImportance.Default,
      notificationIcon: AndroidResource(
        name: 'ic_launcher_foreground',
        defType: 'drawable'),
    );
   return FlutterBackground.initialize(androidConfig: androidConfig);
}

and call it somewhere after the initialization of the app or before starting the screen sharing.

5. Call the function FlutterBackground.enableBackgroundExecution() just before starting the screen sharing and function FlutterBackground.disableBackgroundExecution() after ending the screen sharing or finishing the call.

The Connectycube Flutter SDK supports two types of Screen sharing on the iOS platform. There are In-app screen sharing and Screen Broadcasting. The In-app screen sharing doesn’t require any additional preparation on the app side. But the Screen Broadcasting feature requires some.

All required features we already added to our P2P Calls sample.

Below is the step-by-step guide on adding it to your app. It contains the following steps:

Add the Broadcast Upload Extension;
Add required files from our sample to your iOS project;
Update project configuration files with your credentials;

Add the `Broadcast Upload Extension`

For creating the extension you need to add a new target to your application, selecting the Broadcast Upload Extension template. Fill in the desired name, change the language to Swift, make sure Include UI Extension (see screenshot) is not selected, as we don’t need custom UI for our case, then press Finish. You will see that a new folder with the extension’s name was added to the project’s tree, containing the SampleHandler.swift class. Also, make sure to update the Deployment Info, for the newly created extension, to iOS 14 or newer. To learn more about creating App Extensions check the official documentation.

Add the required files from our sample to your own iOS project

After adding the extension you should add prepared files from our sample to your own project. Copy next files from our Broadcast Extension directory: Atomic.swift, Broadcast Extension.entitlements (the name can be different according to your extension’s name), DarwinNotificationCenter.swift, SampleHandler.swift (replace the automatically created file), SampleUploader.swift, SocketConnection.swift. Then open your project in Xcode and link these files with your iOS project using Xcode tools. For it, call the context menu of your extension directory, select ‘Add Files to “Runner”…’ (see screenshot) and select files copied to your extension directory before.

Update project configuration files

Do the following for your iOS project configuration files:

1. Add both the app and the extension to the same App Group. For it, add to both (app and extension) *.entitlements files next lines:

<key>com.apple.security.application-groups</key>
<array>
    <string>group.com.connectycube.flutter</string>
</array>

where the group.com.connectycube.flutter is your App group. To learn about working with app groups, see Adding an App to an App Group. We recommend you create the app group in the Apple Developer Console before.

Next, add the App group id value to the app’s Info.plist of your app for the RTCAppGroupIdentifier key:

<key>RTCAppGroupIdentifier</key>
<string>group.com.connectycube.flutter</string>

where the group.com.connectycube.flutter is your App group.

2. Add a new key RTCScreenSharingExtension to the app’s Info.plist with the extension’s Bundle Identifier as the value:

<key>RTCScreenSharingExtension</key>
<string>com.connectycube.flutter.p2p-call-sample.app.Broadcast-Extension</string>

where the com.connectycube.flutter.p2p-call-sample.app.Broadcast-Extension is the Bundle ID of your Broadcast Extension. Take it from the Xcode

3. Update SampleHandler.swift’s appGroupIdentifier constant with the App Group name your app and extension are both registered to.

static let appGroupIdentifier = "group.com.connectycube.flutter"

where the group.com.connectycube.flutter is your app group.

4. Make sure voip is added to UIBackgroundModes, in the app’s Info.plist, in order to work when the app is in the background.

<key>UIBackgroundModes</key>
<array>
    <string>remote-notification</string>
    <string>voip</string>
    <string>audio</string>
</array>

After performing mentioned actions you can switch to Screen sharing during the call using useIOSBroadcasting = true:

_callSession.enableScreenSharing(true, useIOSBroadcasting: true);

Requesting desktop capture source

Desktop platforms require the capture source (Screen or Window) for screen sharing. We prepared a widget ready for using that requests the available sources from the system and provides them to a user for selection. After that, you can use it as the source for screen sharing.

In code it can look in a next way:

var desktopCapturerSource = isDesktop
    ? await showDialog<DesktopCapturerSource>(
      context: context,
      builder: (context) => ScreenSelectDialog())
    : null;


callSession.enableScreenSharing(true, desktopCapturerSource: desktopCapturerSource);

The default capture source (usually it is the default screen) will be captured if set null as a capture source for the desktop platform.

WebRTC Stats reporting

Stats reporting is an insanely powerful tool that can provide detailed info about a call. There is info about the media, peer connection, codecs, certificates, etc. To enable stats report you should first set stats reporting frequency using RTCConfig.

RTCConfig.instance.statsReportsInterval = 200; // receive stats report every 200 milliseconds

Then you can subscribe to the stream with reports using the instance of the call session:

_callSession.statsReports.listen((event) {
  var userId = event.userId; // the user's id the stats related to
  var stats = event.stats;   // available stats
});

To disable fetching Stats reports set this parameter as 0.

Monitoring mic level and video bitrate using Stats

Also, we prepared the helpful manager CubeStatsReportsManager for processing Stats reports and getting some helpful information like the opponent’s mic level and video bitrate.

For its work, you just need to configure the RTCConfig as described above. Then create the instance of CubeStatsReportsManager and initialize it with the call session.

final CubeStatsReportsManager _statsReportsManager = CubeStatsReportsManager();

_statsReportsManager.init(_callSession);

After that you can subscribe on the interested data:

_statsReportsManager.micLevelStream.listen((event) {
  var userId = event.userId;
  var micLevel = event.micLevel; // the mic level from 0 to 1
});

_statsReportsManager.videoBitrateStream.listen((event) {
  var userId = event.userId;
  var bitRate = event.bitRate; // the video bitrate in kbits/sec
});

After finishing the call you should dispose of the manager for avoiding memory leaks. You can do it in the onSessionClosed callback:

void _onSessionClosed(session) {
  // ...

  _statsReportsManager.dispose();

  // ..
}

Configurations

ConnectyCube Flutter SDK provides possibility to change some default parameters for call session.

Media stream configurations

Use instance of RTCMediaConfig class to change some default media stream configs.

RTCMediaConfig mediaConfig = RTCMediaConfig.instance;
mediaConfig.minHeight = 720; // sets preferred minimal height for local video stream, default value is 320
mediaConfig.minWidth = 1280; // sets preferred minimal width for local video stream, default value is 480
mediaConfig.minFrameRate = 30; // sets preferred minimal framerate for local video stream, default value is 25
mediaConfig.maxBandwidth = 512; // sets initial maximum bandwidth in kbps, set to `0` or `null` for disabling the limitation, default value is 0

Call quality

Limit bandwidth

Despite WebRTC engine uses automatic quality adjustement based on available Internet bandwidth, sometimes it’s better to set the max available bandwidth cap which will result in a better and smoother user experience. For example, if you know you have a bad internet connection, you can limit the max available bandwidth to e.g. 256 Kbit/s.

This can be done either when initiate a call via RTCMediaConfig.instance.maxBandwidth = 512 which will result in limiting the max vailable bandwidth for ALL participants or/and during a call:

callSession.setMaxBandwidth(256); // set some maximum value to increase the limit

which will result in limiting the max available bandwidth for current user only.

Call connection configurations

Use instance of RTCConfig class to change some default call connection configs.

RTCConfig config = RTCConfig.instance;
config.noAnswerTimeout = 90; // sets timeout in seconds before stop dilling to opponents, default value is 60
config.dillingTimeInterval = 5; // time interval in seconds between 'invite call' packages, default value is 3 seconds, min value is 3 seconds
config.statsReportsInterval = 300; // the time interval in milliseconds of periodic fetching reports, default value is 0 (disabled)

Recording

(coming soon)

CallKit

A ready Flutter P2P Calls sample with CallKit integrated is available at GitHub. All the below code snippets will be taken from it.

For mobile apps, it can be a situation when an opponent’s user app is either in closed (killed)or background (inactive) state.

In this case, to be able to still receive a call request, a flow called CallKit is used. It’s a mix of CallKit API + Push Notifications API + VOIP Push Notifications API.

The complete flow is similar to the following:

a call initiator should send a push notification (for iOS it’s a VOIP push notification) along with a call request
when an opponent’s app is killed or in a background state - an opponent will receive a push notification about an incoming call, so the CallKit incoming call screen will be displayed, where a user can accept/reject the call.

The ConnectyCube Flutter Call Kit plugin should be used to integrate CallKit functionality.

Below we provide a detailed guide on additional steps that needs to be performed in order to integrate CallKit into a Flutter app.

Connect the ConnectyCube Flutter Call Kit plugin

Please follow the plugin’s guide on how to connect it to your project.

Initiate a call

When initiate a call via callSession.startCall(), additionally we need to send a push notification (standard for Android user and VOIP for iOS). This is required for an opponent(s) to be able to receive an incoming call request when an app is in the background or killed state.

The following request will initiate a standard push notification for Android and a VOIP push notification for iOS:

P2PSession callSession; // the call session created before

CreateEventParams params = CreateEventParams();
params.parameters = {
  'message': "Incoming ${callSession.callType == CallType.VIDEO_CALL ? "Video" : "Audio"} call",
  'call_type': callSession.callType,
  'session_id': callSession.sessionId,
  'caller_id': callSession.callerId,
  'caller_name': callerName,
  'call_opponents': callSession.opponentsIds.join(','),
  'signal_type': 'startCall',
  'ios_voip': 1,
};

params.notificationType = NotificationType.PUSH;
params.environment = kReleaseMode ? CubeEnvironment.PRODUCTION : CubeEnvironment.DEVELOPMENT;
params.usersIds = callSession.opponentsIds.toList();

createEvent(params.getEventForRequest()).then((cubeEvent) {
    // event was created
}).catchError((error) {
    // something went wrong during event creation
});

Receive call request in background/killed state

The goal of CallKit is to receive call requests when an app is in the background or killed state. For iOS we will use CallKit and for Android we will use standard capabilities.

The ConnectyCube Flutter Call Kit plugin covers all main functionality for receiving the calls in the background.

First of all, you need to subscribe on a push notifications to have the possibility of receiving a push notifications in the background.

You can request the subscription token from the ConnectyCube Flutter Call Kit plugin. It will return the VoIP token for iOS and the common FCM token for Android.

Then you can create the subscription using the token above. In code it will look next:

ConnectycubeFlutterCallKit.getToken().then((token) {
  if (token != null) {
    subscribe(token);
  }
});

subscribe(String token) async {
  CreateSubscriptionParameters parameters = CreateSubscriptionParameters();
  parameters.pushToken = token;
  parameters.environment = kReleaseMode ? CubeEnvironment.PRODUCTION : CubeEnvironment.DEVELOPMENT;

  if (Platform.isAndroid) {
    parameters.channel = NotificationsChannels.GCM;
    parameters.platform = CubePlatform.ANDROID;
  } else if (Platform.isIOS) {
    parameters.channel = NotificationsChannels.APNS_VOIP;
    parameters.platform = CubePlatform.IOS;
  }

  String? deviceId = await PlatformDeviceId.getDeviceId;
  parameters.udid = deviceId;

  var packageInfo = await PackageInfo.fromPlatform();
  parameters.bundleIdentifier = packageInfo.packageName;

  createSubscription(parameters.getRequestParameters()).then((cubeSubscriptions) {
    log('[subscribe] subscription SUCCESS');
  }).catchError((error) {
    log('[subscribe] subscription ERROR: $error');
  });
}

During the Android app life, the FCM token can be refreshed. Use the next code snippet to listen to this event and renew the subscription on the Connectycube back-end:

ConnectycubeFlutterCallKit.onTokenRefreshed = (token) {
  subscribe(token);
};

After correctly performing the steps above the ConnectyCube Flutter Call Kit plugin automatically will show the CallKit screen for iOS and the Incoming Call notification for Android.

!> Pay attention: the Android platform requires some preparations for showing the notifications, working in the background, and starting the app from a notification. It includes next:

Request the permission on showing notifications (using the permission_handler plugin):

requestNotificationsPermission() async {
  var isPermissionGranted = await Permission.notification.isGranted;
  if(!isPermissionGranted){
    await Permission.notification.request();
  }
}

Request permission for starting the app from notification (using the permission_handler plugin):

Future<void> checkSystemAlertWindowPermission(BuildContext context) async {
  if (Platform.isAndroid) {
    var androidInfo = await DeviceInfoPlugin().androidInfo;
    var sdkInt = androidInfo.version.sdkInt!;

    if (sdkInt >= 31) {
      if (await Permission.systemAlertWindow.isDenied) {
        showDialog(
          context: context,
          builder: (BuildContext context) {
            return Expanded(
              child: AlertDialog(
                title: Text('Permission required'),
                content: Text(
                    'For accepting the calls in the background you should provide access to show System Alerts from the background. Would you like to do it now?'),
                actions: [
                  TextButton(
                    onPressed: () {
                      Permission.systemAlertWindow.request().then((status) {
                        if (status.isGranted) {
                          Navigator.of(context).pop();
                        }
                      });
                    },
                    child: Text(
                      'Allow',
                    ),
                  ),
                  TextButton(
                    onPressed: () {
                      Navigator.of(context).pop();
                    },
                    child: Text(
                      'Later',
                    ),
                  ),
                ],
              ),
            );
          },
        );
      }
    }
  }
}

Start/Stop foreground service when navigating the app to the background/foreground during the call (using flutter_background plugin):

Future<bool> startBackgroundExecution() async {
  if (Platform.isAndroid) {
    return initForegroundService().then((_) {
      return FlutterBackground.enableBackgroundExecution();
    });
  } else {
    return Future.value(true);
  }
}

Future<bool> stopBackgroundExecution() async {
  if (Platform.isAndroid && FlutterBackground.isBackgroundExecutionEnabled) {
    return FlutterBackground.disableBackgroundExecution();
  } else {
    return Future.value(true);
  }
}

Follow the official plugin’s doc for more details.

Listen to the callbacks from ConnectyCube Flutter Call Kit plugin

After displaying the CallKit/Call Notification you need to react to callbacks produced by this screen. Use the next code snippets to start listening to them:

ConnectycubeFlutterCallKit.instance.init(
        onCallAccepted: _onCallAccepted,
        onCallRejected: _onCallRejected,
);

if (Platform.isIOS) {
  ConnectycubeFlutterCallKit.onCallMuted = _onCallMuted;
}

ConnectycubeFlutterCallKit.onCallRejectedWhenTerminated = onCallRejectedWhenTerminated;

Future<void> _onCallMuted(bool mute, String uuid) async {
  // Called when the system or user mutes a call
  currentCall?.setMicrophoneMute(mute);
}

Future<void> _onCallAccepted(CallEvent callEvent) async {
  // Called when the user answers an incoming call via Call Kit
  ConnectycubeFlutterCallKit.setOnLockScreenVisibility(isVisible: true); // useful on Android when accept the call from the Lockscreen
  currentCall?.acceptCall();
}

Future<void> _onCallRejected(CallEvent callEvent) async {
  // Called when the user ends an incoming call via Call Kit
  if (!CubeChatConnection.instance.isAuthenticated()) {
    // reject the call via HTTP request
    rejectCall(
        callEvent.sessionId, {...callEvent.opponentsIds, callEvent.callerId});
  } else {
    currentCall?.reject();
  }
}

/// This provided handler must be a top-level function and cannot be
/// anonymous otherwise an [ArgumentError] will be thrown.
@pragma('vm:entry-point')
Future<void> onCallRejectedWhenTerminated(CallEvent callEvent) async {
  var currentUser = await SharedPrefs.getUser();
  initConnectycubeContextLess();

  return rejectCall(
      callEvent.sessionId, {...callEvent.opponentsIds.where((userId) => currentUser!.id != userId), callEvent.callerId});
}

initConnectycubeContextLess() {
  CubeSettings.instance.applicationId = config.APP_ID;
  CubeSettings.instance.authorizationKey = config.AUTH_KEY;
  CubeSettings.instance.authorizationSecret = config.AUTH_SECRET;
  CubeSettings.instance.onSessionRestore = () {
    return SharedPrefs.getUser().then((savedUser) {
      return createSession(savedUser);
    });
  };
}

Also, when performing any operations e.g. start call, accept, reject, stop, etc, we need to report back to CallKit lib - to have both app UI and CallKit UI in sync:

ConnectycubeFlutterCallKit.reportCallAccepted(sessionId: callUUID);


ConnectycubeFlutterCallKit.reportCallEnded(sessionId: callUUID);

For the callUUID we will use call’s currentCall!.sessionId.

All the above code snippets can be found in a ready Flutter P2P Calls sample with CallKit integrated.

Video Calling

Required preparations for supported platforms

iOS

Android

macOS

Windows

Web

Linux

P2PClient setup

Create call session

Add listeners

Initiate a call

Accept a call

Receive a call in background

Reject a call

End a call

Monitor session connections state

Mute audio

Switch audio output

Mute video

Switch video cameras

Get available cameras list

Get available Audio input devices list

Get available Audio output devices list

Use the custom media stream

Toggle the torch

Screen Sharing

Android specifics of targeting the targetSdkVersion to the version 31 and above

IOS screen sharing using the Screen Broadcasting feature.

Add the Broadcast Upload Extension

Add the required files from our sample to your own iOS project

Update project configuration files

Requesting desktop capture source

WebRTC Stats reporting

Monitoring mic level and video bitrate using Stats

Configurations

Media stream configurations

Call quality

Call connection configurations

Recording

CallKit

Connect the ConnectyCube Flutter Call Kit plugin

Receive call request in background/killed state

Listen to the callbacks from ConnectyCube Flutter Call Kit plugin

Android specifics of targeting the `targetSdkVersion` to the version 31 and above

Add the `Broadcast Upload Extension`