Agora-iot-sdk demo
1 Functional Overview
The sound network-based Agora-IoT-SDK connecting sound network cloud to realize the one-way diagram of equipment and mobile phone voice calls and equipment to mobile phones.
2 Code Path
demo path:
\components\demos\media\agora
For the detailed description of the API interface of the AEC library, please refer to the same webpage:
/api-reference/multi_media/bk_aec.html
3 Cli command introduction
The commands supported by the demo are as follows:
Command |
Description |
---|---|
agora_test {audio start|stop appid audio_type sampple_rate aec_en} |
Voice call |
agora_test {video start|stop appid video_type ppi} |
Video transfer |
agora_test {both start|stop appid audio_type sample_rate video_type ppi aec_en} |
Voice and Video transfer |
The command parameters are described as follows:
appid
an appid for registration
audio_type
- mic and speaker type:
0:
onboard
1:
UAC
sampple_rate
- sample rate:
8000
16000
aec_en
- AEC function control:
0:
disable AEC
1:
enable AEC
video_type
- camera type:
APP_CAMERA_DVP_JPEG
APP_CAMERA_DVP_YUV
APP_CAMERA_UVC_MJPEG
ppi
- resolution:
PPI_320X240
PPI_320X480
PPI_480X320
PPI_480X480
PPI_480X800
PPI_640X480
PPI_800X480
DEMO Compilation instruction: Make BK7256 Project = ThirdParty/Agora
4. Demonstration introduction
The preparation of DEMO execution is as follows:
1、Prepare the Android machine that can be connected to the external network and install the APK
Open Live
to test the test2、Go to Agora official website to register to apply for testing for testing
appid
, please refer to the information below for detailed operation3、Prepare to access the 2.4GHz hotspot of the external network for Demo board connection and use
The steps of demo execution are as follows:
Mobile APK configuration
Open
Open Live
APK, enter the registration applicationappid
, clickEnter
to enterEnter Channel name `` hello_bk7256demo`` , click Join ROOM to enter, select
BroadCaster
2.Demo board wifi connection
DEMO board sending instructions
sta test xxxxxxx
connect 2.4GHz hot spots named TEST
Open and close voice calls
The demo board sends the command
agora_test audio start appid audio_type sample_rate aec_en
to open the voice callThe demo board sends the command
agora_test audio stop appid audio_type sample_rate aec_en
to close the voice call
Turn on and off video transmission
The demo board sends the command
agora_test video start appid video_type ppi
to open the image transmissionThe demo board sends the command
agora_test video stop appid video_type ppi
to close the image transmission
Turn on and off voice call and image transmission
The demo board sends the command
agora_test both start appid audio_type sample_rate video_type ppi aec_en
to open voice call and image transmissionThe demo board sends the command
agora_test both stop appid audio_type sample_rate video_type ppi aec_en
to turn off voice calls and image transmission
5. Audio configuration
The audio code in the demo is developed based on the aud_intf
component. By configuring the input parameters of the bk_aud_intf_voc_init
interface, the selection of mic and speaker types and the setting of the sampling rate can be realized.
- The supported sample rates are as follows:
1、AUD_INTF_VOC_SAMP_RATE_8K: 8K sampling rate (recommended configuration)
2、AUD_INTF_VOC_SAMP_RATE_16K: 16K sampling rate (Currently, the SoundNet SDK does not support)
Note
16K sampling rate will increase the load of network bandwidth, which will affect the frame rate of image transmission, so it is recommended to sample at 8K sampling rate
- The supported mic and speaker types are as follows:
1、AUD_INTF_MIC_TYPE_BOARD: onboard mic (recommended configuration)
2、AUD_INTF_MIC_TYPE_UAC: uac type mic
3、AUD_INTF_SPK_TYPE_BOARD: onboard speaker (recommended configuration)
4、AUD_INTF_SPK_TYPE_UAC: uac type speaker
For detailed description of Aud_Intf API interface, please refer to the same page: /api-reference/multi_media/bk_aud_intf.html
6. Video configuration
The part of the image transmission code in the demo is developed based on the media
component. By configuring the input parameters of the media_app_camera_open
interface, the selection of the camera type and the setting of the resolution can be realized.
- The supported types are as follows:
1、APP_CAMERA_DVP_JPEG: DVP camera in JPEG format (recommended configuration)
2、APP_CAMERA_DVP_YUV: DVP camera in YUV format (Currently, the SoundNet SDK does not support)
3、APP_CAMERA_UVC_MJPEG: UVC camera in MJPEG format
- The supported resolutions are as follows:
1、PPI_320X240 (recommended configuration)
2、PPI_320X480
3、PPI_480X320
4、PPI_480X480
5、PPI_480X800
6、PPI_640X480
7、PPI_800X480
Note
1、The underlying hardware supports a variety of common resolutions, but it is not recommended to configure a higher sampling rate due to the limitations of the Acoustics SDK and network bandwidth
7. Reference materials
Sound network reference document: https://docs.agora.io/cn/Agora%20Platform/manage_projects?platform=Android
Agora appid register link:https://sso2.agora.io/cn/v5/login?_gl=1%2ardr355%2a_ga%2aMzkyNDM4ODYyLjE2NzM1MTM3MTU.%2a_ga_BFVGG7E02W%2aMTY3ODg1MjM0My4xMi4wLjE2Nzg4NTIzNDYuMC4wLjA.
Apk download link: http://dl.bekencorp.com/apk/shengwang/OpenLive_input_appid.apk