ESP32-Korvo-DU1906运行例程play_baidu_speech_mp3_example无法播放合成语音

modaoo
Posts: 3
Joined: Wed May 26, 2021 6:07 am

ESP32-Korvo-DU1906运行例程play_baidu_speech_mp3_example无法播放合成语音

Postby modaoo » Wed May 26, 2021 6:41 am

运行esp-adf\examples\cloud_services\pipeline_baidu_speech_mp3例程失败,已在百度AI开放平台注册语音合成应用,并且按照例程说明填入 API key和Secret Key,运行例程时,发现连接上了WiFi,并没有连接上百度AI平台 调试信息如下:

I (29) boot: ESP-IDF v4.2.1 2nd stage bootloader
I (29) boot: compile time 13:52:04
I (29) boot: chip revision: 3
I (32) boot_comm: chip revision: 3, min. bootloader chip revision: 0
I (39) qio_mode: Enabling default flash chip QIO
I (44) boot.esp32: SPI Speed : 80MHz
I (49) boot.esp32: SPI Mode : QIO
I (54) boot.esp32: SPI Flash Size : 8MB
I (58) boot: Enabling RNG early entropy source...
I (64) boot: Partition Table:
I (67) boot: ## Label Usage Type ST Offset Length
I (74) boot: 0 nvs WiFi data 01 02 00009000 00004000
I (82) boot: 1 phy_init RF data 01 01 0000d000 00001000
I (89) boot: 2 factory factory app 00 00 00010000 00300000
I (97) boot: End of partition table
I (101) boot_comm: chip revision: 3, min. application chip revision: 0
I (108) esp_image: segment 0: paddr=0x00010020 vaddr=0x3f400020 size=0x25ef4 (155380) map
I (163) esp_image: segment 1: paddr=0x00035f1c vaddr=0x3ffb0000 size=0x03354 ( 13140) load
I (168) esp_image: segment 2: paddr=0x00039278 vaddr=0x40080000 size=0x00404 ( 1028) load
0x40080000: _WindowOverflow4 at F:/esp-idf/components/freertos/xtensa/xtensa_vectors.S:1730

I (170) esp_image: segment 3: paddr=0x00039684 vaddr=0x40080404 size=0x06994 ( 27028) load
I (188) esp_image: segment 4: paddr=0x00040020 vaddr=0x400d0020 size=0xa6b54 (682836) map
0x400d0020: _stext at ??:?

I (390) esp_image: segment 5: paddr=0x000e6b7c vaddr=0x40086d98 size=0x105e8 ( 67048) load
0x40086d98: write_wifi_dig_gain at /home/cff/gittree/chip7.1_phy/chip_7.1/board_code/app_test/pp/phy/phy_chip_v7_cal.c:1937

I (426) boot: Loaded app from partition at offset 0x10000
I (426) boot: Disabling RNG early entropy source...
I (426) cpu_start: Pro cpu up.
I (430) cpu_start: Application information:
I (435) cpu_start: Project name: play_baidu_tts_mp3
I (441) cpu_start: App version: 1
I (445) cpu_start: Compile time: May 26 2021 13:50:32
I (451) cpu_start: ELF file SHA256: 8680ed60e6383ee0...
I (457) cpu_start: ESP-IDF: v4.2.1
I (462) cpu_start: Starting app cpu, entry point is 0x400819ac
0x400819ac: call_start_cpu1 at F:/esp-idf/components/esp32/cpu_start.c:287

I (0) cpu_start: App cpu up.
I (472) heap_init: Initializing. RAM available for dynamic allocation:
I (479) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM
I (485) heap_init: At 3FFB7E88 len 00028178 (160 KiB): DRAM
I (492) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM
I (498) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM
I (504) heap_init: At 40097380 len 00008C80 (35 KiB): IRAM
I (511) cpu_start: Pro cpu start user code
I (528) spi_flash: detected chip: gd
I (528) spi_flash: flash io: qio
I (528) cpu_start: Starting scheduler on PRO CPU.
I (0) cpu_start: Starting scheduler on APP CPU.
I (560) BAIDU_SPEECH_EXAMPLE: [ 0 ] Start and wait for Wi-Fi network
I (580) wifi:wifi driver task: 3ffc1b68, prio:23, stack:6656, core=0
I (580) system_api: Base MAC address is not set
I (580) system_api: read default base MAC address from EFUSE
I (590) wifi:wifi firmware version: c44a5e7
I (590) wifi:wifi certification version: v7.0
I (590) wifi:config NVS flash: enabled
I (590) wifi:config nano formating: disabled
I (600) wifi:Init data frame dynamic rx buffer num: 32
I (600) wifi:Init management frame dynamic rx buffer num: 32
I (610) wifi:Init management short buffer num: 32
I (610) wifi:Init dynamic tx buffer num: 32
I (620) wifi:Init static rx buffer size: 1600
I (620) wifi:Init static rx buffer num: 10
I (620) wifi:Init dynamic rx buffer num: 32
I (630) wifi_init: rx ba win: 6
I (630) wifi_init: tcpip mbox: 32
I (640) wifi_init: udp mbox: 6
I (640) wifi_init: tcp mbox: 6
I (640) wifi_init: tcp tx win: 5744
I (650) wifi_init: tcp rx win: 5744
I (650) wifi_init: tcp mss: 1440
I (660) wifi_init: WiFi IRAM OP enabled
I (660) wifi_init: WiFi RX IRAM OP enabled
I (660) phy_init: phy_version 4660,0162888,Dec 23 2020
I (770) wifi:mode : sta (b8:f0:09:8f:bc:20)
I (900) wifi:new:<2,0>, old:<1,0>, ap:<255,255>, sta:<2,0>, prof:1
I (1760) wifi:state: init -> auth (b0)
I (1830) wifi:state: auth -> assoc (0)
I (1860) wifi:state: assoc -> run (10)
I (1990) wifi:connected with bujiaban, aid = 4, channel 2, BW20, bssid = 50:64:2b:34:e5:fe
I (1990) wifi:security: WPA2-PSK, phy: bgn, rssi: -46
I (2000) wifi:pm start, type: 1

W (2000) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:4
I (2100) wifi:AP's beacon interval = 102400 us, DTIM period = 1
I (3060) esp_netif_handlers: sta ip: 192.168.31.115, mask: 255.255.255.0, gw: 192.168.31.1
I (3060) PERIPH_WIFI: Got ip:192.168.31.115
I (3060) BAIDU_SPEECH_EXAMPLE: [ 1 ] Start audio codec chip
I (3070) ESP32_Korvo_DU1906: I2S0, MCLK output by GPIO0
W (3080) I2C_BUS: i2c_bus_create:57: I2C bus has been already created, [port:0]
I (3080) AUDIO_HAL: Codec mode is 3, Ctrl:1
I (3080) BAIDU_SPEECH_EXAMPLE: [2.0] Create audio pipeline for playback
I (3090) BAIDU_SPEECH_EXAMPLE: [2.1] Create http stream to read data
I (3100) BAIDU_SPEECH_EXAMPLE: [2.2] Create i2s stream to write data to codec chip
I (3110) I2S: DMA Malloc info, datalen=blocksize=1200, dma_buf_count=3
I (3110) I2S: DMA Malloc info, datalen=blocksize=1200, dma_buf_count=3
I (3140) I2S: APLL: Req RATE: 44100, real rate: 44099.988, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 11289597.000, SCLK: 1411199.625000, diva: 1, divb: 0
I (3150) ESP32_Korvo_DU1906: I2S0, MCLK output by GPIO0
I (3150) BAIDU_SPEECH_EXAMPLE: [2.3] Create mp3 decoder to decode mp3 file
I (3160) MP3_DECODER: MP3 init
I (3160) BAIDU_SPEECH_EXAMPLE: [2.4] Register all elements to audio pipeline
I (3170) BAIDU_SPEECH_EXAMPLE: [2.5] Link it together http_stream-->mp3_decoder-->i2s_stream-->[codec_chip]
I (3180) AUDIO_PIPELINE: link el->rb, el:0x3ffc6f50, tag:http, rb:0x3ffc9978
I (3190) AUDIO_PIPELINE: link el->rb, el:0x3ffc9608, tag:mp3, rb:0x3ffceab4
I (3200) BAIDU_SPEECH_EXAMPLE: [2.6] Set up uri (http as http_stream, mp3 as mp3 decoder, and default output is i2s)
I (3210) BAIDU_SPEECH_EXAMPLE: [ 4 ] Set up event listener
I (3220) BAIDU_SPEECH_EXAMPLE: [4.1] Listening event from all elements of pipeline
I (3220) BAIDU_SPEECH_EXAMPLE: [4.2] Listening event from peripherals
I (3230) BAIDU_SPEECH_EXAMPLE: [ 5 ] Start audio_pipeline
I (3240) AUDIO_ELEMENT: [http-0x3ffc6f50] Element task created
I (3240) AUDIO_ELEMENT: [mp3-0x3ffc9608] Element task created
I (3250) AUDIO_ELEMENT: [i2s-0x3ffc9290] Element task created
I (3260) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:177740 Bytes

I (3260) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1
I (3270) AUDIO_ELEMENT: [mp3] AEL_MSG_CMD_RESUME,state:1
I (3280) MP3_DECODER: MP3 opened
I (3280) CODEC_ELEMENT_HELPER: The element is 0x3ffc9608. The reserve data 2 is 0x0.
I (3290) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_RESUME,state:1
I (3300) I2S_STREAM: AUDIO_STREAM_WRITER
I (3300) AUDIO_PIPELINE: Pipeline started
I (3320) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_PAUSE
I (3350) I2S: APLL: Req RATE: 16000, real rate: 15999.986, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 4095996.500, SCLK: 511999.562500, diva: 1, divb: 0
I (3350) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_RESUME,state:4
I (3360) I2S_STREAM: AUDIO_STREAM_WRITER
I (4460) BAIDU_AUTH: Access token=24.5a504b830554f448e13e4c6686f1b789.2592000.1624600431.282335-24243893
I (5090) HTTP_STREAM: total_bytes=5976
W (5110) HTTP_STREAM: No more data,errno:0, total_bytes:5976, rlen = 0
I (5110) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0
I (5110) BAIDU_SPEECH_EXAMPLE: [ * ] Receive music info from mp3 decoder, sample_rates=16000, bits=16, ch=1
I (5260) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_PAUSE
I (5280) I2S: APLL: Req RATE: 16000, real rate: 15999.986, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 4095996.500, SCLK: 511999.562500, diva: 1, divb: 0
I (5290) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_RESUME,state:4
I (5290) I2S_STREAM: AUDIO_STREAM_WRITER
I (6410) AUDIO_ELEMENT: IN-[mp3] AEL_IO_DONE,-2
I (7500) MP3_DECODER: Closed
I (7570) AUDIO_ELEMENT: IN-[i2s] AEL_IO_DONE,-2
W (7800) BAIDU_SPEECH_EXAMPLE: [ * ] Stop event received
I (7800) BAIDU_SPEECH_EXAMPLE: [ 6 ] Stop audio_pipeline
E (7800) AUDIO_ELEMENT: [http] Element already stopped
E (7800) AUDIO_ELEMENT: [mp3] Element already stopped
E (7810) AUDIO_ELEMENT: [i2s] Element already stopped

W (7820) AUDIO_PIPELINE: There are no listener registered
I (7820) AUDIO_PIPELINE: audio_pipeline_unlinked
W (7830) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE
W (7830) AUDIO_ELEMENT: [i2s] Element has not create when AUDIO_ELEMENT_TERMINATE
W (7840) AUDIO_ELEMENT: [mp3] Element has not create when AUDIO_ELEMENT_TERMINATE

I (7860) wifi:state: run -> init (0)
I (7860) wifi:pm stop, total sleep time: 3454263 us / 5857611 us

I (7860) wifi:new:<2,0>, old:<2,0>, ap:<255,255>, sta:<2,0>, prof:1
W (7870) PERIPH_WIFI: Wi-Fi disconnected from SSID bujiaban, auto-reconnect disabled, reconnect after 1000 ms
W (7880) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:3

I (8000) wifi:flush txq
I (8000) wifi:stop sw txq
I (8000) wifi:lmac stop hw txq
I (8000) wifi:Deinit lldesc rx mblock:10

modaoo
Posts: 3
Joined: Wed May 26, 2021 6:07 am

Re: ESP32-Korvo-DU1906运行例程play_baidu_speech_mp3_example无法播放合成语音

Postby modaoo » Thu May 27, 2021 3:46 am

找到问题原因了,例程中的接口地址是错误的

ESP_HengYC
Posts: 184
Joined: Fri Dec 15, 2017 2:45 am

Re: ESP32-Korvo-DU1906运行例程play_baidu_speech_mp3_example无法播放合成语音

Postby ESP_HengYC » Tue Jun 15, 2021 3:12 am

modaoo wrote:
Thu May 27, 2021 3:46 am
找到问题原因了,例程中的接口地址是错误的
你好,

可否提供下信息,具体是哪个接口地址是错误的?

SSSSJX
Posts: 18
Joined: Tue Oct 12, 2021 2:37 am

Re: ESP32-Korvo-DU1906运行例程play_baidu_speech_mp3_example无法播放合成语音

Postby SSSSJX » Mon Jan 24, 2022 6:12 pm

也遇到了类似问题,请问有任何思路或者解决吗
https://github.com/espressif/esp-adf/tr ... speech_mp3

W (2903) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:4
W (2923) wifi:<ba-add>idx:0 (ifx:0, 52:84:c7:c5:9e:11), tid:0, ssn:0, winSize:64
I (2993) wifi:AP's beacon interval = 102400 us, DTIM period = 2
I (3653) esp_netif_handlers: sta ip: 192.168.173.30, mask: 255.255.255.0, gw: 192.168.173.16
I (3653) PERIPH_WIFI: Got ip:192.168.173.30
I (3653) BAIDU_SPEECH_EXAMPLE: [ 1 ] Start audio codec chip
I (3673) DRV8311: ES8311 in Slave mode
I (3683) gpio: GPIO[21]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0
W (3683) I2C_BUS: i2c_bus_create:57: I2C bus has been already created, [port:0]
I (3693) AUDIO_HAL: Codec mode is 3, Ctrl:1
I (3703) BAIDU_SPEECH_EXAMPLE: [2.0] Create audio pipeline for playback
I (3703) BAIDU_SPEECH_EXAMPLE: [2.1] Create http stream to read data
I (3713) BAIDU_SPEECH_EXAMPLE: [2.2] Create i2s stream to write data to codec chip
I (3713) I2S: DMA Malloc info, datalen=blocksize=1200, dma_buf_count=3
I (3723) I2S: DMA Malloc info, datalen=blocksize=1200, dma_buf_count=3
I (3753) I2S: APLL: Req RATE: 44100, real rate: 44099.988, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 11289597.000, SCLK: 1411199.625000, diva: 1, divb: 0
I (3763) LYRAT_MINI_V1_1: I2S0, MCLK output by GPIO0
I (3763) BAIDU_SPEECH_EXAMPLE: [2.3] Create mp3 decoder to decode mp3 file
I (3773) MP3_DECODER: MP3 init
I (3773) BAIDU_SPEECH_EXAMPLE: [2.4] Register all elements to audio pipeline
I (3783) BAIDU_SPEECH_EXAMPLE: [2.5] Link it together http_stream-->mp3_decoder-->i2s_stream-->[codec_chip]
I (3793) AUDIO_PIPELINE: link el->rb, el:0x3ffc8cf0, tag:http, rb:0x3ffcb7fc
I (3803) AUDIO_PIPELINE: link el->rb, el:0x3ffcb46c, tag:mp3, rb:0x3ffd0944
I (3813) BAIDU_SPEECH_EXAMPLE: [2.6] Set up uri (http as http_stream, mp3 as mp3 decoder, and default output is i2s)
I (3823) BAIDU_SPEECH_EXAMPLE: [ 4 ] Set up event listener
I (3823) BAIDU_SPEECH_EXAMPLE: [4.1] Listening event from all elements of pipeline
I (3833) BAIDU_SPEECH_EXAMPLE: [4.2] Listening event from peripherals
I (3843) BAIDU_SPEECH_EXAMPLE: [ 5 ] Start audio_pipeline
I (3853) AUDIO_ELEMENT: [http-0x3ffc8cf0] Element task created
I (3853) AUDIO_ELEMENT: [mp3-0x3ffcb46c] Element task created
I (3863) AUDIO_ELEMENT: [i2s-0x3ffcb0d4] Element task created
I (3863) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:167980 Bytes

I (3873) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1
I (3893) AUDIO_ELEMENT: [mp3] AEL_MSG_CMD_RESUME,state:1
I (3893) MP3_DECODER: MP3 opened
I (3893) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_RESUME,state:1
I (3893) I2S_STREAM: AUDIO_STREAM_WRITER
I (3903) AUDIO_PIPELINE: Pipeline started
I (3933) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_PAUSE
I (3953) I2S: APLL: Req RATE: 16000, real rate: 15999.986, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 4095996.500, SCLK: 511999.562500, diva: 1, divb: 0
I (3963) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_RESUME,state:4
I (3963) I2S_STREAM: AUDIO_STREAM_WRITER
E (4273) esp-tls-mbedtls: No server verification option set in esp_tls_cfg_t structure. Check esp_tls API reference
E (4283) esp-tls-mbedtls: Failed to set client configurations
E (4283) esp-tls: create_ssl_handle failed
E (4293) esp-tls: Failed to open new connection
E (4293) TRANS_SSL: Failed to open a new connection
E (4303) HTTP_CLIENT: Connection failed, sock < 0
E (4303) BAIDU_AUTH: Error open http request to baidu auth server
E (4313) BAIDU_SPEECH_EXAMPLE: Error issuing access token
E (4323) HTTP_STREAM: Failed to process user callback
E (4323) AUDIO_ELEMENT: [http] AEL_STATUS_ERROR_OPEN,-1
W (4333) AUDIO_ELEMENT: [http] audio_element_on_cmd_error,7
W (4333) AUDIO_ELEMENT: IN-[mp3] AEL_IO_ABORT
E (4343) MP3_DECODER: failed to read audio data (line 119)
W (4343) AUDIO_ELEMENT: [mp3] AEL_IO_ABORT, -3
I (4353) MP3_DECODER: Closed
W (4373) AUDIO_ELEMENT: IN-[i2s] AEL_IO_ABORT
W (4593) BAIDU_SPEECH_EXAMPLE: [ * ] Stop event received
I (4593) BAIDU_SPEECH_EXAMPLE: [ 6 ] Stop audio_pipeline
E (4593) AUDIO_ELEMENT: [http] Element already stopped
E (4603) AUDIO_ELEMENT: [mp3] Element already stopped
E (4603) AUDIO_ELEMENT: [i2s] Element already stopped
W (4613) AUDIO_PIPELINE: There are no listener registered
I (4623) AUDIO_PIPELINE: audio_pipeline_unlinked
W (4623) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE
W (4633) AUDIO_ELEMENT: [i2s] Element has not create when AUDIO_ELEMENT_TERMINATE
W (4643) AUDIO_ELEMENT: [mp3] Element has not create when AUDIO_ELEMENT_TERMINATE
I (4663) wifi:state: run -> init (0)
I (4663) wifi:pm stop, total sleep time: 956668 us / 1759261 us

W (4663) wifi:<ba-del>idx
I (4663) wifi:new:<11,0>, old:<11,0>, ap:<255,255>, sta:<11,0>, prof:1
W (4673) PERIPH_WIFI: Wi-Fi disconnected from SSID she, auto-reconnect disabled, reconnect after 1000 ms
W (4683) PERIPH_WIFI: WiFi Event cb, Unhandle event_base:WIFI_EVENT, event_id:3
I (4683) wifi:flush txq
I (4683) wifi:stop sw txq
I (4693) wifi:lmac stop hw txq
I (4693) wifi:Deinit lldesc rx mblock:10

SSSSJX
Posts: 18
Joined: Tue Oct 12, 2021 2:37 am

Re: ESP32-Korvo-DU1906运行例程play_baidu_speech_mp3_example无法播放合成语音

Postby SSSSJX » Sat Jan 29, 2022 3:27 am

已解决。adf没有安装完全。。已经用半年跑通了好几个example而且git submodule update --init --recursive了好几次都没有发现问题,到这里才发现

Who is online

Users browsing this forum: No registered users and 9 guests