ESP32-LyraT speech_recognition \ asr例程问题
Posted: Sun May 17, 2020 2:14 am
speech_recognition \ asr这个例程，按照官方文档操作，能语音唤醒，但是语音命令词就没反应了，打印结果：
ets Jun 8 2016 00:22:57
rst:0x1 (POWERON_RESET),boot:0x3f (SPI_FAST_FLASH_BOOT)
flash read err, 1000
ets_main.c 371
ets Jun 8 2016 00:22:57
rst:0x10 (RTCWDT_RTC_RESET),boot:0x3f (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0018,len:4
load:0x3fff001c,len:7048
load:0x40078000,len:12072
load:0x40080400,len:6784
entry 0x4008077c
[0;32mI (63) boot: Chip Revision: 1[0m
[0;32mI (63) boot_comm: chip revision: 1, min. bootloader chip revision: 0[0m
[0;32mI (39) boot: ESP-IDF v3.3.2-107-g722043f73-dirty 2nd stage bootloader[0m
[0;32mI (39) boot: compile time 17:03:23[0m
[0;32mI (68) boot: Enabling RNG early entropy source...[0m
[0;32mI (68) boot: SPI Speed : 80MHz[0m
[0;32mI (68) boot: SPI Mode : DIO[0m
[0;32mI (70) boot: SPI Flash Size : 4MB[0m
[0;32mI (74) boot: Partition Table:[0m
[0;32mI (78) boot: ## Label Usage Type ST Offset Length[0m
[0;32mI (85) boot: 0 nvs WiFi data 01 02 00009000 00006000[0m
[0;32mI (93) boot: 1 phy_init RF data 01 01 0000f000 00001000[0m
[0;32mI (100) boot: 2 factory factory app 00 00 00010000 00200000[0m
[0;32mI (108) boot: End of partition table[0m
[0;32mI (112) boot_comm: chip revision: 1, min. application chip revision: 0[0m
[0;32mI (119) esp_image: segment 0: paddr=0x00010020 vaddr=0x3f400020 size=0x174490 (1524880) map[0m
[0;32mI (572) esp_image: segment 1: paddr=0x001844b8 vaddr=0x3ffb0000 size=0x0245c ( 9308) load[0m
[0;32mI (576) esp_image: segment 2: paddr=0x0018691c vaddr=0x40080000 size=0x00400 ( 1024) load[0m
[0;32mI (579) esp_image: segment 3: paddr=0x00186d24 vaddr=0x40080400 size=0x092ec ( 37612) load[0m
[0;32mI (601) esp_image: segment 4: paddr=0x00190018 vaddr=0x400d0018 size=0x473a8 (291752) map[0m
[0;32mI (687) esp_image: segment 5: paddr=0x001d73c8 vaddr=0x400896ec size=0x08260 ( 33376) load[0m
[0;32mI (709) boot: Loaded app from partition at offset 0x10000[0m
[0;32mI (709) boot: Disabling RNG early entropy source...[0m
[0;32mI (709) psram: This chip is ESP32-D0WD[0m
[0;32mI (714) spiram: Found 32MBit SPI RAM device[0m
[0;32mI (718) spiram: SPI RAM mode: flash 80m sram 40m[0m
[0;32mI (724) spiram: PSRAM initialized, cache is in low/high (2-core) mode.[0m
[0;32mI (731) cpu_start: Pro cpu up.[0m
[0;32mI (735) cpu_start: Application information:[0m
[0;32mI (740) cpu_start: Project name: speech_recognition_example[0m
[0;32mI (746) cpu_start: App version: v2.0-54-gabaaa79-dirty[0m
[0;32mI (752) cpu_start: Compile time: May 16 2020 17:04:28[0m
[0;32mI (759) cpu_start: ELF file SHA256: 1b3cb6c21ea73f58...[0m
[0;32mI (764) cpu_start: ESP-IDF: v3.3.2-107-g722043f73-dirty[0m
[0;32mI (771) cpu_start: Starting app cpu, entry point is 0x4008150c[0m
[0;32mI (0) cpu_start: App cpu up.[0m
[0;32mI (1671) spiram: SPI SRAM memory test OK[0m
[0;32mI (1671) heap_init: Initializing. RAM available for dynamic allocation:[0m
[0;32mI (1672) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM[0m
[0;32mI (1678) heap_init: At 3FFB36A0 len 0002C960 (178 KiB): DRAM[0m
[0;32mI (1684) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM[0m
[0;32mI (1691) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM[0m
[0;32mI (1697) heap_init: At 4009194C len 0000E6B4 (57 KiB): IRAM[0m
[0;32mI (1703) cpu_start: Pro cpu start user code[0m
[0;32mI (1708) spiram: Adding pool of 4096K of external SPI memory to heap allocator[0m
[0;32mI (163) cpu_start: Starting scheduler on PRO CPU.[0m
[0;32mI (0) cpu_start: Starting scheduler on APP CPU.[0m
[0;32mI (164) spiram: Reserving pool of 32K of internal memory for DMA/internal allocations[0m
[0;32mI (172) gpio: GPIO[22]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0 [0m
[0;32mI (181) example_asr_keywords: Initialize SR wn handle[0m
Quantized wakeNet5: wakeNet5_v1_nihaoxiaozhi_6_0.983_0.95, mode:0 (Nov 20 2019 14:34:43)
[0;32mI (195) example_asr_keywords: keywords: nihaoxiaozhi (index = 1)[0m
Fail: index is out of range, the min index is 1, the max index is 1[0;32mI (201) example_asr_keywords: keywords_num = 1, threshold = 0.000000, sample_rate = 16000, chunksize = 480, sizeof_uint16 = 2[0m
Quantized MN1_2 (Dec 5 2019 20:22:00)
SHIFT: 8, 11, 17, 18, 18, 17, 7, 16, 15, 13,
[0;32mI (238) example_asr_keywords: keywords_num = 200 , sample_rate = 16000, chunksize = 480, sizeof_uint16 = 2[0m
[0;32mI (238) example_asr_keywords: [ 1 ] Start codec chip[0m
[0;32mI (744) example_asr_keywords: [ 2.0 ] Create audio pipeline for recording[0m
[0;32mI (744) example_asr_keywords: [ 2.1 ] Create i2s stream to read audio data from codec chip[0m
[0;32mI (753) example_asr_keywords: [ 2.2 ] Create filter to resample audio data[0m
[0;32mI (757) example_asr_keywords: [ 2.3 ] Create raw to receive data[0m
[0;32mI (764) example_asr_keywords: [ 3 ] Register all elements to audio pipeline[0m
[0;32mI (771) example_asr_keywords: [ 4 ] Link elements together [codec_chip]-->i2s_stream-->filter-->raw-->[SR][0m
[0;31mE (783) gpio: gpio_install_isr_service(412): GPIO isr service already installed[0m
----------------------------- ESP Audio Platform -----------------------------
| |
| ESP_AUDIO-v1.5.6-16-gcf04695-dirty |
| Compile date: May 9 2020-14:49:56 |
------------------------------------------------------------------------------
[0;33mW (834) I2S: I2S driver already installed[0m
[0;32mI (835) example_asr_keywords: esp_audio instance is:0x3f80fb48
[0m
[0;32mI (841) example_asr_keywords: [ 5 ] Start audio_pipeline[0m
然后唤醒后打印输出：
[0;33mW (652808) AUDIO_PIPELINE: Without stop, st:1[0m
[0;33mW (652809) AUDIO_PIPELINE: Without wait stop, st:1[0m
[0;33mW (652809) AUDIO_PIPELINE: Without stop, st:1[0m
[0;33mW (652813) AUDIO_PIPELINE: Without wait stop, st:1[0m
[0;33mW (652819) AUDIO_PIPELINE: There are no listener registered[0m
[0;33mW (652825) ESP_AUDIO_TASK: Destroy the old pipeline[0m
[0;33mW (654093) FATFS_STREAM: No more data,ret:0[0m
[0;32mI (654907) example_asr_keywords: wake up[0m
10秒钟后拾音结束，输出打印：
[0;32mI (664089) example_asr_keywords: stop multinet[0m
ets Jun 8 2016 00:22:57
rst:0x1 (POWERON_RESET),boot:0x3f (SPI_FAST_FLASH_BOOT)
flash read err, 1000
ets_main.c 371
ets Jun 8 2016 00:22:57
rst:0x10 (RTCWDT_RTC_RESET),boot:0x3f (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0018,len:4
load:0x3fff001c,len:7048
load:0x40078000,len:12072
load:0x40080400,len:6784
entry 0x4008077c
[0;32mI (63) boot: Chip Revision: 1[0m
[0;32mI (63) boot_comm: chip revision: 1, min. bootloader chip revision: 0[0m
[0;32mI (39) boot: ESP-IDF v3.3.2-107-g722043f73-dirty 2nd stage bootloader[0m
[0;32mI (39) boot: compile time 17:03:23[0m
[0;32mI (68) boot: Enabling RNG early entropy source...[0m
[0;32mI (68) boot: SPI Speed : 80MHz[0m
[0;32mI (68) boot: SPI Mode : DIO[0m
[0;32mI (70) boot: SPI Flash Size : 4MB[0m
[0;32mI (74) boot: Partition Table:[0m
[0;32mI (78) boot: ## Label Usage Type ST Offset Length[0m
[0;32mI (85) boot: 0 nvs WiFi data 01 02 00009000 00006000[0m
[0;32mI (93) boot: 1 phy_init RF data 01 01 0000f000 00001000[0m
[0;32mI (100) boot: 2 factory factory app 00 00 00010000 00200000[0m
[0;32mI (108) boot: End of partition table[0m
[0;32mI (112) boot_comm: chip revision: 1, min. application chip revision: 0[0m
[0;32mI (119) esp_image: segment 0: paddr=0x00010020 vaddr=0x3f400020 size=0x174490 (1524880) map[0m
[0;32mI (572) esp_image: segment 1: paddr=0x001844b8 vaddr=0x3ffb0000 size=0x0245c ( 9308) load[0m
[0;32mI (576) esp_image: segment 2: paddr=0x0018691c vaddr=0x40080000 size=0x00400 ( 1024) load[0m
[0;32mI (579) esp_image: segment 3: paddr=0x00186d24 vaddr=0x40080400 size=0x092ec ( 37612) load[0m
[0;32mI (601) esp_image: segment 4: paddr=0x00190018 vaddr=0x400d0018 size=0x473a8 (291752) map[0m
[0;32mI (687) esp_image: segment 5: paddr=0x001d73c8 vaddr=0x400896ec size=0x08260 ( 33376) load[0m
[0;32mI (709) boot: Loaded app from partition at offset 0x10000[0m
[0;32mI (709) boot: Disabling RNG early entropy source...[0m
[0;32mI (709) psram: This chip is ESP32-D0WD[0m
[0;32mI (714) spiram: Found 32MBit SPI RAM device[0m
[0;32mI (718) spiram: SPI RAM mode: flash 80m sram 40m[0m
[0;32mI (724) spiram: PSRAM initialized, cache is in low/high (2-core) mode.[0m
[0;32mI (731) cpu_start: Pro cpu up.[0m
[0;32mI (735) cpu_start: Application information:[0m
[0;32mI (740) cpu_start: Project name: speech_recognition_example[0m
[0;32mI (746) cpu_start: App version: v2.0-54-gabaaa79-dirty[0m
[0;32mI (752) cpu_start: Compile time: May 16 2020 17:04:28[0m
[0;32mI (759) cpu_start: ELF file SHA256: 1b3cb6c21ea73f58...[0m
[0;32mI (764) cpu_start: ESP-IDF: v3.3.2-107-g722043f73-dirty[0m
[0;32mI (771) cpu_start: Starting app cpu, entry point is 0x4008150c[0m
[0;32mI (0) cpu_start: App cpu up.[0m
[0;32mI (1671) spiram: SPI SRAM memory test OK[0m
[0;32mI (1671) heap_init: Initializing. RAM available for dynamic allocation:[0m
[0;32mI (1672) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM[0m
[0;32mI (1678) heap_init: At 3FFB36A0 len 0002C960 (178 KiB): DRAM[0m
[0;32mI (1684) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM[0m
[0;32mI (1691) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM[0m
[0;32mI (1697) heap_init: At 4009194C len 0000E6B4 (57 KiB): IRAM[0m
[0;32mI (1703) cpu_start: Pro cpu start user code[0m
[0;32mI (1708) spiram: Adding pool of 4096K of external SPI memory to heap allocator[0m
[0;32mI (163) cpu_start: Starting scheduler on PRO CPU.[0m
[0;32mI (0) cpu_start: Starting scheduler on APP CPU.[0m
[0;32mI (164) spiram: Reserving pool of 32K of internal memory for DMA/internal allocations[0m
[0;32mI (172) gpio: GPIO[22]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0 [0m
[0;32mI (181) example_asr_keywords: Initialize SR wn handle[0m
Quantized wakeNet5: wakeNet5_v1_nihaoxiaozhi_6_0.983_0.95, mode:0 (Nov 20 2019 14:34:43)
[0;32mI (195) example_asr_keywords: keywords: nihaoxiaozhi (index = 1)[0m
Fail: index is out of range, the min index is 1, the max index is 1[0;32mI (201) example_asr_keywords: keywords_num = 1, threshold = 0.000000, sample_rate = 16000, chunksize = 480, sizeof_uint16 = 2[0m
Quantized MN1_2 (Dec 5 2019 20:22:00)
SHIFT: 8, 11, 17, 18, 18, 17, 7, 16, 15, 13,
[0;32mI (238) example_asr_keywords: keywords_num = 200 , sample_rate = 16000, chunksize = 480, sizeof_uint16 = 2[0m
[0;32mI (238) example_asr_keywords: [ 1 ] Start codec chip[0m
[0;32mI (744) example_asr_keywords: [ 2.0 ] Create audio pipeline for recording[0m
[0;32mI (744) example_asr_keywords: [ 2.1 ] Create i2s stream to read audio data from codec chip[0m
[0;32mI (753) example_asr_keywords: [ 2.2 ] Create filter to resample audio data[0m
[0;32mI (757) example_asr_keywords: [ 2.3 ] Create raw to receive data[0m
[0;32mI (764) example_asr_keywords: [ 3 ] Register all elements to audio pipeline[0m
[0;32mI (771) example_asr_keywords: [ 4 ] Link elements together [codec_chip]-->i2s_stream-->filter-->raw-->[SR][0m
[0;31mE (783) gpio: gpio_install_isr_service(412): GPIO isr service already installed[0m
----------------------------- ESP Audio Platform -----------------------------
| |
| ESP_AUDIO-v1.5.6-16-gcf04695-dirty |
| Compile date: May 9 2020-14:49:56 |
------------------------------------------------------------------------------
[0;33mW (834) I2S: I2S driver already installed[0m
[0;32mI (835) example_asr_keywords: esp_audio instance is:0x3f80fb48
[0m
[0;32mI (841) example_asr_keywords: [ 5 ] Start audio_pipeline[0m
然后唤醒后打印输出：
[0;33mW (652808) AUDIO_PIPELINE: Without stop, st:1[0m
[0;33mW (652809) AUDIO_PIPELINE: Without wait stop, st:1[0m
[0;33mW (652809) AUDIO_PIPELINE: Without stop, st:1[0m
[0;33mW (652813) AUDIO_PIPELINE: Without wait stop, st:1[0m
[0;33mW (652819) AUDIO_PIPELINE: There are no listener registered[0m
[0;33mW (652825) ESP_AUDIO_TASK: Destroy the old pipeline[0m
[0;33mW (654093) FATFS_STREAM: No more data,ret:0[0m
[0;32mI (654907) example_asr_keywords: wake up[0m
10秒钟后拾音结束，输出打印：
[0;32mI (664089) example_asr_keywords: stop multinet[0m