Reading from a large JSON file with ESP32

[reesebrogd]

I am curious if anyone has any suggestions for reading from a 2MB JSON file with the ESP32 and an SD card.

Currently, we are thinking of creating a hashtable with the JSON objects, partitioning the hashtable into smaller files, and loading them onto an SD card. Then we will be able to hash our key and know which file to read from on the SD card to locate our key-value pair.

Alternatively, we could use the SQLite database management system on the ESP32 to handle the JSON data.

Does anyone know which solution would read files faster and load key-value pairs faster on the ESP32? Are there any other solutions?

[liaifat85]

You can consider JSON streaming.

[chegewara]

Hi,
it is only theory, but i doubt you will be able to parse 2MB json string on esp32.
I would suggest to use CSV instead, where you can read line by line from file.