Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to speed up json parsing ? #61

Open
nbanb opened this issue Jan 27, 2023 · 0 comments
Open

How to speed up json parsing ? #61

nbanb opened this issue Jan 27, 2023 · 0 comments

Comments

@nbanb
Copy link

nbanb commented Jan 27, 2023

Dear contributors

This is more à challenge than an issue...!

I m currently using this code in different project I maintain and for example the main one is a bash library of ~3500 lines : fbx-delta-nba_bash_api.sh .

Json parsing is working fine but when an api call reply a complexe json which is more than 80kb or 100kb, parsing became very slow, too slow for a dynamic usage...

I need a way to throttle by 10 or more those functions (certains json parsing takes several minutes)...

I did try to systematically cache all parsed values and I get a global throttle of x3 on the frontend functions of the library which are using this project as the underlying engine. But it's still not enough for a proper dynamic usage (dynamic question/reply).

Maybe there is something I'm doing wrong, but as I'm not a developer, I don't know what to do so I would ask for help here (and i cannot use 'jq' instead).

Does someone has an idea of how speeding up the exec of these function ?

Is there some small change which permit execution throttling ?

Thanks and kind regards
nbanba

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant