Horrible Audio Crackling Issues

[apexdevai]

Hello I am using the RVC GUI, and when trying to use any RVC model, there is a lot of crackling.
Even increasing block_time doesnt really help, it reduces the amount of crackling, but it is still there.
I have an RTX 3070 Ti and am using Arch Linux. My hardware should not be the problem in this case.
Is there any ways to improve performance whilst maintaining realtime?

[apexdevai]

As an update, it seems that it only crackles every time there is a sample. If I increase my sample length, the time between the crackling varies. Every time Spent time: fea = 0.005s, index = 0.001s, f0 = 0.010s, model = 0.010s is printed is exactly when the crackling occurs.