replay buffer improvements

[xjuzyw0319]

Hello, Mr. Reinis Cimurs. Thank you very much for your work. I recently reproduced and improved your work. First, I improved your replay buffer.py file and added the Prioritized Experience Replay module (https://github.com/Howuhh/prioritized_experience_replay). During the training process, I found that the results were not so ideal (as shown in Figure 1). Can you give me some suggestions? Modify the algorithm parameters or something else?

图一

[reiniscimurs]

1. Fill out issue template when submitting an issue
2. Provide all relevant changes
3. This is a repeat issue