Impossible to fetch token history

[paulmillr]

Describe the bug

I've built esplr - private block explorer, but it can't be ran on reth.

It utilizes trace_filter which is great and universal. Reth has 100-block limit for trace_filter, requiring 190k requests just get transactions (source code). If there are better APIs for this purpose, let's document / create them.

Other useful methods are in ots_ namespace, which allow ots_searchTransactionsBefore, ots_searchTransactionsAfter and ots_getContractCreator - seems to be fairly low-effort?

In any case, it would be awesome to make Reth support local block explorers! It seems like it can enable all kinds of different new use-cases besides mine.

Steps to reproduce

Run trace_filter request, batch size is max 100

Requirements

One thing to keep in mind is that Erigon has smaller datasets even though the feature / index is enabled.

Code of Conduct

• I agree to follow the Code of Conduct

[Rjected]

Opened an issue to make the block range configurable:
#14930

[paulmillr]

Great that #14939 / #14930 have been solved! This improves things a lot.

One item that may still be missing is having proper indexes. To build list of address txs, we don't know when "first block containing tx" happened. This means we will need to walk through ALL blocks / full history.

How complicated would it be to add something similar to what's in Erigon? Or something better to solve this issue?

[paulmillr]

@mattsse is it clear how much effort something like this could take?