Feature/clean crawler

[hawyar]

The crawler now has a stream option which allows streaming new blocks in a separate child process. Before every crawler cycle we find the last processed block height (start) and the current chain height (end). As long as the new block from stream is not in that range (start - end) for that cycle then we are able to process it.

[shanejearley]

Looks awesome. Do you mind removing the contracts/ethereum/build folder? Not sure why .gitignore missed this, maybe an out of date file. Then I'll take a deeper look, since there will be less scrolling through changes.

[shanejearley]

Did you find a good solution for the fetch/stream ranges?

[hawyar]

One solution might be adding inserted_at to the event schema. Before starting, the crawler would query for the last inserted event rather than the highest block height in the event table.

[shanejearley]

That sounds like a good idea to consider.

[shanejearley]

Great work 👏