feat: fetch payload CIDs from piece indexer

[NikolasHaimerl]

This MR proposes the following changes:

1. Add a piece cid indexer which fetches miner IDs and payloads for miner IDs and piece CIDs
2. Add tests for the piece indexer loop
3. Refactor database access for better code visibility

The lookup operation for piece CIDs is not yet complete. The piece cid indexer does not have all combinations of minerID and piece CID for any built-in actor event. A follow-up PR which deals with this issue is described in this issue.
We do not want to add the piece indexer loop to the list of executables for now. This should be done as soon as missing payloads are also dealt with.

[juliangruber]

How did we come up with this magic number? It defines how many active deals we look at at a time. It looks like by tuning it we control the trade off between processing speed (how many deals to update in a loop iteration) and memory usage (but not concurrency).

[bajtos]

I don't remember the details; it's best to ask @NikolasHaimerl. Your description looks correct to me.

This will be easy to tweak later, I think we should pick some reasonable number for now and move on. WDYT?

[bajtos]

I quickly skimmed throught the latest version and it looks very reasonable to me. I don't see any major issues/blockers.

[bajtos]

We already have piece-indexer - see https://github.com/CheckerNetwork/piece-indexer

How about calling this file piece-indexer-client.js?

(Not blocking this PR from landing.)

[juliangruber]

Good call, I found that confusing as well. Will fix

[sentry-io]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ Error: Failed to make RPC request. getDealPayloadCid(piece-indexer-service) View Issue
• ‼️ Error: Failed to make RPC request Filecoin.ChainHead rpcRequest(service) View Issue
• ‼️ Error: Failed to make RPC request Filecoin.GetActorEventsRaw rpcRequest(service) View Issue
• ‼️ error: relation "active_deals" does not exist loadDeals(deal-observer) View Issue
• ‼️ Error: Connection terminated unexpectedly loadDeals(deal-observer) View Issue

_{Did you find this useful? React with a 👍 or 👎}