Code

DEGEN ETL Improvements [V1]#10

Code

Open

manjeet9727 wants to merge 66 commits intomainAirstack-xyz/ethereum-etl:mainfrom feat/degen-etl-improvementsAirstack-xyz/ethereum-etl:feat/degen-etl-improvementsCopy head branch name to clipboard

+352-53

Commits

Commits on Apr 7, 2024

• support for start-block and file arg

  manjeet9727

  committed
  18a0634

  Copy full SHA for 18a0634

• check messages in set before publishing

  manjeet9727

  committed
  854cd2f

  Copy full SHA for 854cd2f

• support for bloom-filters

  manjeet9727

  committed
  6bacb79

  Copy full SHA for 6bacb79

• support for prometheus-metrics

  manjeet9727

  committed
  e1d4a48

  Copy full SHA for e1d4a48

Commits on Apr 8, 2024

• change sorting order & minor redis changes

  manjeet9727

  committed
  3a28809

  Copy full SHA for 3a28809

• Merge branch 'main' of github.com:Airstack-xyz/ethereum-etl into feat/degen-etl-improvements

  manjeet9727

  committed
  42d8c6d

  Copy full SHA for 42d8c6d

• refactor code

  manjeet9727

  committed
  fc4c540

  Copy full SHA for fc4c540

• refactor code

  manjeet9727

  committed
  2f0298d

  Copy full SHA for 2f0298d

• refactor code

  manjeet9727

  committed
  00d0f82

  Copy full SHA for 00d0f82

• Update setup.py

  manjeet9727

  authored
  acf6122

  Copy full SHA for acf6122

• fix: lz4

  manjeet9727

  committed
  5db3cd3

  Copy full SHA for 5db3cd3

• Merge pull request #14 from Airstack-xyz/main

  Show description for 77871a3
  manjeet9727

  authored
  77871a3

  Copy full SHA for 77871a3

• Support for both start-block vs last-synced-file

  manjeet9727

  committed
  2adc05b

  Copy full SHA for 2adc05b

Commits on Apr 9, 2024

• Support for both start-block vs last-synced-file

  manjeet9727

  committed
  eb42f62

  Copy full SHA for eb42f62

• Merge branch 'main' into feat/degen-etl-improvements

  manjeet9727

  committed
  acb31a8

  Copy full SHA for acb31a8

• Merge branch 'feat/degen-start-block' into feat/degen-etl-improvements

  manjeet9727

  committed
  be93dc5

  Copy full SHA for be93dc5

• WIP: CH support

  manjeet9727

  committed
  9ce6504

  Copy full SHA for 9ce6504

• FIX: balance traces

  manjeet9727

  committed
  14bfff6

  Copy full SHA for 14bfff6

• FIX: balance traces

  manjeet9727

  committed
  2b17ec7

  Copy full SHA for 2b17ec7

• FIX: balance traces

  manjeet9727

  committed
  42a87a9

  Copy full SHA for 42a87a9

• Merge branch 'fix/traces' into feat/degen-etl-improvements

  manjeet9727

  committed
  c330081

  Copy full SHA for c330081

• process blocks at the end

  manjeet9727

  committed
  ccdc5d2

  Copy full SHA for ccdc5d2

• WIP: CH support

  manjeet9727

  committed
  022e5c0

  Copy full SHA for 022e5c0

• WIP: CH support

  manjeet9727

  committed
  52dfa13

  Copy full SHA for 52dfa13

• support for redis lock

  manjeet9727

  committed
  f622926

  Copy full SHA for f622926

Commits on Apr 10, 2024

• support for redis lock

  manjeet9727

  committed
  1d52c8e

  Copy full SHA for 1d52c8e

• WIP dedup logic

  manjeet9727

  committed
  a769547

  Copy full SHA for a769547

• Added support for dedup using CH

  manjeet9727

  committed
  5ee0a0b

  Copy full SHA for 5ee0a0b

• Added support for dedup using CH

  manjeet9727

  committed
  c52eb78

  Copy full SHA for c52eb78

• Added support for dedup using CH

  manjeet9727

  committed
  d03e88c

  Copy full SHA for d03e88c

• Added support for dedup using CH

  manjeet9727

  committed
  975dea2

  Copy full SHA for 975dea2

• Added support for dedup using CH

  manjeet9727

  committed
  9e76bef

  Copy full SHA for 9e76bef

• Added support for dedup using CH

  manjeet9727

  committed
  38fb76a

  Copy full SHA for 38fb76a

• Added support for dedup using CH

  manjeet9727

  committed
  a2fffaf

  Copy full SHA for a2fffaf

• Added support for dedup using CH

  manjeet9727

  committed
  4c99c0e

  Copy full SHA for 4c99c0e

Commits on Apr 11, 2024

• Added backfill jobs

  manjeet9727

  committed
  a82e57b

  Copy full SHA for a82e57b

• Added backfill jobs

  manjeet9727

  committed
  b71fb0f

  Copy full SHA for b71fb0f

Commits on Apr 14, 2024

• Merge pull request #15 from Airstack-xyz/feat/degen-start-block

  Show description for 89ee8a7
  0xsarvesh

  authored
  89ee8a7

  Copy full SHA for 89ee8a7

• Added more logs

  manjeet9727

  committed
  02e5b87

  Copy full SHA for 02e5b87

Commits on Apr 15, 2024

• make last-synced-block-file as required param

  manjeet9727

  committed
  b59df5f

  Copy full SHA for b59df5f

• fix: str traces value

  manjeet9727

  committed
  d181885

  Copy full SHA for d181885

• Merge branch 'develop' into feat/degen-etl-improvements

  manjeet9727

  committed
  35fed03

  Copy full SHA for 35fed03

Commits on Apr 16, 2024

• added details for EVM Transfers

  manjeet9727

  committed
  ebb3dd8

  Copy full SHA for ebb3dd8

• code review fixes

  manjeet9727

  committed
  6d6b8df

  Copy full SHA for 6d6b8df

• code review fixes

  manjeet9727

  committed
  f90e705

  Copy full SHA for f90e705

Commits on Apr 17, 2024

• revert: str traces value

  manjeet9727

  committed
  6e28885

  Copy full SHA for 6e28885

Commits on Apr 23, 2024

• WIP: backmerge till ca54ef6

  manjeet9727

  committed
  4f451f4

  Copy full SHA for 4f451f4

Commits on Apr 24, 2024

• fix backmerge

  manjeet9727

  committed
  e438604

  Copy full SHA for e438604

• fix backmerge

  manjeet9727

  committed
  d1c63f1

  Copy full SHA for d1c63f1

• Merge branch 'fix/traces' into feat/degen-etl-improvements

  manjeet9727

  committed
  f62ca04

  Copy full SHA for f62ca04

• Merge branch 'feat/degen-etl-improvements' into feat/degen-v2-backmerge

  manjeet9727

  committed
  06cef7e

  Copy full SHA for 06cef7e

• Merge branch 'feat/degen-etl-improvements' into feat/degen-etl-improvements-v2

  manjeet9727

  committed
  39c407f

  Copy full SHA for 39c407f

• Merge branch 'feat/degen-v2-backmerge' into feat/etl-improvements-combined

  manjeet9727

  committed
  b157061

  Copy full SHA for b157061

• fix: add util to convert numric to string

  manjeet9727

  committed
  bf5899e

  Copy full SHA for bf5899e

Commits on Apr 25, 2024

• feat: produce to kafka and then mark in redis

  manjeet9727

  committed
  dbf7f2d

  Copy full SHA for dbf7f2d

• update table mapping for token stream

  manjeet9727

  committed
  c60b1d4

  Copy full SHA for c60b1d4

• Revert "WIP: backmerge till ca54ef6"

  Show description for 2f7b41c
  manjeet9727

  committed
  2f7b41c

  Copy full SHA for 2f7b41c

Commits on Apr 28, 2024

• fix: do not handle produce error

  manjeet9727

  committed
  ebf5079

  Copy full SHA for ebf5079

Commits on Apr 29, 2024

• test: dont log produce message

  manjeet9727

  committed
  94e2eb6

  Copy full SHA for 94e2eb6

Commits on Apr 30, 2024

• wip: test futures handling

  manjeet9727

  committed
  68fb8a3

  Copy full SHA for 68fb8a3

Commits on May 14, 2024

• feat: raise exception

  manjeet9727

  committed
  ce4812a

  Copy full SHA for ce4812a

Commits on May 20, 2024

• add AttributeError except for future

  14MR

  committed
  563197b

  Copy full SHA for 563197b

• filter out None values in futures

  14MR

  committed
  5ebe998

  Copy full SHA for 5ebe998

Commits on May 23, 2024

• move marking redis after kafka message was sent

  14MR

  committed
  0d1be65

  Copy full SHA for 0d1be65

Commits on May 28, 2024

• set acks='all', linger_ms=5

  14MR

  committed
  d4cea15

  Copy full SHA for d4cea15

Commits on Jun 6, 2024

• Merge pull request #20 from Airstack-xyz/feat/etl-improvements-v2

  Show description for a28ff29
  14MR

  authored
  a28ff29

  Copy full SHA for a28ff29