Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

downsample & sqlite-sink leaking! #17

Open
rpj opened this issue Jan 17, 2019 · 2 comments
Open

downsample & sqlite-sink leaking! #17

rpj opened this issue Jan 17, 2019 · 2 comments
Assignees
Labels
bug Something isn't working major-feature More than an "enhancement" P0 Priority 0h Shit

Comments

@rpj
Copy link
Owner

rpj commented Jan 17, 2019

On charlie, the forwarding invocations of this seem to be leaking quite badly over long periods (these have been running for about 9 days):

ryan      3038  0.1 17.1 2233072 2090796 pts/1 S+   Jan06  20:54 python ./bin/downsample -i redis://u:XXX@localhost -o redis://h:[email protected]:15979 -p * -r 10 -t list:suffix=.list,limit=5000 -m flatten:mapping=mapping.json,include-raw=1
ryan      4796  0.1 16.5 2166996 2024552 pts/3 S+   Jan06  20:10 python ./bin/downsample -i redis://u:XXX@localhost -o redis://h:[email protected]:15979 -p * -r 10 -m flatten:mapping=mapping.json,include-raw=1 -t key

The cause isn't immediately obvious, though I'm suspecting the internal windowed cache isn't windowing or something.

@rpj rpj added bug Something isn't working major-feature More than an "enhancement" P1 Priority 1 labels Jan 17, 2019
@rpj rpj self-assigned this Jan 17, 2019
@rpj
Copy link
Owner Author

rpj commented Jan 17, 2019

Looks like sqlite-sink is doing it too. Dammit.

ryan     10794  0.4 14.5 1851512 1775812 pts/2 Dl+  Jan06  57:04 python ./bin/sqlite-sink /mnt/1TBSeagate/garden-bots-data/three.sqlite3

@rpj rpj added P0 Priority 0h Shit and removed P1 Priority 1 labels Jan 17, 2019
@rpj
Copy link
Owner Author

rpj commented Jan 17, 2019

Looking at the long-running sensor nodes (zed, zero), downsample doesn't appear to be leaking on them. So it's very likely something in the -t or -m options causing it. Though that wouldn't explain sqlite-sink...

@rpj rpj changed the title downsample leaking! downsample & sqlite-sink leaking! Jan 17, 2019
@rpj rpj pinned this issue Mar 12, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working major-feature More than an "enhancement" P0 Priority 0h Shit
Projects
None yet
Development

No branches or pull requests

1 participant