-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add models for operator dashboard #74
Conversation
@bmtcril how does this works on local and dev? Where you able to query the data locally? |
36cbeea
to
00762f3
Compare
config( | ||
materialized="materialized_view", | ||
schema=env_var("ASPECTS_XAPI_DATABASE", "xapi"), | ||
engine=get_engine("SummingMergeTree()"), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this is our first use of a SummingMergeTree. I'm still trying to confirm this is all working as expected.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Were you able to confirm that this does what we want? It looks correct to me but I'm trying to compare this to the AggregatingMergeTree
table engine.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There's something off with it when there is new data coming in, I'm still debugging it
5356cbc
to
fafa728
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think this looks good! I tried testing the use of AggregatingMergeTree
along with uniqCombinedState
and it seemed to work as I'd expect.
fafa728
to
2fa70fd
Compare
Also removes a number of user_pii fields that are currently unused and cause ClickHouse to fail to build them when run at scale.