Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create Infrastructure for Storing and Accessing DTIO Telemetry Data #18

Open
Keith-Bateman opened this issue Sep 26, 2023 · 0 comments
Open
Labels

Comments

@Keith-Bateman
Copy link
Member

Is your feature request related to a problem? Please describe.
We need to collect telemetry data that can be easily accessed by any learning models within DTIO

Describe the solution you'd like
A new HCL unordered map executable should be launched as part of DTIO which telemetry data can be written to (see existing HCL map implementation for an example of how to do this). Telemetry should be separate from metadata, so a new executable is preferred. Existing processes will have to be made aware of the telemetry map and hooks will need to be added to store data such as:

  • HCL Queue Throughput (at workers and task scheduler)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

2 participants