Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

query tracing #5821

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

query tracing #5821

wants to merge 1 commit into from

Conversation

mangas
Copy link
Contributor

@mangas mangas commented Feb 15, 2025

Introduces a new GRPC Server that supports the streaming of rich information about query traces. This server enables users to obtain stats about running queries without having to change any settings other than enabling the tracing server via the relevant env var.

This is an important step to be able to analyse query performance at runtime in order to explore potential improvements. The exported queries have enough information to then automate the analysis of query plans on postgres to derive new performance improvements, can also be used to sample queries in runtime with no need to restart the graph-node.

The design aims to introduce as little overhead as possible, the subscription are eventually consistent and use watch channels to provide updates so the hot path is lock free, the highest price is paid once when the tracing mechanism is initialised.

@mangas mangas force-pushed the filipe/query-tracing branch 6 times, most recently from d71040d to b7ff47a Compare February 19, 2025 12:53
@mangas mangas force-pushed the filipe/query-tracing branch 9 times, most recently from 3d9fe78 to 8ae8570 Compare February 24, 2025 21:40
@mangas mangas marked this pull request as ready for review February 24, 2025 21:40
@mangas mangas force-pushed the filipe/query-tracing branch 2 times, most recently from 2f11488 to d019193 Compare February 24, 2025 21:52
@mangas mangas force-pushed the filipe/query-tracing branch from d019193 to 8ca3232 Compare February 24, 2025 22:16
@mangas mangas requested review from isum and lutter February 25, 2025 08:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant