Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split stats into standalone service #278

Open
georgesnelling opened this issue Nov 6, 2014 · 0 comments
Open

Split stats into standalone service #278

georgesnelling opened this issue Nov 6, 2014 · 0 comments

Comments

@georgesnelling
Copy link
Member

Currently collections have no protection from concurrent rebuild / refresh commands.

We refresh stats every minute on the service using a recurring task. When the stats are screwed up we issue a /stats/rebuild command manually. If this doesn't finish within a minute the recurring refresh command merrily starts up and chaos ensues. The most common symptom is double values.

Stats should be split out as an entirely separate service with its own database that includes the current tos and froms persisted map-reduce collections. Rebuilds should create temp collections and hot-swap them when complete. Both refreshes and rebuilds should be protected from concurrent starts, and should provide kill commands.

@georgesnelling georgesnelling removed the Bug label Nov 6, 2014
@georgesnelling georgesnelling changed the title stats collections have no protection from concurrent rebuild / refresh commands Split stats into standalone service Nov 6, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant