You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently collections have no protection from concurrent rebuild / refresh commands.
We refresh stats every minute on the service using a recurring task. When the stats are screwed up we issue a /stats/rebuild command manually. If this doesn't finish within a minute the recurring refresh command merrily starts up and chaos ensues. The most common symptom is double values.
Stats should be split out as an entirely separate service with its own database that includes the current tos and froms persisted map-reduce collections. Rebuilds should create temp collections and hot-swap them when complete. Both refreshes and rebuilds should be protected from concurrent starts, and should provide kill commands.
The text was updated successfully, but these errors were encountered:
georgesnelling
changed the title
stats collections have no protection from concurrent rebuild / refresh commands
Split stats into standalone service
Nov 6, 2014
Currently collections have no protection from concurrent rebuild / refresh commands.
We refresh stats every minute on the service using a recurring task. When the stats are screwed up we issue a /stats/rebuild command manually. If this doesn't finish within a minute the recurring refresh command merrily starts up and chaos ensues. The most common symptom is double values.
Stats should be split out as an entirely separate service with its own database that includes the current tos and froms persisted map-reduce collections. Rebuilds should create temp collections and hot-swap them when complete. Both refreshes and rebuilds should be protected from concurrent starts, and should provide kill commands.
The text was updated successfully, but these errors were encountered: