Statistics

Web

Open the following url
http://localhost:8000/stats/show
***********************
Module ebot_db
***********************
disk_size:45
doc_count:6424
***********************
Module ebot_crawler
***********************
new_urls_counter:7759
visited_urls_counter:1959
***********************
Module ebot_html
***********************
worker-html-0:4
worker-html-1:2
worker-html-2:1
worker-html-3:0
***********************
Module ebot_mq
***********************
ebot.url.new.0:0
ebot.url.new.1:4057
ebot.url.new.2:1622
ebot.url.new.3:0
ebot.url.fetched.0:1024
ebot.url.fetched.1:366
ebot.url.fetched.2:3
ebot.url.fetched.3:0
ebot.url.processed.0:212
ebot.url.processed.1:234
ebot.url.processed.2:279
ebot.url.processed.3:0
ebot.url.refused.0:6
ebot.url.refused.1:5
ebot.url.refused.2:10
ebot.url.refused.3:0
***********************
Module ebot_web
***********************
worker-web-0:4
worker-web-1:2
worker-web-2:1
worker-web-3:0

RRD file

http://localhost:8000/stats/update_rrd

See http://oss.oetiker.ch/rrdtool/ for more info about Round Robin Databases (RRD)

See sample files under utils folder

• create-rrd.sh, for creating RRD files
• update-rrd.sh, for updating RRD files
• chart-rrd.sh, for charting RRD files