Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
danielfireman authored Mar 20, 2017
1 parent bdf881f commit 16550e0
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,18 +64,19 @@ If you would like to change URL parameters of the query (for instance, replay th
cat my_slowlogs.log | ./esperf loadspec parseslowlog "http://localhost:9200/wikipediax/_search?search_type=query_then_fetch" > slowlogs.loadspec.json
```

## Why esperf exists?
# Why esperf exists?

When researching for tools to load test ES I was quickly reminded by ES REST beauties and pointed out to [JMeter ](http://jmeter.apache.org/) or tools alike. As I needed to conduct experiments with very specific needs, I found that would be easier to build a tool myself than work around.

Also, I couldn't find a spec format that would respect the distribution of the arrival times. In particular, when parsing slowlogs, I would like to replay that respecting as much as possible the arrival times that were collected. I took a look at [Vegeta](https://github.com/tsenart/vegeta/) and [Yandex-Tank](https://github.com/yandex/yandex-tank) formats.

On the metrics side, I took a look at some ES plugins (i.e. [Marvel](https://www.elastic.co/downloads/marvel)) but I also bumped into some restrictions, for instance tune the metrics collection interval, pic and choose metrics and have access to raw data (CSV) to play with them in platforms like [R](https://www.r-project.org/) :heart:

# Inspiration
Non-exaustive list of sources of inspiration:

* [kosho/esperf](https://github.com/kosho/esperf): loadspec gen inspiration.
* [coxx/es-slowlog](https://github.com/coxx/es-slowlog): ideas and pointers to other loadspec file formats
* [tsenart/vegeta](https://github.com/tsenart/vegeta/) and [yandex/yandex-tank](https://github.com/yandex/yandex-tank): simple loadtest spec formats

# Thanks

Expand Down

0 comments on commit 16550e0

Please sign in to comment.