Running tests on Sauce Labs locally

To run grunt test-sauce locally, you need to get the username and access key from our saucelabs account. Ask someone on the plottable team for this information, or email [email protected]. After acquiring this information, run the following commands.

export SAUCE_USERNAME=[username here]

export SAUCE_ACCESS_KEY=[access key here]

After doing this, you should be able to just run grunt test-sauce. This process can take anywhere from 3-5 minutes. After running, you should see something like this in the output:

$ grunt test-sauce
Running "connect:server" (connect) task
Started connect web server on http://localhost:9999

Running "saucelabs-mocha:all" (saucelabs-mocha) task
=> Starting Tunnel to Sauce Labs
>> Connected to Saucelabs

 1 / 3 tests started

 2 / 3 tests started

 3 / 3 tests started


Tested http://127.0.0.1:9999/test/tests.html
Platform: ,chrome,35
Passed: true
Url https://assets.saucelabs.com/jobs/59cd68fe8cc6431b8d19935b208ee07c


Tested http://127.0.0.1:9999/test/tests.html
Platform: WIN8,internet explorer,10
Passed: true
Url https://assets.saucelabs.com/jobs/59b7259a6b9e4d5d8225afdad2ea2108


Tested http://127.0.0.1:9999/test/tests.html
Platform: WIN7,internet explorer,9
Passed: false
Url https://assets.saucelabs.com/jobs/5ea4c1cfb3874d87a9b3899d2d53afa1
>> All tests completed with status false
=> Stopping Tunnel to Sauce Labs
Warning: Task "saucelabs-mocha:all" failed. Use --force to continue.

Aborted due to warnings.

This shows that IE9 tests failed, so we can follow the assets.saucelabs link to see which ones.

Here's an example of a successful run.

$ grunt test-sauce
Running "connect:server" (connect) task
Started connect web server on http://localhost:9999

Running "saucelabs-mocha:all" (saucelabs-mocha) task
=> Starting Tunnel to Sauce Labs
>> Connected to Saucelabs

 1 / 2 tests started

 2 / 2 tests started


Tested http://127.0.0.1:9999/test/tests.html
Platform: ,chrome,35
Passed: true
Url https://assets.saucelabs.com/jobs/380a7f978e4b44258426da9ce8e0f7c4


Tested http://127.0.0.1:9999/test/tests.html
Platform: WIN8,internet explorer,10
Passed: true
Url https://assets.saucelabs.com/jobs/dd905fa8b3b9465e8cd01c1720be8ff6
>> All tests completed with status true
=> Stopping Tunnel to Sauce Labs

Done, without errors.

These Sauce Labs tests will also automatically run on a push.