streamparse 3.0.0.dev3
Pre-releaseThis is the fourth developer preview release of streamparse 3.0. In addition to having been extensively tested in production, this version also is the first in the 3.0 line that has sparse run
back in it. However it is only supports on Storm 0.10.0+ and requires you to add [org.apache.storm/flux-core "0.10.0"]
to your dependencies in your project.clj
, because it uses Storm's new Flux library to start the local cluster.
You can install this release via pip with pip install --pre streamparse==3.0.0.dev3
. It will not automatically install because it's a pre-release.
⚠️ API Breaking Changes ⚠️
In addition to those outlined in the 3.0.0dev0 and 3.0.0dev1 release notes, this release introduces the following backwards incompatible changes from pinning our pystorm version to 3.0+:
need_task_ids
defaults toFalse
instead ofTrue
in allemit()
method calls. If you were previously storing the task IDs that your tuples were emitted to (which is pretty rare), then you must passneed_task_ids=True
in youremit()
calls. This should provide a little speed boost to most users, because we do not need to wait on a return message from Storm for every emitted tuple.- Instead of having the
log.level
setting in yourconfig.json
influence the root logger's level, only your component (and itsStormHandler
if you haven't setlog.path
)'s levels will be set. - When
log.path
is not set in yourconfig.json
, pystorm will no longer issue warning about how you should set it; instead, it will automatically set up aStormHandler
and log everything directly to your Storm logs. This is really handy as in Storm 1.0 there's support through the UI for searching logs.
Features
- Added back
sparse run
(PR #244)