1.14.0-rc0

TensorFlow Serving using TensorFlow 1.14.0-rc0.

Major Features and Improvements

• Use MKL-DNN contraction kernels by default. (commit: a075ebe)
• Add option to refuse to unload the last servable version. (commit: c8496b1)
• Add ability to disable periodic filesystem polling (#1295). (commit: 7245055)

Breaking Changes

• No breaking changes.

Bug Fixes and Other Changes

• Add enforce_session_run_timeout inside Server::Options. (commit: de03064)
• Add -o option, to pass params to docker command. (commit: dd59021)
• Stop using reader locks (tf_shared_lock) on the read path of FastReadDynamicPtr. (commit: f04e583)
• Add saved model tags to logging metadata. These tags are used by (commit: 6320701)
• Adds an option in SessionBundleConfig to repeat warmup replay n times per request. (commit: 15cd202)
• Improve tpu server warm up (commit: 63d31a3)
• Official PIP package releases are now tied to a specific version of TensorFlow (commit: 9514c37)
• Bump the minimal Bazel version to 0.24.1 (commit: 96a716c)
• Add new device type for TPU. (commit: c74861d)
• Fix incorrect formatting of decimal numbers in JSON output (#1332) (commit: d7c3b3d)
• Fixed the gzip uncompression support in the HTTP server for large request bodies. (commit: fb7835c)
• Add stack memory resource kind. (commit: e56e72b)
• Adds ModelServer test for loading SavedModel exported from Keras Sequential API (commit: 9578f3d)
• Ignore SIGPIPE for libevent，prevent the SIGPIPE signal from being raised (#1257) (commit: 8d88a5b)
• Fix #1367 (commit: 58af901)
• Update Serving_REST_simple.ipynb (commit: 3870ba5)
• Updates README with link to architecture overview (commit: d233a82)
• Update example section to use Docker (commit: a5fc8bb)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

G. Hussain Chinoy, Karthik Vadla, mkim301, yjhjstz

1.13.0

TensorFlow Serving using TensorFlow 1.13.1

Major Features and Improvements

• Support for TensorRT 5.0 (GPU docker image built against CUDA 10 and TensorRT 5.0)
• Support for listening gRPC over UNIX socket (commit: a25b0da)
• New GPU version of TensorFlow Serving API PIP package. This depends on the tensorflow-gpu instead of tensorflow PIP package, but is otherwise identical. (commit: 525c1af)
• TF Serving end-to-end colab! Training with Keras, serving with TF Serving and REST API (commit: 1ff8aad)

Breaking Changes

• No breaking changes.

Bug Fixes and Other Changes

• Make error message for input size mismatch in Predict call even more actionable. (commit: 7237fb5)
• Document how to use the version policy to pin a specific version, or serve multiple versions, of a model. (commit: 2724bfe)
• Document config reloading and model version labels. (commit: f4890af)
• Fix the compile error on ARM-32 in net_http/server. (commit: 5446fd9)
• Adds ModelSpec to SessionRunResponse. (commit: 58a2263)
• Add MKL support (commit: 8f79253)
• Fix default path of Prometheus metrics endpoint (commit: 9d05b0c)
• Add monitoring metrics for saved model (export_dir) warm up latency. (commit: de0935b)
• Add more details/clarification to model version labels documentation. (commit: f9e6ac4)
• Split --tensorflow_session_parallelism flag into two new flags: --tensorflow_intra_op_parallelism and --tensorflow_inter_op_parallelism (commit: 71092e4)
• Update CPU Docker images to Ubuntu 18.04 (commit: 8023fba)
• Upgrade to Bazel 0.20.0 (commit: fc0b75f)
• Update Python 2 scripts to be compatible with both Python 2 and 3 (commit: 846d443)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Daniel Shi, Karthik Vadla, lapolonio, robert, Shintaro Murakami, Siju, Tom Forbes, Ville TöRhöNen

1.13.0-rc1

TensorFlow Serving using TensorFlow 1.13.0-rc1

Major Features and Improvements

• Support for TensorRT 5.0 (GPU docker image built against CUDA 10 and TensorRT 5.0)
• Support for listening gRPC over UNIX socket (commit: a25b0da)
• New GPU version of TensorFlow Serving API PIP package. This depends on the tensorflow-gpu instead of tensorflow PIP package, but is otherwise identical. (commit: 525c1af)
• TF Serving end-to-end colab! Training with Keras, serving with TF Serving and REST API (commit: 1ff8aad)

Breaking Changes

• No breaking changes.

Bug Fixes and Other Changes

• Make error message for input size mismatch in Predict call even more actionable. (commit: 7237fb5)
• Document how to use the version policy to pin a specific version, or serve multiple versions, of a model. (commit: 2724bfe)
• Document config reloading and model version labels. (commit: f4890af)
• Fix the compile error on ARM-32 in net_http/server. (commit: 5446fd9)
• Adds ModelSpec to SessionRunResponse. (commit: 58a2263)
• Add MKL support (commit: 8f79253)
• Fix default path of Prometheus metrics endpoint (commit: 9d05b0c)
• Add monitoring metrics for saved model (export_dir) warm up latency. (commit: de0935b)
• Add more details/clarification to model version labels documentation. (commit: f9e6ac4)
• Split --tensorflow_session_parallelism flag into two new flags: --tensorflow_intra_op_parallelism and --tensorflow_inter_op_parallelism (commit: 71092e4)
• Update CPU Docker images to Ubuntu 18.04 (commit: 8023fba)
• Upgrade to Bazel 0.20.0 (commit: fc0b75f)
• Update Python 2 scripts to be compatible with both Python 2 and 3 (commit: 846d443)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Daniel Shi, Karthik Vadla, lapolonio, robert, Shintaro Murakami, Siju, Tom Forbes, Ville TöRhöNen

1.12.0

TensorFlow Serving using TensorFlow 1.12.0

Major Features and Improvements

• Add new REST API to get model status from ModelServer (commit: 00e459f)
• Add new REST API to get model metadata from ModelServer (fixes #1115) (commit: 9768702)
• Support accepting gzipped REST API requests (fixes #1091) (commit: b94f6c8)

Breaking Changes

None

Bug Fixes and Other Changes

• Update MKL build (commit: e11bd51)
• Remove version pinning on pip packages (commit: 462072c)
• Update basic serving tutorials (commit: 33a4b05)
• Replacing legacy_init_op argument in SavedModelBuilder with main_op. (commit: 2fda31f)
• Add git hash for version metadata of model server and add tags for dev and nightly builds. (commit: 5c7740f)
• Add error messages for specific cases when json for REST requests (commit: a17c892)
• Python examples now run in a hermetic environment with all required dependencies (commit: 793fd90)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Charles Verge, demfier, Kamidi Preetham, Lihang Li, naurril, vfdev, Yu Zheng

1.12.0-rc0

TensorFlow Serving using TensorFlow 1.12.0-rc2

Major Features and Improvements

• Add new REST API to get model status from ModelServer (commit: 00e459f)
• Add new REST API to get model metadata from ModelServer (fixes #1115) (commit: 9768702)
• Support accepting gzipped REST API requests (fixes #1091) (commit: b94f6c8)

Breaking Changes

Bug Fixes and Other Changes

• Update MKL build (commit: e11bd51)
• Remove version pinning on pip packages (commit: 462072c)
• Update basic serving tutorials (commit: 33a4b05)
• Replacing legacy_init_op argument in SavedModelBuilder with main_op. (commit: 2fda31f)
• Add git hash for version metadata of model server and add tags for dev and nightly builds. (commit: 5c7740f)
• Add error messages for specific cases when json for REST requests (commit: a17c892)
• Python examples now run in a hermetic environment with all required dependencies (commit: 793fd90)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Charles Verge, demfier, Kamidi Preetham, Lihang Li, naurril, vfdev, Yu Zheng

1.11.1

TensorFlow Serving using TensorFlow 1.11.0

Bug Fixes and Other Changes

• Fix version of model server binary (Fixes #1134)
• Range check floating point numbers correctly (Fixes #1136).
• Fix docker run script for same user and group name (Fixes #1137).
• Fix GPU build (Fixes #1150)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

vfdev

1.11.0

TensorFlow Serving using TensorFlow 1.11.0

Major Features and Improvements

• Prometheus exporter for TF metrics (see 021efbd for details).

Breaking Changes

• No breaking changes

Bug Fixes and Other Changes

• Built against TensorFlow 1.11.0
• Accept integers for float/doubles in JSON REST API requests
• TF Serving API is now pre-built into Docker development images
• GPU Docker images are now built against cuDNN 7.2
• Add --max_num_load_retries flag to ModelServer (fixes #1099)
• Add user-configured model version labels to the stand-alone ModelServer binary.
• Directly import tensor.proto.h (the transitive import will be removed from tensor.h soon)
• Building optimized TensorFlow Serving binaries is now easier (see docs for details)
• Adds columnar format support for input/output tensors in Predict REST API (fixes #1047)
• Development Dockerfiles now produce a more optimized ModelServer
• Fixed TensorFlow Serving API PyPi package overwriting TensorFlow package.

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Feisan, joshua.horowitz, Prashanth Reddy Basani, tianyapiaozi, Vamsi Sripathi, Yu Zheng

1.11.0-rc1

TensorFlow Serving using TensorFlow 1.11.0-rc1

1.11.0-rc0

Release 1.11.0-rc0

Major Features and Improvements

• Prometheus exporter for TF metrics (see 021efbd for details).
• Added new REST API to get status of model(s) from ModelServer.

Breaking Changes

• No breaking changes

Bug Fixes and Other Changes

• Built against TensorFlow 1.11.0-rc0.
• Directly import tensor.proto.h (the transitive import will be removed from tensor.h soon)
• Building optimized TensorFlow Serving binaries is now easier (see docs for details)
• Adds columnar format support for input/output tensors in Predict REST API (fixes #1047)
• Development Dockerfiles now produce a more optimized ModelServer
• Fixed TensorFlow Serving API PyPi package overwriting TensorFlow package.

TensorFlow Serving 1.10.1

Release 1.10.1

Bug Fixes and Other Changes

• Fixed TensorFlow Serving API PyPi package overwriting TensorFlow package.
• Update Docker configs to fix tensorflow/tensorflow#21518