Skip to content

Commit

Permalink
Fix CPU only build
Browse files Browse the repository at this point in the history
  • Loading branch information
krishung5 committed Oct 25, 2023
1 parent 353a5ed commit 53fedbc
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions src/infer_response.cc
Original file line number Diff line number Diff line change
Expand Up @@ -249,9 +249,11 @@ InferResponse::Send(
}

bool cuda_copy = false;
#ifdef TRITON_ENABLE_GPU
// This variable is used to avoid printing the same message multiple times
// when the output tensor is failed to be allocated from the CUDA memory pool.
bool log_warning = true;
#endif // TRITON_ENABLE_GPU

for (auto& output_tensor : OutputTensors()) {
// FIXME: for decoupled models we will skip the requested output names.
Expand Down

0 comments on commit 53fedbc

Please sign in to comment.