Skip to content

Commit

Permalink
graph: backend: dnnl: add check for sdp decomp kernel
Browse files Browse the repository at this point in the history
filter out implicit causal mask in sdp decomp kernel
  • Loading branch information
ElaineBao committed Jan 21, 2025
1 parent 2dc60a7 commit 749c60b
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions src/graph/backend/dnnl/kernels/sdp_decomp_config.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -457,6 +457,8 @@ impl::status_t sdp_decomp_config_t::record_input_offset(
graph::op_kind::SoftMax};
for (const auto &cur_op : sg->get_ops()) {
const auto &op_kind = cur_op->get_kind();
VCHECK_SDP_DECOMP(op_kind == graph::op_kind::GenIndex,
status::unimplemented, "Not support implicit causal mask");
VCHECK_SDP_DECOMP(
!(op_kind == graph::op_kind::DynamicDequantize
&& cur_op->get_attr<std::string>(op_attr::qtype)
Expand Down

0 comments on commit 749c60b

Please sign in to comment.