Skip to content

[mlir] Optimize const values AffineMap::compose #141005

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 24, 2025
Merged

Conversation

qazwsxedcrfvtg14
Copy link
Contributor

The original implementation will create two intermediate AffineMap in the context, calling this compose function with different values multiple times will occupy a lot of memory.

To improve the performance, we can call the AffineExpr::replace directly, so we don't need to store all combinations of values in the context.

@llvmbot llvmbot added mlir:core MLIR Core Infrastructure mlir labels May 22, 2025
@llvmbot
Copy link
Member

llvmbot commented May 22, 2025

@llvm/pr-subscribers-mlir-core

@llvm/pr-subscribers-mlir

Author: qazwsxedcrfvtg14 (qazwsxedcrfvtg14)

Changes

The original implementation will create two intermediate AffineMap in the context, calling this compose function with different values multiple times will occupy a lot of memory.

To improve the performance, we can call the AffineExpr::replace directly, so we don't need to store all combinations of values in the context.


Full diff: https://github.com/llvm/llvm-project/pull/141005.diff

1 Files Affected:

  • (modified) mlir/lib/IR/AffineMap.cpp (+8-8)
diff --git a/mlir/lib/IR/AffineMap.cpp b/mlir/lib/IR/AffineMap.cpp
index 72effb38d614c..db8f76dec1e01 100644
--- a/mlir/lib/IR/AffineMap.cpp
+++ b/mlir/lib/IR/AffineMap.cpp
@@ -579,16 +579,16 @@ AffineMap AffineMap::compose(AffineMap map) const {
 
 SmallVector<int64_t, 4> AffineMap::compose(ArrayRef<int64_t> values) const {
   assert(getNumSymbols() == 0 && "Expected symbol-less map");
-  SmallVector<AffineExpr, 4> exprs;
-  exprs.reserve(values.size());
+  unsigned numValues = values.size();
+  DenseMap<AffineExpr, AffineExpr> mapping;
   MLIRContext *ctx = getContext();
-  for (auto v : values)
-    exprs.push_back(getAffineConstantExpr(v, ctx));
-  auto resMap = compose(AffineMap::get(0, 0, exprs, ctx));
+  for (unsigned idx = 0; idx < numValues; ++idx)
+    mapping[getAffineDimExpr(idx, ctx)] =
+        getAffineConstantExpr(values[idx], ctx);
   SmallVector<int64_t, 4> res;
-  res.reserve(resMap.getNumResults());
-  for (auto e : resMap.getResults())
-    res.push_back(cast<AffineConstantExpr>(e).getValue());
+  res.reserve(getNumResults());
+  for (auto e : getResults())
+    res.push_back(cast<AffineConstantExpr>(e.replace(mapping)).getValue());
   return res;
 }
 

The original implementation will create two intermediate AffineMap in the
context, calling this compose function with different values multiple
times will occupy a lot of memory.

To improve the performance, we can call the AffineExpr::replace
directly, so we don't need to store all combinations of values in the
context.
@qazwsxedcrfvtg14
Copy link
Contributor Author

It looks like I don't have the ability to merge the PR.
Could you merge the PR on my behalf?

Thanks!

@j2kun j2kun merged commit d5802c3 into llvm:main May 24, 2025
9 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mlir:core MLIR Core Infrastructure mlir
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants