Skip to content

GH-46149: [C++] Opening dataset fails with sshfs-3.7.3 due to F_RDADVISE error #46346

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
May 12, 2025

Conversation

thisisnic
Copy link
Member

@thisisnic thisisnic commented May 7, 2025

Rationale for this change

Fix a bug where cache optimisation errors prevent files being read

What changes are included in this PR?

No longer treat WillNeed errors in ReadRangeCache::Cache as fatal

Are these changes tested?

No

Are there any user-facing changes?

No

@thisisnic
Copy link
Member Author

@github-actions autotune

@thisisnic thisisnic requested a review from pitrou May 9, 2025 16:18
Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @thisisnic , minor suggestion here.

@@ -188,7 +188,9 @@ struct ReadRangeCache::Impl {
entries = std::move(new_entries);
}
// Prefetch immediately, regardless of executor availability, if possible
return file->WillNeed(ranges);
// As this is optimisation only, failures should not be treated as fatal
ARROW_UNUSED(file->WillNeed(ranges));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would rather we just ignore IOError but less other errors propagate (they might be indicative of a logic error).

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gotcha, have updated it now.

@thisisnic thisisnic force-pushed the gh-46149_fradvise branch from fee89f2 to 195d032 Compare May 12, 2025 10:31
@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting committer review Awaiting committer review labels May 12, 2025
Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, thank you @thisisnic !

@thisisnic thisisnic merged commit c3855b9 into apache:main May 12, 2025
36 of 38 checks passed
@thisisnic thisisnic removed the awaiting changes Awaiting changes label May 12, 2025
@r2evans
Copy link

r2evans commented May 12, 2025

Thanks @thisisnic 🥇 .... bummer we missed 20.0.0 a couple of days, 🤞 a patch-release is soon :-)

Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit c3855b9.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 35 possible false positives for unstable benchmarks that are known to sometimes produce them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants