Skip to content

Exposing FFI to python #1137

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

renato2099
Copy link
Contributor

Which issue does this PR close?

Closes #1091

Rationale for this change

Similar to exposing FFI for TableProviders, this PR exposes the capability for exposing CatalogProvider in python, now that apache/datafusion#15280 was merged.

What changes are included in this PR?

Includes the necessary changes to expose the FFICatalogProvider, an example, and the corresponding use case.

Are there any user-facing changes?

Yes, the new register_catalog method in the SessionContext
No breaking changes.

@renato2099
Copy link
Contributor Author

Hi @timsaucer , if you could please take a pass on this PR , that would be great, thanks!

@timsaucer
Copy link
Contributor

This is great. We had someone open a related issue #1103 and it would be fantastic if we could address both of them at once. Do you think you could enhance this PR to handle python based catalogs and schemas as well? It is something I was planning to work on but I've been hard at work trying to get metadata handling in the upstream repo. I still have a bit of work there before I can focus on this repo again. Which is to say, I can take what you have here (which is great) and work from it if you need.

Does that all make sense?

@renato2099
Copy link
Contributor Author

Do you think you could enhance this PR to handle python based catalogs and schemas as well?

yes, I can try to do so, I will go and read what this is about and come back :)

@renato2099 renato2099 force-pushed the renato2099/1091_ffi_cataglog branch from 7b09073 to af88c42 Compare June 29, 2025 22:30
@timsaucer
Copy link
Contributor

Thank you for this excellent work and for the review of the other PR. Do you think we can close this one?

@renato2099
Copy link
Contributor Author

Thank you for this excellent work and for the review of the other PR

happy to help :) if you have some other issues to be work on, please send them my way I will make my way through

Do you think we can close this one?

yes, please, thanks @timsaucer !

@renato2099 renato2099 closed this Jul 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add CatalogProvider and SchemaProvider
2 participants