Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[EPIC]: mdspan-based algorithms #2471

Open
1 task done
fbusato opened this issue Sep 27, 2024 · 0 comments
Open
1 task done

[EPIC]: mdspan-based algorithms #2471

fbusato opened this issue Sep 27, 2024 · 0 comments
Assignees
Labels
2.8.0 target for 2.8.0 release feature request New feature or request.

Comments

@fbusato
Copy link
Contributor

fbusato commented Sep 27, 2024

Is this a duplicate?

Area

libcu++

Is your feature request related to a problem? Please describe.

  1. mdspan represents the C++ abstraction for multidimensional data. We currently support only a small subset of available features
  2. The llm.c version presented to the CUDA MODE group can be greatly simplified and improved by supporting additional features related to mdspan

Describe the solution you'd like

  • Provide a cuda:: streaming accessor instead of manually instantiate it
  • Allow mdspan to support device-only/host-only code for custom accessors and layouts
  • Provide for_each_in_extent to directly linearization/de-linearization multidimensional indices
  • Provide mdarray (owning version of mdspan)
  • Provide a vocabulary type to declare host or device mdspan/mdarray

Describe alternatives you've considered

No response

Additional context

No response

@fbusato fbusato added the feature request New feature or request. label Sep 27, 2024
@fbusato fbusato self-assigned this Sep 27, 2024
@github-project-automation github-project-automation bot moved this to Todo in CCCL Sep 27, 2024
@fbusato fbusato changed the title [EPIC]: Modernize llm.c mdspan usage [EPIC]: mdspan-based algorithms Nov 15, 2024
@jollylili jollylili added the 2.8.0 target for 2.8.0 release label Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
2.8.0 target for 2.8.0 release feature request New feature or request.
Projects
Status: Todo
Development

No branches or pull requests

2 participants