Add new nvtext tokenized minhash API

[davidwendt]

Description

Creates a new minhash API that works on ngrams of row elements given a list column of strings.

std::unique_ptr<cudf::column> minhash_ngrams(
  cudf::lists_column_view const& input,
  cudf::size_type ngrams,
  uint32_t seed,
  cudf::device_span<uint32_t const> parameter_a,
  cudf::device_span<uint32_t const> parameter_b,
  rmm::cuda_stream_view stream,
  rmm::device_async_resource_ref mr);

The input column is expected to be rows of words (strings) and each row is hashed using a sliding window of words (ngrams) and then the permuted algorithm is re-used to produce the minhash values.

Checklist

• I am familiar with the Contributing Guidelines.
• New or existing tests cover these changes.
• The documentation is up to date with these changes.

[copy-pr-bot]

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

[davidwendt]

/ok to test

[davidwendt]

/ok to test

[davidwendt]

/ok to test

[davidwendt]

/ok to test

[davidwendt]

/ok to test

[ayushdg]

Was able to test this PR on larger scale datasets and the results seem to be in line with what we would expect for the given data. I'll run more experiments in the future and open issues if I observe unexpected behavior, but this should be good to go and works for our needs. Thanks!

[PointKernel]

Very clean code, looks great!

[mhaseeb123]

C++ changes LGTM

[davidwendt]

/merge