Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added Query iterator method Continuation #89

Merged
merged 7 commits into from
Jul 13, 2024

Conversation

BlackGad
Copy link
Contributor

Initial PR #80

Here is comments fix and System.Text.Json package update because of compile errors (warning as errors )

Updated System.Text.Json package because of compile errors (warning as errors)
@BlackGad
Copy link
Contributor Author

Finally, can you please point to the corresponding Python code which I assume this is based on?

Here it is https://github.com/milvus-io/pymilvus/blob/6625af7fd0bfdf75fd596e7a9a871528cb539ef7/pymilvus/orm/iterator.py

Copy link
Collaborator

@roji roji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@BlackGad thanks, see comments below plus the unresolved comments on the original PR (#80).

But importantly, as I wrote there, please add tests - that's a vital part of implementing any new feature. Otherwise we can't be sure this actually works, and it may also accidentally break in the future without us knowing about it.

@@ -554,7 +564,7 @@ public Task<FlushResult> FlushAsync(CancellationToken cancellationToken = defaul
Value = Math.Min(batchSize, leftItemsCount).ToString(CultureInfo.InvariantCulture)
});

var nextExpression = pkField.DataType == DataType.VarChar
string nextExpression = pkField.DataType == DataType.VarChar
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do the same switch here as above, with an exception for unsupported types etc.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added

@@ -554,7 +564,7 @@ public Task<FlushResult> FlushAsync(CancellationToken cancellationToken = defaul
Value = Math.Min(batchSize, leftItemsCount).ToString(CultureInfo.InvariantCulture)
});

var nextExpression = pkField.DataType == DataType.VarChar
string nextExpression = pkField.DataType == DataType.VarChar
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In the concatenation below (nextExpression += $" and {userExpression}"), aren't you missing parentheses around the user expression, to prevent any possible operator precedence issues?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added

@BlackGad
Copy link
Contributor Author

Tests added

@BlackGad
Copy link
Contributor Author

Seems handled all the comments from previous PR.

@BlackGad
Copy link
Contributor Author

BlackGad commented Jul 13, 2024

What is strange that my local unit tests run is successful

image

@BlackGad
Copy link
Contributor Author

BlackGad commented Jul 13, 2024

It seems like there's a race condition error because I added the first tests for string keys.

Do you want me to remove the tests for string key schemas?

EDIT: My bad it was copy paste issue in tests. Forget to change collection name

@BlackGad BlackGad requested a review from roji July 13, 2024 10:40
@roji
Copy link
Collaborator

roji commented Jul 13, 2024

Thanks - but note that there are still test failures.

I'll try to review again soon, though note I'll be away for the coming week, so it will likely take a bit of time. You'll have to be patient.

@BlackGad
Copy link
Contributor Author

Thanks - but note that there are still test failures.

I'll try to review again soon, though note I'll be away for the coming week, so it will likely take a bit of time. You'll have to be patient.

Test run now successful. Am I missed some comments? Or we finished so far?

@roji
Copy link
Collaborator

roji commented Jul 13, 2024

Thanks, I'm going to merge this. I'll likely do another small pass next week with some cleanup/stuff before releasing.

@roji roji merged commit 92877fe into milvus-io:main Jul 13, 2024
2 checks passed
@BlackGad
Copy link
Contributor Author

@roji Thank you!

@BlackGad BlackGad deleted the vshkolka_query_iterator_support branch July 13, 2024 11:38
@BlackGad
Copy link
Contributor Author

@roji Hi! When release is planned? Still old version at NuGet.org

@lofcz
Copy link

lofcz commented Oct 10, 2024

Also looking forward to the next release - the progress has been plodding lately, are there any plans to continue the development of the library?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants