Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Additions #48035

Closed
wants to merge 16 commits into from

Regen code and add test for developer message

9d77c8a
Select commit
Loading
Failed to load commit list.
Closed

Feature Additions #48035

Regen code and add test for developer message
9d77c8a
Select commit
Loading
Failed to load commit list.
Azure Pipelines / net - ai - inference - ci failed Feb 7, 2025 in 9m 22s

Build #20250206.1 had test failures

9 errors / 111 warnings

Details

Tests

  • Failed: 546 (29.77%)
  • Passed: 959 (52.29%)
  • Other: 329 (17.94%)
  • Total: 1,834
Code coverage

  • 7588 of 37194 line covered (20.40%)

Annotations

Check failure on line 462 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Build log #L462 

Generated code is not up to date.
    You may need to rebase on the latest main, 
    run 'eng\scripts\Update-Snippets.ps1' if you modified sample snippets or other *.md files (https://github.com/Azure/azure-sdk-for-net/blob/main/CONTRIBUTING.md#updating-sample-snippets), 
    run 'eng\scripts\Export-API.ps1' if you changed public APIs (https://github.com/Azure/azure-sdk-for-net/blob/main/CONTRIBUTING.md#public-api-additions). 
    run 'dotnet build /t:GenerateCode' to update the generated code and samples.
    
To reproduce this error locally, run 'eng\scripts\CodeChecks.ps1 -ServiceDirectory ai'.

Check failure on line 489 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Build log #L489 

PowerShell exited with code '1'.

Check failure on line 2149 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Build log #L2149 

Bash exited with code '1'.

Check failure on line 2250 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Build log #L2250 

Bash exited with code '1'.

Check failure on line 1 in Azure.AI.Inference.Tests.InferenceClientTelemetryTest(False).TestMultipleChoices(Basic)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Azure.AI.Inference.Tests.InferenceClientTelemetryTest(False).TestMultipleChoices(Basic) 

Azure.Core.TestFramework.TestRecordingMismatchException : If this is a new recording, make sure you have pushed the recordings to the assets repository. For instructions, see: https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/core/Azure.Core.TestFramework/README.md#recording

Unable to find a record for the request POST https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview
Remaining entry: https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview
Uri doesn't match:
    request <https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview>
    record  <https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview>
Header differences:
Body differences:
Raw output 
   at Azure.Core.TestFramework.ProxyTransport.ProcessResponseAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 123
   at Azure.Core.TestFramework.ProxyTransport.ProcessAsyncInternalAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 88
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(Task task) in /mnt/vss/_work/1/s/sdk/core/Azure.Core/src/Shared/TaskExtensions.cs:line 43
   at Azure.Core.TestFramework.ProxyTransport.Process(HttpMessage message) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 63
   at Azure.Core.Pipeline.HttpPipelineTransportPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RequestActivityPolicy.ProcessNextAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RequestActivityPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.ResponseBodyPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.ResponseBodyPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.LoggingPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RedirectPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.RedirectPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.RetryPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.AI.Inference.ChatCompletionsClient.AddApiKeyHeaderPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline) in /_/sdk/ai/Azure.AI.Inference/src/Customized/ChatCompletionsClient.cs:line 375
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipeline.Send(HttpMessage message, CancellationToken cancellationToken)
   at Azure.Core.HttpPipelineExtensions.ProcessMessage(HttpPipeline pipeline, HttpMessage message, RequestContext requestContext, CancellationToken cancellationToken) in /_/sdk/core/Azure.Core/src/Shared/HttpPipelineExtensions.cs:line 40
   at Azure.AI.Inference.ChatCompletionsClient.Complete(RequestContent content, String extraParams, RequestContext context) in /_/sdk/ai/Azure.AI.Inference/src/Cust

Check failure on line 1 in Azure.AI.Inference.Tests.InferenceClientTelemetryTest(False).TestGoodChatResponse(Streaming,False,True)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Azure.AI.Inference.Tests.InferenceClientTelemetryTest(False).TestGoodChatResponse(Streaming,False,True) 

Azure.Core.TestFramework.TestRecordingMismatchException : If this is a new recording, make sure you have pushed the recordings to the assets repository. For instructions, see: https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/core/Azure.Core.TestFramework/README.md#recording

Unable to find a record for the request POST https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview
Remaining entry: https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview
Uri doesn't match:
    request <https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview>
    record  <https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview>
Header differences:
Body differences:
Raw output 
   at Azure.Core.TestFramework.ProxyTransport.ProcessResponseAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 123
   at Azure.Core.TestFramework.ProxyTransport.ProcessAsyncInternalAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 88
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(Task task) in /mnt/vss/_work/1/s/sdk/core/Azure.Core/src/Shared/TaskExtensions.cs:line 43
   at Azure.Core.TestFramework.ProxyTransport.Process(HttpMessage message) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 63
   at Azure.Core.Pipeline.HttpPipelineTransportPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RequestActivityPolicy.ProcessNextAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RequestActivityPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.ResponseBodyPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.ResponseBodyPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.LoggingPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RedirectPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.RedirectPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.RetryPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.AI.Inference.ChatCompletionsClient.AddApiKeyHeaderPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline) in /_/sdk/ai/Azure.AI.Inference/src/Customized/ChatCompletionsClient.cs:line 375
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipeline.Send(HttpMessage message, CancellationToken cancellationToken)
   at Azure.Core.HttpPipelineExtensions.ProcessMessage(HttpPipeline pipeline, HttpMessage message, RequestContext requestContext, CancellationToken cancellationToken) in /_/sdk/core/Azure.Core/src/Shared/HttpPipelineExtensions.cs:line 40
   at Azure.AI.Inference.ChatCompletionsClient.CompleteStreaming(ChatCompletionsOptions chatCompletionsOptions, CancellationToken cancellationToken) in /_/sdk/ai/Az

Check failure on line 1 in Azure.AI.Inference.Tests.InferenceClientTelemetryTest(False).TestGoodChatResponse(Streaming,True,True)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Azure.AI.Inference.Tests.InferenceClientTelemetryTest(False).TestGoodChatResponse(Streaming,True,True) 

Azure.Core.TestFramework.TestRecordingMismatchException : If this is a new recording, make sure you have pushed the recordings to the assets repository. For instructions, see: https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/core/Azure.Core.TestFramework/README.md#recording

Unable to find a record for the request POST https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview
Remaining entry: https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview
Uri doesn't match:
    request <https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview>
    record  <https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview>
Header differences:
Body differences:
Raw output 
   at Azure.Core.TestFramework.ProxyTransport.ProcessResponseAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 123
   at Azure.Core.TestFramework.ProxyTransport.ProcessAsyncInternalAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 88
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(Task task) in /mnt/vss/_work/1/s/sdk/core/Azure.Core/src/Shared/TaskExtensions.cs:line 43
   at Azure.Core.TestFramework.ProxyTransport.Process(HttpMessage message) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 63
   at Azure.Core.Pipeline.HttpPipelineTransportPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RequestActivityPolicy.ProcessNextAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RequestActivityPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.ResponseBodyPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.ResponseBodyPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.LoggingPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RedirectPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.RedirectPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.TaskExtensions.EnsureCompleted(ValueTask task)
   at Azure.Core.Pipeline.RetryPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.AI.Inference.ChatCompletionsClient.AddApiKeyHeaderPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline) in /_/sdk/ai/Azure.AI.Inference/src/Customized/ChatCompletionsClient.cs:line 375
   at Azure.Core.Pipeline.HttpPipelinePolicy.ProcessNext(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipelineSynchronousPolicy.Process(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.HttpPipeline.Send(HttpMessage message, CancellationToken cancellationToken)
   at Azure.Core.HttpPipelineExtensions.ProcessMessage(HttpPipeline pipeline, HttpMessage message, RequestContext requestContext, CancellationToken cancellationToken) in /_/sdk/core/Azure.Core/src/Shared/HttpPipelineExtensions.cs:line 40
   at Azure.AI.Inference.ChatCompletionsClient.CompleteStreaming(ChatCompletionsOptions chatCompletionsOptions, CancellationToken cancellationToken) in /_/sdk/ai/Az

Check failure on line 1 in Azure.AI.Inference.Tests.ChatCompletionsClientTest(True).TestChatCompletionsFunctionToolHandling(UseFunctionByExplicitToolDefinitionForToolChoice,GitHubGpt4o)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - ai - inference - ci

Azure.AI.Inference.Tests.ChatCompletionsClientTest(True).TestChatCompletionsFunctionToolHandling(UseFunctionByExplicitToolDefinitionForToolChoice,GitHubGpt4o) 

System.InvalidOperationException : Unable to find environment variable AI_AZUREAI_GITHUB_TOKEN or AZUREAI_GITHUB_TOKEN required by test.
Make sure the test environment was initialized using the eng/common/TestResources/New-TestResources.ps1 script.
Raw output 
   at Azure.Core.TestFramework.TestEnvironment.EnsureValue(String name, String value) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 539
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name, Action`1 options) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 471
   at Azure.AI.Inference.Tests.InferenceClientTestEnvironment.get_GithubToken() in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/InferenceClientTestEnvironment.cs:line 16
   at Azure.AI.Inference.Tests.ChatCompletionsClientTest.TestChatCompletionsFunctionToolHandling(ToolChoiceTestType toolChoiceType, TargetModel targetModel) in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/ChatCompletionsClientTest.cs:line 326
   at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.GetResult()
   at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)
View more details on Azure Pipelines