Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Additions #48035

Open
wants to merge 16 commits into
base: feature/azure-ai-inference-beta-3
Choose a base branch
from

Regen code and add test for developer message

9d77c8a
Select commit
Loading
Failed to load commit list.
Open

Feature Additions #48035

Regen code and add test for developer message
9d77c8a
Select commit
Loading
Failed to load commit list.
Azure Pipelines / net - pullrequest failed Feb 7, 2025 in 14m 34s

Build #20250206.27 had test failures

9 errors / 115 warnings

Details

Tests

  • Failed: 546 (2.17%)
  • Passed: 24,087 (95.91%)
  • Other: 482 (1.92%)
  • Total: 25,115
Code coverage

  • 13654 of 42115 line covered (32.42%)

Annotations

Check failure on line 462 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Build log #L462 

Generated code is not up to date.
    You may need to rebase on the latest main, 
    run 'eng\scripts\Update-Snippets.ps1' if you modified sample snippets or other *.md files (https://github.com/Azure/azure-sdk-for-net/blob/main/CONTRIBUTING.md#updating-sample-snippets), 
    run 'eng\scripts\Export-API.ps1' if you changed public APIs (https://github.com/Azure/azure-sdk-for-net/blob/main/CONTRIBUTING.md#public-api-additions). 
    run 'dotnet build /t:GenerateCode' to update the generated code and samples.
    
To reproduce this error locally, run 'eng\scripts\CodeChecks.ps1 -ServiceDirectory ai'.

Check failure on line 489 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Build log #L489 

PowerShell exited with code '1'.

Check failure on line 5444 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Build log #L5444 

Bash exited with code '1'.

Check failure on line 5510 in Build log

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Build log #L5510 

Bash exited with code '1'.

Check failure on line 1 in Azure.AI.Inference.Tests.ChatCompletionsClientTest(True).TestChatCompletionsFunctionToolHandling(UseAutoPresetToolChoice,MistralSmall)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Azure.AI.Inference.Tests.ChatCompletionsClientTest(True).TestChatCompletionsFunctionToolHandling(UseAutoPresetToolChoice,MistralSmall) 

System.InvalidOperationException : Unable to find environment variable AI_AZUREAI_MISTRAL_SMALL_URL or AZUREAI_MISTRAL_SMALL_URL required by test.
Make sure the test environment was initialized using the eng/common/TestResources/New-TestResources.ps1 script.
Raw output 
   at Azure.Core.TestFramework.TestEnvironment.EnsureValue(String name, String value) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 539
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name, Action`1 options) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 471
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 456
   at Azure.AI.Inference.Tests.InferenceClientTestEnvironment.get_MistralSmallEndpoint() in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/InferenceClientTestEnvironment.cs:line 10
   at Azure.AI.Inference.Tests.ChatCompletionsClientTest.TestChatCompletionsFunctionToolHandling(ToolChoiceTestType toolChoiceType, TargetModel targetModel) in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/ChatCompletionsClientTest.cs:line 318
   at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.GetResult()
   at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)

Check failure on line 1 in Azure.AI.Inference.Tests.ChatCompletionsClientTest(False).TestChatCompletionsFunctionToolHandling(UseNonePresetToolChoice,MistralSmall)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Azure.AI.Inference.Tests.ChatCompletionsClientTest(False).TestChatCompletionsFunctionToolHandling(UseNonePresetToolChoice,MistralSmall) 

System.InvalidOperationException : Unable to find environment variable AI_AZUREAI_MISTRAL_SMALL_URL or AZUREAI_MISTRAL_SMALL_URL required by test.
Make sure the test environment was initialized using the eng/common/TestResources/New-TestResources.ps1 script.
Raw output 
   at Azure.Core.TestFramework.TestEnvironment.EnsureValue(String name, String value) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 539
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name, Action`1 options) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 471
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 456
   at Azure.AI.Inference.Tests.InferenceClientTestEnvironment.get_MistralSmallEndpoint() in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/InferenceClientTestEnvironment.cs:line 10
   at Azure.AI.Inference.Tests.ChatCompletionsClientTest.TestChatCompletionsFunctionToolHandling(ToolChoiceTestType toolChoiceType, TargetModel targetModel) in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/ChatCompletionsClientTest.cs:line 318
   at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.GetResult()
   at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)

Check failure on line 1 in Azure.AI.Inference.Tests.InferenceClientTelemetryTest(True).TestToolCalls(Basic)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Azure.AI.Inference.Tests.InferenceClientTelemetryTest(True).TestToolCalls(Basic) 

Azure.Core.TestFramework.TestRecordingMismatchException : If this is a new recording, make sure you have pushed the recordings to the assets repository. For instructions, see: https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/core/Azure.Core.TestFramework/README.md#recording

Unable to find a record for the request POST https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview
Remaining entry: https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview
Uri doesn't match:
    request <https://models.inference.ai.azure.com/chat/completions?api-version=2024-05-01-preview>
    record  <https://int.api.azureml-test.ms/nexus/chat/completions?api-version=2024-05-01-preview>
Header differences:
Body differences:
Raw output 
   at Azure.Core.TestFramework.ProxyTransport.ProcessResponseAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 123
   at Azure.Core.TestFramework.ProxyTransport.ProcessAsyncInternalAsync(HttpMessage message, Boolean async) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 88
   at Azure.Core.TestFramework.ProxyTransport.ProcessAsync(HttpMessage message) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/ProxyTransport.cs:line 66
   at Azure.Core.Pipeline.HttpPipelineTransportPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline)
   at Azure.Core.Pipeline.ResponseBodyPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RedirectPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.Pipeline.RetryPolicy.ProcessAsync(HttpMessage message, ReadOnlyMemory`1 pipeline, Boolean async)
   at Azure.Core.HttpPipelineExtensions.ProcessMessageAsync(HttpPipeline pipeline, HttpMessage message, RequestContext requestContext, CancellationToken cancellationToken) in /_/sdk/core/Azure.Core/src/Shared/HttpPipelineExtensions.cs:line 19
   at Azure.AI.Inference.ChatCompletionsClient.CompleteAsync(RequestContent content, String extraParams, RequestContext context) in /_/sdk/ai/Azure.AI.Inference/src/Customized/ChatCompletionsClient.cs:line 282
   at Azure.AI.Inference.ChatCompletionsClient.CompleteAsync(ChatCompletionsOptions chatCompletionsOptions, CancellationToken cancellationToken) in /_/sdk/ai/Azure.AI.Inference/src/Customized/ChatCompletionsClient.cs:line 78
   at Azure.AI.Inference.Tests.InferenceClientTelemetryTest.TestToolCalls(TestType testType) in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/InferenceClientTelemetryTest.cs:line 274
   at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.BlockUntilCompleted()
   at NUnit.Framework.Internal.MessagePumpStrategy.NoMessagePumpStrategy.WaitForCompletion(AwaitAdapter awaiter)
   at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)

Check failure on line 1 in Azure.AI.Inference.Tests.ChatCompletionsClientTest(False).TestChatCompletionsFunctionToolHandlingWithStreaming(UseAutoPresetToolChoice,MistralSmall)

See this annotation in the file changed.

@azure-pipelines azure-pipelines / net - pullrequest

Azure.AI.Inference.Tests.ChatCompletionsClientTest(False).TestChatCompletionsFunctionToolHandlingWithStreaming(UseAutoPresetToolChoice,MistralSmall) 

System.InvalidOperationException : Unable to find environment variable AI_AZUREAI_MISTRAL_SMALL_URL or AZUREAI_MISTRAL_SMALL_URL required by test.
Make sure the test environment was initialized using the eng/common/TestResources/New-TestResources.ps1 script.
Raw output 
   at Azure.Core.TestFramework.TestEnvironment.EnsureValue(String name, String value) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 539
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name, Action`1 options) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 471
   at Azure.Core.TestFramework.TestEnvironment.GetRecordedVariable(String name) in /mnt/vss/_work/1/s/sdk/core/Azure.Core.TestFramework/src/TestEnvironment.cs:line 456
   at Azure.AI.Inference.Tests.InferenceClientTestEnvironment.get_MistralSmallEndpoint() in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/InferenceClientTestEnvironment.cs:line 10
   at Azure.AI.Inference.Tests.ChatCompletionsClientTest.TestChatCompletionsFunctionToolHandlingWithStreaming(ToolChoiceTestType toolChoiceType, TargetModel targetModel) in /mnt/vss/_work/1/s/sdk/ai/Azure.AI.Inference/tests/ChatCompletionsClientTest.cs:line 695
   at NUnit.Framework.Internal.TaskAwaitAdapter.GenericAdapter`1.GetResult()
   at NUnit.Framework.Internal.AsyncToSyncAdapter.Await(Func`1 invoke)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.RunTestMethod(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.TestMethodCommand.Execute(TestExecutionContext context)
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.<>c__DisplayClass1_0.<Execute>b__0()
   at NUnit.Framework.Internal.Commands.BeforeAndAfterTestCommand.RunTestMethodInThreadAbortSafeZone(TestExecutionContext context, Action action)
View more details on Azure Pipelines