Skip to content

test failed in CI: test_updating_running_instance_boot_disk_is_conflict #8376

Open
@jgallagher

Description

@jgallagher

This test failed on a CI run on #8355:

https://github.com/oxidecomputer/omicron/pull/8355/checks?check_run_id=44280143791

Log showing the specific test failure:

https://buildomat.eng.oxide.computer/wg/0/details/01JXZFN364SXAAMEKX3B1ME99A/wlPySh1JOizRXVtTz0RISfO2qG08qAwt4YW8kleXsXvneZNu/01JXZFND2K2EW5E4MZA12FKSX6

Excerpt from the log showing the failure:

7323	2025-06-17T18:52:48.508Z	    log file: /var/tmp/omicron_tmp/test_all-19fa3b57abad3d04-test_updating_running_instance_boot_disk_is_conflict.24714.0.log
7324	2025-06-17T18:52:48.508Z	    note: configured to log to "/var/tmp/omicron_tmp/test_all-19fa3b57abad3d04-test_updating_running_instance_boot_disk_is_conflict.24714.0.log"
7325	2025-06-17T18:52:48.508Z	    DB URL: postgresql://root@[::1]:40409/omicron?sslmode=disable
7326	2025-06-17T18:52:48.508Z	    DB address: [::1]:40409
7327	2025-06-17T18:52:48.508Z	    log file: /var/tmp/omicron_tmp/test_all-19fa3b57abad3d04-test_updating_running_instance_boot_disk_is_conflict.24714.2.log
7328	2025-06-17T18:52:48.508Z	    note: configured to log to "/var/tmp/omicron_tmp/test_all-19fa3b57abad3d04-test_updating_running_instance_boot_disk_is_conflict.24714.2.log"
7329	2025-06-17T18:52:48.508Z	
7330	2025-06-17T18:52:48.508Z	    thread 'integration_tests::instances::test_updating_running_instance_boot_disk_is_conflict' panicked at sled-agent/src/sim/collection.rs:274:65:
7331	2025-06-17T18:52:48.508Z	    called `Result::unwrap()` on an `Err` value: InternalError { internal_message: "Communication Error: error sending request for url (http://127.0.0.1:63143/vmms/eb67c601-9668-4539-b0a1-86143e2872a0)" }
7332	2025-06-17T18:52:48.508Z	    stack backtrace:
7333	2025-06-17T18:52:48.508Z	       0: __rustc::rust_begin_unwind
7334	2025-06-17T18:52:48.508Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/panicking.rs:697:5
7335	2025-06-17T18:52:48.508Z	       1: core::panicking::panic_fmt
7336	2025-06-17T18:52:48.508Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/panicking.rs:75:14
7337	2025-06-17T18:52:48.508Z	       2: core::result::unwrap_failed
7338	2025-06-17T18:52:48.509Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/result.rs:1704:5
7339	2025-06-17T18:52:48.509Z	       3: unwrap<(), omicron_common::api::external::error::Error>
7340	2025-06-17T18:52:48.509Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/result.rs:1109:23
7341	2025-06-17T18:52:48.509Z	       4: {async_fn#0}<omicron_sled_agent::sim::instance::SimInstance>
7342	2025-06-17T18:52:48.509Z	                 at /work/oxidecomputer/omicron/sled-agent/src/sim/collection.rs:274:13
7343	2025-06-17T18:52:48.509Z	       5: {async_fn#0}
7344	2025-06-17T18:52:48.509Z	                 at /work/oxidecomputer/omicron/sled-agent/src/sim/sled_agent.rs:521:58
7345	2025-06-17T18:52:48.509Z	       6: {async_fn#0}
7346	2025-06-17T18:52:48.509Z	                 at /work/oxidecomputer/omicron/sled-agent/src/sim/http_entrypoints.rs:814:38
7347	2025-06-17T18:52:48.509Z	       7: {async_block#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>, fn(dropshot::handler::RequestContext<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>) -> omicron_sled_agent::sim::http_entrypoints::{impl#1}::from::instance_poke_post::{async_fn_env#0}, omicron_sled_agent::sim::http_entrypoints::{impl#1}::from::instance_poke_post::{async_fn_env#0}, dropshot::handler::HttpResponseUpdatedNoContent, dropshot::error::HttpError, dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>>
7348	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/handler.rs:664:78
7349	2025-06-17T18:52:48.509Z	       8: poll<alloc::boxed::Box<(dyn core::future::future::Future<Output=core::result::Result<http::response::Response<dropshot::body::Body>, dropshot::handler::HandlerError>> + core::marker::Send), alloc::alloc::Global>>
7350	2025-06-17T18:52:48.509Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/future/future.rs:124:9
7351	2025-06-17T18:52:48.509Z	       9: {async_block#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>, fn(dropshot::handler::RequestContext<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>) -> omicron_sled_agent::sim::http_entrypoints::{impl#1}::from::instance_poke_post::{async_fn_env#0}, (dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>), dropshot::handler::HttpResponseUpdatedNoContent>
7352	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/handler.rs:785:16
7353	2025-06-17T18:52:48.509Z	      10: poll<alloc::boxed::Box<(dyn core::future::future::Future<Output=core::result::Result<http::response::Response<dropshot::body::Body>, dropshot::handler::HandlerError>> + core::marker::Send), alloc::alloc::Global>>
7354	2025-06-17T18:52:48.509Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/future/future.rs:124:9
7355	2025-06-17T18:52:48.509Z	      11: {async_block#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>
7356	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:937:69
7357	2025-06-17T18:52:48.509Z	      12: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
7358	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/core.rs:331:17
7359	2025-06-17T18:52:48.509Z	      13: with_mut<tokio::runtime::task::core::Stage<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>>, core::task::poll::Poll<()>, tokio::runtime::task::core::{impl#6}::poll::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>
7360	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/loom/std/unsafe_cell.rs:16:9
7361	2025-06-17T18:52:48.509Z	      14: poll<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>
7362	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/core.rs:320:13
7363	2025-06-17T18:52:48.509Z	      15: tokio::runtime::task::harness::poll_future::{{closure}}
7364	2025-06-17T18:52:48.509Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/harness.rs:532:19
7365	2025-06-17T18:52:48.509Z	      16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
7366	2025-06-17T18:52:48.509Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/panic/unwind_safe.rs:272:9
7367	2025-06-17T18:52:48.509Z	      17: do_call<core::panic::unwind_safe::AssertUnwindSafe<tokio::runtime::task::harness::poll_future::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>, core::task::poll::Poll<()>>
7368	2025-06-17T18:52:48.509Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/panicking.rs:589:40
7369	2025-06-17T18:52:48.509Z	      18: __rust_try
7370	2025-06-17T18:52:48.509Z	      19: try<core::task::poll::Poll<()>, core::panic::unwind_safe::AssertUnwindSafe<tokio::runtime::task::harness::poll_future::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>>
7371	2025-06-17T18:52:48.510Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/panicking.rs:552:19
7372	2025-06-17T18:52:48.510Z	      20: catch_unwind<core::panic::unwind_safe::AssertUnwindSafe<tokio::runtime::task::harness::poll_future::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>, core::task::poll::Poll<()>>
7373	2025-06-17T18:52:48.510Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/panic.rs:359:14
7374	2025-06-17T18:52:48.560Z	      21: tokio::runtime::task::harness::poll_future
7375	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/harness.rs:520:18
7376	2025-06-17T18:52:48.560Z	      22: tokio::runtime::task::harness::Harness<T,S>::poll_inner
7377	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/harness.rs:209:27
7378	2025-06-17T18:52:48.560Z	      23: tokio::runtime::task::harness::Harness<T,S>::poll
7379	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/harness.rs:154:15
7380	2025-06-17T18:52:48.560Z	      24: tokio::runtime::task::raw::poll
7381	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/raw.rs:271:5
7382	2025-06-17T18:52:48.560Z	      25: tokio::runtime::task::raw::RawTask::poll
7383	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/raw.rs:201:18
7384	2025-06-17T18:52:48.560Z	      26: tokio::runtime::task::LocalNotified<S>::run
7385	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/task/mod.rs:463:9
7386	2025-06-17T18:52:48.560Z	      27: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
7387	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:780:25
7388	2025-06-17T18:52:48.560Z	      28: with_budget<(), tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure_env#1}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7389	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/task/coop/mod.rs:167:5
7390	2025-06-17T18:52:48.560Z	      29: budget<(), tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure_env#1}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7391	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/task/coop/mod.rs:133:5
7392	2025-06-17T18:52:48.560Z	      30: {closure#0}<(), tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure_env#1}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7393	2025-06-17T18:52:48.560Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:368:43
7394	2025-06-17T18:52:48.560Z	      31: tokio::runtime::scheduler::current_thread::Context::enter
7395	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:432:19
7396	2025-06-17T18:52:48.561Z	      32: tokio::runtime::scheduler::current_thread::Context::run_task
7397	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:368:23
7398	2025-06-17T18:52:48.561Z	      33: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7399	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:776:35
7400	2025-06-17T18:52:48.561Z	      34: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
7401	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:820:68
7402	2025-06-17T18:52:48.561Z	      35: tokio::runtime::context::scoped::Scoped<T>::set
7403	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context/scoped.rs:40:9
7404	2025-06-17T18:52:48.561Z	      36: tokio::runtime::context::set_scheduler::{{closure}}
7405	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context.rs:176:26
7406	2025-06-17T18:52:48.561Z	      37: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#8}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)>
7407	2025-06-17T18:52:48.561Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/thread/local.rs:311:12
7408	2025-06-17T18:52:48.561Z	      38: std::thread::local::LocalKey<T>::with
7409	2025-06-17T18:52:48.561Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/thread/local.rs:275:15
7410	2025-06-17T18:52:48.561Z	      39: tokio::runtime::context::set_scheduler
7411	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context.rs:176:9
7412	2025-06-17T18:52:48.561Z	      40: tokio::runtime::scheduler::current_thread::CoreGuard::enter
7413	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:820:27
7414	2025-06-17T18:52:48.561Z	      41: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
7415	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:720:19
7416	2025-06-17T18:52:48.561Z	      42: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7417	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:200:28
7418	2025-06-17T18:52:48.561Z	      43: tokio::runtime::context::runtime::enter_runtime
7419	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context/runtime.rs:65:16
7420	2025-06-17T18:52:48.561Z	      44: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7421	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:188:9
7422	2025-06-17T18:52:48.561Z	      45: tokio::runtime::runtime::Runtime::block_on_inner
7423	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/runtime.rs:356:47
7424	2025-06-17T18:52:48.561Z	      46: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7425	2025-06-17T18:52:48.561Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/runtime.rs:330:13
7426	2025-06-17T18:52:48.561Z	      47: test_updating_running_instance_boot_disk_is_conflict
7427	2025-06-17T18:52:48.561Z	                 at ./tests/integration_tests/instances.rs:4500:1
7428	2025-06-17T18:52:48.561Z	      48: test_all::integration_tests::instances::test_updating_running_instance_boot_disk_is_conflict::{{closure}}
7429	2025-06-17T18:52:48.561Z	                 at ./tests/integration_tests/instances.rs:4503:2
7430	2025-06-17T18:52:48.561Z	      49: core::ops::function::FnOnce::call_once
7431	2025-06-17T18:52:48.561Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/ops/function.rs:250:5
7432	2025-06-17T18:52:48.561Z	      50: core::ops::function::FnOnce::call_once
7433	2025-06-17T18:52:48.561Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/ops/function.rs:250:5
7434	2025-06-17T18:52:48.562Z	    note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
7435	2025-06-17T18:52:48.562Z	
7436	2025-06-17T18:52:48.562Z	    thread 'integration_tests::instances::test_updating_running_instance_boot_disk_is_conflict' panicked at clients/sled-agent-client/src/lib.rs:366:14:
7437	2025-06-17T18:52:48.562Z	    instance_finish_transition() failed unexpectedly: reqwest::Error { kind: Request, url: "http://[::1]:38427/vmms/eb67c601-9668-4539-b0a1-86143e2872a0/poke", source: hyper_util::client::legacy::Error(SendRequest, hyper::Error(IncompleteMessage)) }
7438	2025-06-17T18:52:48.562Z	    stack backtrace:
7439	2025-06-17T18:52:48.562Z	       0: __rustc::rust_begin_unwind
7440	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/panicking.rs:697:5
7441	2025-06-17T18:52:48.562Z	       1: core::panicking::panic_fmt
7442	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/panicking.rs:75:14
7443	2025-06-17T18:52:48.562Z	       2: core::result::unwrap_failed
7444	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/result.rs:1704:5
7445	2025-06-17T18:52:48.562Z	       3: core::result::Result<T,E>::expect
7446	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/result.rs:1061:23
7447	2025-06-17T18:52:48.562Z	       4: {async_block#0}
7448	2025-06-17T18:52:48.562Z	                 at /work/oxidecomputer/omicron/clients/sled-agent-client/src/lib.rs:362:9
7449	2025-06-17T18:52:48.562Z	       5: poll<alloc::boxed::Box<(dyn core::future::future::Future<Output=()> + core::marker::Send), alloc::alloc::Global>>
7450	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/future/future.rs:124:9
7451	2025-06-17T18:52:48.562Z	       6: {async_fn#0}
7452	2025-06-17T18:52:48.562Z	                 at ./tests/integration_tests/instances.rs:7193:72
7453	2025-06-17T18:52:48.562Z	       7: {async_fn#0}
7454	2025-06-17T18:52:48.562Z	                 at ./tests/integration_tests/instances.rs:4572:44
7455	2025-06-17T18:52:48.562Z	       8: {async_block#0}
7456	2025-06-17T18:52:48.562Z	                 at ./tests/integration_tests/instances.rs:4500:1
7457	2025-06-17T18:52:48.562Z	       9: poll<&mut dyn core::future::future::Future<Output=()>>
7458	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/future/future.rs:124:9
7459	2025-06-17T18:52:48.562Z	      10: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7460	2025-06-17T18:52:48.562Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/future/future.rs:124:9
7461	2025-06-17T18:52:48.562Z	      11: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7462	2025-06-17T18:52:48.562Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:733:54
7463	2025-06-17T18:52:48.562Z	      12: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7464	2025-06-17T18:52:48.562Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/task/coop/mod.rs:167:5
7465	2025-06-17T18:52:48.562Z	      13: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7466	2025-06-17T18:52:48.562Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/task/coop/mod.rs:133:5
7467	2025-06-17T18:52:48.562Z	      14: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7468	2025-06-17T18:52:48.562Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:733:25
7469	2025-06-17T18:52:48.562Z	      15: tokio::runtime::scheduler::current_thread::Context::enter
7470	2025-06-17T18:52:48.563Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:432:19
7471	2025-06-17T18:52:48.563Z	      16: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7472	2025-06-17T18:52:48.563Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:732:36
7473	2025-06-17T18:52:48.563Z	      17: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
7474	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:820:68
7475	2025-06-17T18:52:48.589Z	      18: tokio::runtime::context::scoped::Scoped<T>::set
7476	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context/scoped.rs:40:9
7477	2025-06-17T18:52:48.589Z	      19: tokio::runtime::context::set_scheduler::{{closure}}
7478	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context.rs:176:26
7479	2025-06-17T18:52:48.589Z	      20: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#8}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)>
7480	2025-06-17T18:52:48.589Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/thread/local.rs:311:12
7481	2025-06-17T18:52:48.589Z	      21: std::thread::local::LocalKey<T>::with
7482	2025-06-17T18:52:48.589Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/std/src/thread/local.rs:275:15
7483	2025-06-17T18:52:48.589Z	      22: tokio::runtime::context::set_scheduler
7484	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context.rs:176:9
7485	2025-06-17T18:52:48.589Z	      23: tokio::runtime::scheduler::current_thread::CoreGuard::enter
7486	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:820:27
7487	2025-06-17T18:52:48.589Z	      24: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
7488	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:720:19
7489	2025-06-17T18:52:48.589Z	      25: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7490	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:200:28
7491	2025-06-17T18:52:48.589Z	      26: tokio::runtime::context::runtime::enter_runtime
7492	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/context/runtime.rs:65:16
7493	2025-06-17T18:52:48.589Z	      27: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7494	2025-06-17T18:52:48.589Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/scheduler/current_thread/mod.rs:188:9
7495	2025-06-17T18:52:48.589Z	      28: tokio::runtime::runtime::Runtime::block_on_inner
7496	2025-06-17T18:52:48.590Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/runtime.rs:356:47
7497	2025-06-17T18:52:48.590Z	      29: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7498	2025-06-17T18:52:48.590Z	                 at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.45.0/src/runtime/runtime.rs:330:13
7499	2025-06-17T18:52:48.590Z	      30: test_updating_running_instance_boot_disk_is_conflict
7500	2025-06-17T18:52:48.590Z	                 at ./tests/integration_tests/instances.rs:4500:1
7501	2025-06-17T18:52:48.590Z	      31: test_all::integration_tests::instances::test_updating_running_instance_boot_disk_is_conflict::{{closure}}
7502	2025-06-17T18:52:48.590Z	                 at ./tests/integration_tests/instances.rs:4503:2
7503	2025-06-17T18:52:48.590Z	      32: core::ops::function::FnOnce::call_once
7504	2025-06-17T18:52:48.590Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/ops/function.rs:250:5
7505	2025-06-17T18:52:48.590Z	      33: core::ops::function::FnOnce::call_once
7506	2025-06-17T18:52:48.590Z	                 at /rustc/17067e9ac6d7ecb70e50f92c1944e545188d2359/library/core/src/ops/function.rs:250:5

Metadata

Metadata

Assignees

No one assigned

    Labels

    Test FlakeTests that work. Wait, no. Actually yes. Hang on. Something is broken.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions