clearml-agent is not able to execute task

[gunter-trooper]

Description:
Hello everyone,

I am currently experiencing an issue with a pipeline I rebuilt from the example provided. The pipeline registers correctly on Cearml, but it does not get executed by the worker.

What I have done:

Rebuilt the pipeline using the example from the GitHub repository.
https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_from_functions.py

Verified that the pipeline is registered on Cearml without errors.
The issue:
The worker does not execute the registered pipeline.

Attachments:
Logs from the worker.
task_5009c074b3b841e28d3e1855dcb5a06c (1).log

Screenshots of the Cearml platform showing the pipeline registration and worker status.

Expected behavior:
The pipeline should execute as expected once registered on Cearml.

Environment:
Docker Compose Deployment for ClearMLSever
https://hub.docker.com/layers/allegroai/clearml/latest/images/sha256-cbc6e5519edecc716112bb03ca291e937c38e6c33630907e557545148cf85d51?context=explore

Agent was testet in docker mode on Windows and WSL
clearml-agent 1.9.2
Logs are identical
example_log_worker.log

Link to discussion in Slack:
https://clearml.slack.com/archives/CTK20V944/p1733059802636009

Any insights or suggestions would be greatly appreciated! Thank you in advance for your help.

[Ruhrozz]

afaik pipeline is a task and it executes on your queue, but pipeline creates another tasks and you need another queue to handle these

[gunter-trooper]

@Ruhrozz
Thanks for pointing that out! However, I'm still facing an issue: when I use two agents in Docker mode, the pipeline remains stuck with the same behavior. Interestingly, it works correctly when I switch to venv mode.

Task Worker -> clearml-agent daemon --gpus all --docker --queue default --detached
Pipeline Worker -> clearml-agent daemon --docker --queue controller_queue --detached

Now running new pipeline :

controller_queue is taking the task :

controller gets stuck :

The default query with second worker remains idle:

I hope this provides a clearer description of the problem.