Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task run showing as RUNNING and duration still counting even though Execution was killed hours ago #6331

Open
anna-geller opened this issue Dec 5, 2024 · 0 comments
Labels
area/backend Needs backend code changes area/frontend Needs frontend code changes bug Something isn't working

Comments

@anna-geller
Copy link
Member

anna-geller commented Dec 5, 2024

Describe the issue

Demo: https://share.descript.com/view/LOP42SX5vup

image

It crashed the worker on cloud: https://github.com/kestra-io/kestra-ee/issues/2416

Execution: https://us.kestra.cloud/ui/kestra-tech/executions/company.team/api-python-sql/3dO37csVSlm7SjBzkeHTie

id: api-python-sql
namespace: company.team
# disabled when it crashed the worker 
disabled: true

tasks:
  - id: api
    type: io.kestra.plugin.core.http.Request
    uri: https://dummyjson.com/products

  - id: python
    type: io.kestra.plugin.scripts.python.Script
    taskRunner:
      type: io.kestra.plugin.scripts.runner.docker.Docker
    containerImage: python:slim
    beforeCommands:
      - pip install polars
    outputFiles:
      - products.csv
    warningOnStdErr: false
    script: |
      import polars as pl
      data = {{ outputs.api.body | jq('.products') | first }}
      df = pl.from_dicts(data)
      df.glimpse()
      df.select(["brand", "price"]).write_csv("products.csv")

  - id: sql_query
    type: io.kestra.plugin.jdbc.duckdb.Query
    inputFiles:
      in.csv: "{{ outputs.python.outputFiles['products.csv'] }}"
    sql: |
      SELECT brand, round(avg(price), 2) as avg_price
      FROM read_csv_auto('{{ workingDir }}/in.csv', header=True)
      GROUP BY brand
      ORDER BY avg_price DESC;
    fetchType: STORE

Environment

  • Kestra Version: develop
@anna-geller anna-geller added bug Something isn't working area/backend Needs backend code changes area/frontend Needs frontend code changes labels Dec 5, 2024
@github-project-automation github-project-automation bot moved this to Backlog in Issues Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/backend Needs backend code changes area/frontend Needs frontend code changes bug Something isn't working
Projects
Status: Backlog
Development

No branches or pull requests

1 participant