Skip to content

Commit

Permalink
[BugFix] br_cgu_beneficios_cidadao (#916)
Browse files Browse the repository at this point in the history
* fix tables beneficios cidadao

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix path

* add return in partition and fix path

* add dataset in list

* consertando a partição e alterando caminho

* testando na cloud novo_bolsa_familia

* diminuindo o valor do chunksize

* movendo o read_csvc para dentro de task

* colocando a partição dentro do tratamento

* add append in parquet

* concatenando os chunks

* add flows and fix update_metadata

* exclude files in cgu beneficios and add flows

* remove breakpoint

* fix partition and used dask

* testando pipeline com polars

* refactoring partition

* remove dask and polars

* fix input and output

* deactivate licitacao_empenho

* último commit

* remove os

* Revert "último commit"

This reverts commit 9a22f11.

* consertando o último commit

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
tricktx and pre-commit-ci[bot] authored Jan 22, 2025
1 parent 278bb0e commit d4d7f57
Showing 11 changed files with 408 additions and 1,063 deletions.
Empty file.
115 changes: 0 additions & 115 deletions pipelines/datasets/br_cgu_beneficios_cidadao/constants.py

This file was deleted.

Loading

0 comments on commit d4d7f57

Please sign in to comment.