Skip to content

Commit

Permalink
[HOTFIX] Ativar captura do RHO e RDO STPL (#259)
Browse files Browse the repository at this point in the history
* ativar stpl

* materializacao stpl

* altera ambiente para hmg

* add schema rdo_registros_stpl

* altera logica table_id

* corrige schema

* remove packages

* adiciona trim

* add changelog

* restaura packages

* add dbt deps to dockerfile

* add cd queries to dockerfile

* adiciona exclude

* add workdir in place of cd

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* corrige table_id set_last_run_timestamp

* add flow set redis

* corrige flow redis

* remove flow temporario

* altera target para prod

* fix rdo rho stpl

* teste

* remove size

---------

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: hellcassius <[email protected]>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
4 people authored Oct 4, 2024
1 parent e93059a commit d931cc0
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 3 deletions.
4 changes: 2 additions & 2 deletions pipelines/migration/br_rj_riodejaneiro_rdo/flows.py
Original file line number Diff line number Diff line change
Expand Up @@ -129,7 +129,7 @@
materialize = Parameter("materialize", False)

rename_run = rename_current_flow_run_now_time(
prefix=f"{captura_sppo_rho.name} FTP - {transport_mode.run()}-{report_type.run()} ",
prefix="RHO - Captura FTP - " + transport_mode + "-" + report_type + " ",
now_time=get_current_timestamp(),
wait=None,
)
Expand Down Expand Up @@ -176,7 +176,7 @@
materialize = Parameter("materialize", False)

rename_run = rename_current_flow_run_now_time(
prefix=f"{captura_sppo_rdo.name} FTP - {transport_mode.run()}-{report_type.run()} ",
prefix="RHO - Captura FTP - " + transport_mode + "-" + report_type + " ",
now_time=get_current_timestamp(),
wait=None,
)
Expand Down
1 change: 0 additions & 1 deletion pipelines/migration/br_rj_riodejaneiro_rdo/tasks.py
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,6 @@ def get_file_paths_from_ftp(
files_updated_times = {
file: datetime.timestamp(parser.parse(info["modify"]))
for file, info in ftp_client.mlsd(transport_mode)
if info["size"] != "0"
}
# Get files modified inside interval
files = []
Expand Down

0 comments on commit d931cc0

Please sign in to comment.