Code

Add DAG for exporting retool data#550

Code

Merged

amishas157 merged 19 commits intomasterstellar/stellar-etl-airflow:masterfrom patch/fetch-retool-datastellar/stellar-etl-airflow:patch/fetch-retool-dataCopy head branch name to clipboardDec 16, 2024

+414-11

Commits

Commits on Dec 6, 2024

• Add DAG for exporting retool data

  amishas157

  committed
  30ee494

  Copy full SHA for 30ee494

• udpate image

  Show description for ef7e871
  amishas157

  committed
  ef7e871

  Copy full SHA for ef7e871

Commits on Dec 10, 2024

• Pass api key

  amishas157

  committed
  47ca1d2

  Copy full SHA for 47ca1d2

• send cloud flags

  amishas157

  committed
  3e56ccb

  Copy full SHA for 3e56ccb

Commits on Dec 11, 2024

• Add task to write to bq

  Show description for 1102681
  amishas157

  committed
  1102681

  Copy full SHA for 1102681

• rename

  amishas157

  committed
  718238e

  Copy full SHA for 718238e

Commits on Dec 12, 2024

• Add batch_run_date

  Show description for c632660
  amishas157

  committed
  c632660

  Copy full SHA for c632660

• update suffix

  amishas157

  committed
  fe6647d

  Copy full SHA for fe6647d

• update image

  amishas157

  committed
  6378f51

  Copy full SHA for 6378f51

• Add metadata fields

  amishas157

  committed
  a2ec946

  Copy full SHA for a2ec946

• Change schedule and update start/end time

  amishas157

  committed
  e15108f

  Copy full SHA for e15108f

• Add macro

  amishas157

  committed
  52ca776

  Copy full SHA for 52ca776

Commits on Dec 13, 2024

• Refactor into methods

  amishas157

  committed
  3d3fc6a

  Copy full SHA for 3d3fc6a

• moar refactor

  Show description for 7ee9e0d
  amishas157

  committed
  7ee9e0d

  Copy full SHA for 7ee9e0d

• Merge branch 'master' into patch/fetch-retool-data

  amishas157

  authored
  ab8be7a

  Copy full SHA for ab8be7a

• update env_vars early on

  amishas157

  committed
  06884ed

  Copy full SHA for 06884ed

Commits on Dec 16, 2024

• Extract secret from gcs

  Show description for 5920807
  amishas157

  committed
  5920807

  Copy full SHA for 5920807

• Remove extranneous vars

  amishas157

  committed
  9497ebb

  Copy full SHA for 9497ebb

• Move generic method to utils and update date

  amishas157

  committed
  9a4e60f

  Copy full SHA for 9a4e60f