Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Oozie #100

Open
malyq opened this issue Jan 18, 2019 · 1 comment
Open

Oozie #100

malyq opened this issue Jan 18, 2019 · 1 comment
Labels
critical Critical issue with top priority.

Comments

@malyq
Copy link
Contributor

malyq commented Jan 18, 2019

Automate the entire process from Caliber to Redshift, beginning with transferring the data to S3 and connecting to EMR.
@malyq malyq added the feature Feature issue for the project. label Jan 18, 2019
@peter-alagna peter-alagna added critical Critical issue with top priority. feature Feature issue for the project. and removed critical Critical issue with top priority. feature Feature issue for the project. labels Feb 6, 2019
@luiginomp
Copy link
Contributor

Commit ef544b0

Oozie workflows have been reworked. Library now includes Setup and Execution sections. Setup is run once from development environment to save sqoop jobs in sqoop metastore. Execution workflows must be migrated into EMR.

Current iteration still missing biforce-execute-imports.xml workflow and biforce-execute.properties file. This file should have subworkflow actions to call hive-execute-import.xml and warehouse-execute-import.xml.

@garett-nguyen garett-nguyen mentioned this issue Mar 20, 2019
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
critical Critical issue with top priority.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@peter-alagna @malyq @luiginomp