Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

anfog_rt can't be run on an empty schema #717

Open
jonescc opened this issue May 6, 2019 · 0 comments
Open

anfog_rt can't be run on an empty schema #717

jonescc opened this issue May 6, 2019 · 0 comments

Comments

@jonescc
Copy link
Contributor

jonescc commented May 6, 2019

anfog_rt can't be run on an empty schema causing problems for talend 7 testing (and testing in general).

craigj@6-nec-hob:~$ talend_liqui anfog_rt-anfog_rt
Going to process a total of '1' files
Processing slice with '1' files
Preparing file '___anfog_rt-anfog_rt___,___anfog_rt-anfog_rt___' in temp dir '/tmp/d20190507-16494-1c1on97'
DEL '/home/craigj/___anfog_rt-anfog_rt___' => '___anfog_rt-anfog_rt___'
'anfog_rt-anfog_rt': ["___anfog_rt-anfog_rt___"]
Executing '/usr/local/talend/jobs/anfog_rt-anfog_rt/java/ANFOG_RT_harvester/ANFOG_RT_harvester_run.sh --context_param paramFile="/usr/local/talend/jobs/anfog_rt-anfog_rt/etc/anfog_rt-anfog_rt.conf" --context_param base=/tmp/d20190507-16494-1c1on97 --context_param fileList=/tmp/harvester_file_list20190507-16494-19mfs41 --context_param logDir=/tmp/d20190507-16494-12a0jh0' for '["___anfog_rt-anfog_rt___"]'
INFO 7/05/19 8:51 AM:liquibase: Successfully acquired change log lock
INFO 7/05/19 8:51 AM:liquibase: Creating database history table with name: anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: Reading from anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: Reading from anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: ChangeSet changelog.xml::1375428625889-1::talend ran successfully in 26ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet changelog.xml::1375428625889-2::talend ran successfully in 20ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet changelog.xml::1375428625889-6::talend ran successfully in 21ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet changelog.xml::1375428625889-7::talend ran successfully in 11ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet changelog.xml::1375428625889-8::talend ran successfully in 9ms
INFO 7/05/19 8:51 AM:liquibase: Successfully released change log lock
INFO 7/05/19 8:51 AM:liquibase: Successfully acquired change log lock
INFO 7/05/19 8:51 AM:liquibase: Reading from anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: Reading from anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354478507434-1::talend ran successfully in 21ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354478507434-2::talend ran successfully in 19ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354478507434-3::talend ran successfully in 26ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::8d2ccf90-46a1-11e3-8f96-0800200c9a66::craigj ran successfully in 7ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-21::talend ran successfully in 12ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-22::talend ran successfully in 9ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-23::talend ran successfully in 21ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-24::craigj ran successfully in 16ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-25::craigj ran successfully in 8ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-26::talend ran successfully in 16ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-28::talend ran successfully in 7ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-30::talend ran successfully in 7ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-31::talend ran successfully in 7ms
INFO 7/05/19 8:51 AM:liquibase: Marking ChangeSet: iPostgresqlIndexResources_changelog.xml::f911a3c0-fefd-11e2-b778-0800200c9a66::craigj::(Checksum: 3:45afa91f15f67313497586d297b345d2) ran despite precondition failure due to onFail='MARK_RAN': 
          iPostgresqlIndexResources_changelog.xml : Table anfog_rt.index_run does not exist

INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-32::julian ran successfully in 10ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::default-last-change-type::craigj ran successfully in 7ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::1354481764331-33::julian ran successfully in 18ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::add-deleted-flag-to-indexed-file::craigj ran successfully in 48ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::add-harvest-indexes::craigj ran successfully in 14ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::last-change-type-not-null-constraint::craigj ran successfully in 11ms
INFO 7/05/19 8:51 AM:liquibase: ChangeSet iPostgresqlIndexResources_changelog.xml::last-indexed-run-is-last-processed-run::craigj ran successfully in 7ms
INFO 7/05/19 8:51 AM:liquibase: Successfully released change log lock
FILE_INDEX_UPDATER - WARNING: ___anfog_rt-anfog_rt___ not found on indexINFO 7/05/19 8:51 AM:liquibase: Successfully acquired change log lock
INFO 7/05/19 8:51 AM:liquibase: Reading from anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: Reading from anfog_rt.databasechangelog
INFO 7/05/19 8:51 AM:liquibase: ChangeSet changelog.xml::cr_deployments-1::talend ran successfully in 29ms
SEVERE 7/05/19 8:51 AM:liquibase: Change Set changelog.xml::modify-table-1::talend failed.  Error: Error executing SQL ALTER TABLE anfog_rt.measurements
ALTER COLUMN "TIME" SET DATA TYPE timestamp with time zone
USING "TIME"::timestamp with time zone: ERROR: relation "anfog_rt.measurements" does not exist
liquibase.exception.DatabaseException: Error executing SQL ALTER TABLE anfog_rt.measurements
ALTER COLUMN "TIME" SET DATA TYPE timestamp with time zone
USING "TIME"::timestamp with time zone: ERROR: relation "anfog_rt.measurements" does not exist
        at liquibase.executor.jvm.JdbcExecutor.execute(JdbcExecutor.java:62)
        at liquibase.executor.jvm.JdbcExecutor.execute(JdbcExecutor.java:104)
        at liquibase.database.AbstractDatabase.execute(AbstractDatabase.java:1091)
        at liquibase.database.AbstractDatabase.executeStatements(AbstractDatabase.java:1075)
        at liquibase.changelog.ChangeSet.execute(ChangeSet.java:317)
        at liquibase.changelog.visitor.UpdateVisitor.visit(UpdateVisitor.java:27)
        at liquibase.changelog.ChangeLogIterator.run(ChangeLogIterator.java:58)
        at liquibase.Liquibase.update(Liquibase.java:114)
        at anfog_rt.dataharvest_rt_0_1.DataHarvest_RT.iPostgresqlDbUpdate_1Process(DataHarvest_RT.java:1316)
        at anfog_rt.dataharvest_rt_0_1.DataHarvest_RT.runJobInTOS(DataHarvest_RT.java:2606)
        at anfog_rt.dataharvest_rt_0_1.DataHarvest_RT.runJob(DataHarvest_RT.java:2444)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.tRunJob_2Process(ANFOG_RT_harvester.java:1351)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.tRunJob_1Process(ANFOG_RT_harvester.java:1233)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.runJobInTOS(ANFOG_RT_harvester.java:3477)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.main(ANFOG_RT_harvester.java:3273)
Caused by: org.postgresql.util.PSQLException: ERROR: relation "anfog_rt.measurements" does not exist
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2157)
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1886)
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:555)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:403)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:395)
        at liquibase.executor.jvm.JdbcExecutor$1ExecuteStatementCallback.doInStatement(JdbcExecutor.java:92)
        at liquibase.executor.jvm.JdbcExecutor.execute(JdbcExecutor.java:55)
        ... 14 more
INFO 7/05/19 8:51 AM:liquibase: Successfully released change log lock
Exception in component iPostgresqlDbUpdate_1
liquibase.exception.MigrationFailedException: Migration failed for change set changelog.xml::modify-table-1::talend:
     Reason: liquibase.exception.DatabaseException: Error executing SQL ALTER TABLE anfog_rt.measurements
ALTER COLUMN "TIME" SET DATA TYPE timestamp with time zone
USING "TIME"::timestamp with time zone: ERROR: relation "anfog_rt.measurements" does not exist:
          Caused By: Error executing SQL ALTER TABLE anfog_rt.measurements
ALTER COLUMN "TIME" SET DATA TYPE timestamp with time zone
USING "TIME"::timestamp with time zone: ERROR: relation "anfog_rt.measurements" does not exist:
          Caused By: ERROR: relation "anfog_rt.measurements" does not exist
        at liquibase.changelog.ChangeSet.execute(ChangeSet.java:347)
        at liquibase.changelog.visitor.UpdateVisitor.visit(UpdateVisitor.java:27)
        at liquibase.changelog.ChangeLogIterator.run(ChangeLogIterator.java:58)
        at liquibase.Liquibase.update(Liquibase.java:114)
        at anfog_rt.dataharvest_rt_0_1.DataHarvest_RT.iPostgresqlDbUpdate_1Process(DataHarvest_RT.java:1316)
        at anfog_rt.dataharvest_rt_0_1.DataHarvest_RT.runJobInTOS(DataHarvest_RT.java:2606)
        at anfog_rt.dataharvest_rt_0_1.DataHarvest_RT.runJob(DataHarvest_RT.java:2444)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.tRunJob_2Process(ANFOG_RT_harvester.java:1351)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.tRunJob_1Process(ANFOG_RT_harvester.java:1233)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.runJobInTOS(ANFOG_RT_harvester.java:3477)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.main(ANFOG_RT_harvester.java:3273)
Caused by: liquibase.exception.DatabaseException: Error executing SQL ALTER TABLE anfog_rt.measurements
ALTER COLUMN "TIME" SET DATA TYPE timestamp with time zone
USING "TIME"::timestamp with time zone: ERROR: relation "anfog_rt.measurements" does not exist
        at liquibase.executor.jvm.JdbcExecutor.execute(JdbcExecutor.java:62)
        at liquibase.executor.jvm.JdbcExecutor.execute(JdbcExecutor.java:104)
        at liquibase.database.AbstractDatabase.execute(AbstractDatabase.java:1091)
        at liquibase.database.AbstractDatabase.executeStatements(AbstractDatabase.java:1075)
        at liquibase.changelog.ChangeSet.execute(ChangeSet.java:317)
        ... 10 more
Caused by: org.postgresql.util.PSQLException: ERROR: relation "anfog_rt.measurements" does not exist
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2157)
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1886)
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:555)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:403)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:395)
        at liquibase.executor.jvm.JdbcExecutor$1ExecuteStatementCallback.doInStatement(JdbcExecutor.java:92)
        at liquibase.executor.jvm.JdbcExecutor.execute(JdbcExecutor.java:55)
        ... 14 more
Exception in component tRunJob_2
java.lang.RuntimeException: Child job running failed
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.tRunJob_2Process(ANFOG_RT_harvester.java:1362)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.tRunJob_1Process(ANFOG_RT_harvester.java:1233)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.runJobInTOS(ANFOG_RT_harvester.java:3477)
        at anfog_rt.anfog_rt_harvester_0_1.ANFOG_RT_harvester.main(ANFOG_RT_harvester.java:3273)
2019-05-07 08:51:42;MbbEJc;MbbEJc;MbbEJc;16500;ANFOG_RT;ANFOG_RT_harvester;_aS284HmVEeO3Y9k88sZyxQ;0.1;Default;;begin;;

2019-05-07 08:51:47;MbbEJc;MbbEJc;MbbEJc;16500;ANFOG_RT;ANFOG_RT_harvester;_aS284HmVEeO3Y9k88sZyxQ;0.1;Default;;end;failure;4866

Talend harvester anfog_rt-anfog_rt: 1 file(s)  FAILED
Aborting operation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jonescc