Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Required e2e Tests #1816

Merged
merged 1 commit into from
Sep 25, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Deduplicate
Feature: Deduplicate - Verification of Deduplicate pipeline with File as source and File as sink

@GCS_DEDUPLICATE_TEST @FILE_SINK_TEST
@GCS_DEDUPLICATE_TEST @FILE_SINK_TEST @Deduplicate_Required
Scenario: To verify complete flow of data extract and transfer from File source to File sink using Deduplicate Plugin with Max filter option
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Distinct
Feature: Distinct analytics - Verify Distinct plugin error Scenarios

@GCS_DISTINCT_TEST1
@GCS_DISTINCT_TEST1 @Distinct_Required
Scenario:Verify Distinct plugin validation errors for incorrect data in Fields
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Distinct
Feature: Distinct Analytics - Verify File source data transfer using Distinct analytics

@GCS_DISTINCT_TEST1 @FILE_SINK_TEST
@GCS_DISTINCT_TEST1 @FILE_SINK_TEST @Distinct_Required
Scenario: To verify data is getting transferred from File source to File sink plugin successfully using Distinct Single field name
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@File_Sink
Feature:File Sink - Verification of File to File successful data transfer

@CSV_TEST @FILE_SINK_TEST
@CSV_TEST @FILE_SINK_TEST @File_Sink_Required
Scenario Outline: To verify data is getting transferred from File to File sink successfully for different formats
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@ Feature: GroupBy - Verify File source to File sink data transfer using GroupBy a
Then Validate OUT record count of groupby is equal to IN record count of sink
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "groupByTest2OutputFile"

@GROUP_BY_TEST @FILE_SINK_TEST
@GROUP_BY_TEST @FILE_SINK_TEST @GroupBy_Required
Scenario: To verify complete flow of data extract and transfer from File source to File sink with GroupBy plugin using different aggregates
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Joiner
Feature: Joiner - Verify File source to File sink data transfer using Joiner analytics

@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST
@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST @Joiner_Required
Scenario:To verify data is getting transferred from File to File successfully using Joiner plugin with outer join type
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down Expand Up @@ -64,7 +64,7 @@ Feature: Joiner - Verify File source to File sink data transfer using Joiner ana
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "joinerTest1OutputFile"


@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST
@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST @Joiner_Required
Scenario:To verify data is getting transferred from File to File successfully using Joiner plugin with inner join type
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Feature: Normalize transform - Verify File source data transfer using Normalize
Then Close the pipeline logs
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "normalizeCsvAllDataTypeOutputFile"

@NORMALIZE_TEST2 @FILE_SINK_TEST
@NORMALIZE_TEST2 @FILE_SINK_TEST @Normalize_Required
Scenario: To verify data is getting transferred from File source to File sink successfully with different Normalized fields
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
@Normalize
Feature: Normalize - Verify Normalize plugin error Scenarios

@Normalize_Required
Scenario:Verify Normalize plugin validation errors for mandatory fields
Given Open Datafusion Project to configure pipeline
When Expand Plugin group in the LHS plugins list: "Transform"
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/

package io.cdap.plugin.deduplicate.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner required to execute Deduplicate plugin required testcases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.deduplicate.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Deduplicate_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/deduplicate-action",
"json:target/cucumber-reports/cucumber-deduplicate-action.json",
"junit:target/cucumber-reports/cucumber-deduplicate-action.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.distinct.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute require Distinct cases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.distinct.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Distinct_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/distinct",
"json:target/cucumber-reports/cucumber-distinct.json",
"junit:target/cucumber-reports/cucumber-distinct.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.file.runners.sinkrunner;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner required to execute File Sink plugin required testcases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.file.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@File_Sink_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/file-sink",
"json:target/cucumber-reports/cucumber-file-sink.json",
"junit:target/cucumber-reports/cucumber-file-sink.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/

package io.cdap.plugin.groupby.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute required GroupBy cases.
*/

@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.groupby.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@GroupBy_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/groupby-action",
"json:target/cucumber-reports/cucumber-groupby-action.json",
"junit:target/cucumber-reports/cucumber-groupby-action.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.joiner.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute required Joiner cases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"stepsdesign", "io.cdap.plugin.joiner.stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Joiner_Required"},
plugin = {"pretty", "html:target/cucumber-html-report/joiner",
"json:target/cucumber-reports/cucumber-joiner.json",
"junit:target/cucumber-reports/cucumber-joiner.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.normalize.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute required Normalize cases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.normalize.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Normalize_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/normalize",
"json:target/cucumber-reports/cucumber-normalize.json",
"junit:target/cucumber-reports/cucumber-normalize.xml"}
)

public class TestRunnerRequired {
}
Loading