Skip to content

Commit

Permalink
Merge pull request #1816 from cloudsufi/selectRequiredTests
Browse files Browse the repository at this point in the history
Update Required e2e Tests
  • Loading branch information
itsankit-google authored Sep 25, 2023
2 parents 5a8c415 + 55b891a commit d237bba
Show file tree
Hide file tree
Showing 14 changed files with 228 additions and 8 deletions.
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Deduplicate
Feature: Deduplicate - Verification of Deduplicate pipeline with File as source and File as sink

@GCS_DEDUPLICATE_TEST @FILE_SINK_TEST
@GCS_DEDUPLICATE_TEST @FILE_SINK_TEST @Deduplicate_Required
Scenario: To verify complete flow of data extract and transfer from File source to File sink using Deduplicate Plugin with Max filter option
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Distinct
Feature: Distinct analytics - Verify Distinct plugin error Scenarios

@GCS_DISTINCT_TEST1
@GCS_DISTINCT_TEST1 @Distinct_Required
Scenario:Verify Distinct plugin validation errors for incorrect data in Fields
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Distinct
Feature: Distinct Analytics - Verify File source data transfer using Distinct analytics

@GCS_DISTINCT_TEST1 @FILE_SINK_TEST
@GCS_DISTINCT_TEST1 @FILE_SINK_TEST @Distinct_Required
Scenario: To verify data is getting transferred from File source to File sink plugin successfully using Distinct Single field name
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@File_Sink
Feature:File Sink - Verification of File to File successful data transfer

@CSV_TEST @FILE_SINK_TEST
@CSV_TEST @FILE_SINK_TEST @File_Sink_Required
Scenario Outline: To verify data is getting transferred from File to File sink successfully for different formats
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@ Feature: GroupBy - Verify File source to File sink data transfer using GroupBy a
Then Validate OUT record count of groupby is equal to IN record count of sink
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "groupByTest2OutputFile"

@GROUP_BY_TEST @FILE_SINK_TEST
@GROUP_BY_TEST @FILE_SINK_TEST @GroupBy_Required
Scenario: To verify complete flow of data extract and transfer from File source to File sink with GroupBy plugin using different aggregates
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
@Joiner
Feature: Joiner - Verify File source to File sink data transfer using Joiner analytics

@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST
@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST @Joiner_Required
Scenario:To verify data is getting transferred from File to File successfully using Joiner plugin with outer join type
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down Expand Up @@ -64,7 +64,7 @@ Feature: Joiner - Verify File source to File sink data transfer using Joiner ana
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "joinerTest1OutputFile"


@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST
@JOINER_TEST1 @JOINER_TEST2 @FILE_SINK_TEST @Joiner_Required
Scenario:To verify data is getting transferred from File to File successfully using Joiner plugin with inner join type
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Feature: Normalize transform - Verify File source data transfer using Normalize
Then Close the pipeline logs
Then Validate output file generated by file sink plugin "fileSinkTargetBucket" is equal to expected output file "normalizeCsvAllDataTypeOutputFile"

@NORMALIZE_TEST2 @FILE_SINK_TEST
@NORMALIZE_TEST2 @FILE_SINK_TEST @Normalize_Required
Scenario: To verify data is getting transferred from File source to File sink successfully with different Normalized fields
Given Open Datafusion Project to configure pipeline
When Select plugin: "File" from the plugins list as: "Source"
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
@Normalize
Feature: Normalize - Verify Normalize plugin error Scenarios

@Normalize_Required
Scenario:Verify Normalize plugin validation errors for mandatory fields
Given Open Datafusion Project to configure pipeline
When Expand Plugin group in the LHS plugins list: "Transform"
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/

package io.cdap.plugin.deduplicate.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner required to execute Deduplicate plugin required testcases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.deduplicate.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Deduplicate_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/deduplicate-action",
"json:target/cucumber-reports/cucumber-deduplicate-action.json",
"junit:target/cucumber-reports/cucumber-deduplicate-action.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.distinct.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute require Distinct cases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.distinct.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Distinct_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/distinct",
"json:target/cucumber-reports/cucumber-distinct.json",
"junit:target/cucumber-reports/cucumber-distinct.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.file.runners.sinkrunner;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner required to execute File Sink plugin required testcases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.file.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@File_Sink_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/file-sink",
"json:target/cucumber-reports/cucumber-file-sink.json",
"junit:target/cucumber-reports/cucumber-file-sink.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/

package io.cdap.plugin.groupby.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute required GroupBy cases.
*/

@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.groupby.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@GroupBy_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/groupby-action",
"json:target/cucumber-reports/cucumber-groupby-action.json",
"junit:target/cucumber-reports/cucumber-groupby-action.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.joiner.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute required Joiner cases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"stepsdesign", "io.cdap.plugin.joiner.stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Joiner_Required"},
plugin = {"pretty", "html:target/cucumber-html-report/joiner",
"json:target/cucumber-reports/cucumber-joiner.json",
"junit:target/cucumber-reports/cucumber-joiner.xml"}
)
public class TestRunnerRequired {
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
/*
* Copyright © 2023 Cask Data, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you may not
* use this file except in compliance with the License. You may obtain a copy of
* the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
* WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
* License for the specific language governing permissions and limitations under
* the License.
*/
package io.cdap.plugin.normalize.runners;

import io.cucumber.junit.Cucumber;
import io.cucumber.junit.CucumberOptions;
import org.junit.runner.RunWith;

/**
* Test Runner Required to execute required Normalize cases.
*/
@RunWith(Cucumber.class)
@CucumberOptions(
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.normalize.stepsdesign", "stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@Normalize_Required"},
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/normalize",
"json:target/cucumber-reports/cucumber-normalize.json",
"junit:target/cucumber-reports/cucumber-normalize.xml"}
)

public class TestRunnerRequired {
}

0 comments on commit d237bba

Please sign in to comment.