Skip to content

Latest commit

 

History

History
539 lines (406 loc) · 25.5 KB

CHANGELOG.md

File metadata and controls

539 lines (406 loc) · 25.5 KB
Raw

1.0.3

  • [WebDriverIO][Protractor][Nightmare] method waitUntilExists implemented by @sabau
  • Absolute path can be set for output dir by @APshenkin. Fix #571
  • Data table rows can be ignored by using xadd. By @APhenkin
  • Added Data(table).only.Scenario to give ability to launch only Data tests. By @APhenkin
  • Implemented ElementNotFound error by @BorisOsipov.
  • Added TypeScript compiler / configs to check the JavaScript by @KennyRules
  • [Nightmare] fix executeScript return value by @jploskonka
  • [Nightmare] fixed: err.indexOf not a function when waitForText times out in nightmare by @joeypedicini92
  • Fixed: Retries not working when using .only. By @APhenkin

1.0.2

  • Introduced generators support in scenario hooks for BeforeSuite/Before/AfterSuite/After
  • [ApiDataFactory] Fixed loading helper; requireg package included.
  • Fix #485 run-multiple: the first browser-resolution combination was be used in all configurations
  • Fixed unique test names:
    • Fixed #447: tests failed silently if they have the same name as other tests.
    • Use uuid in screenshot names when uniqueScreenshotNames: true
  • [Protractor] Fixed testing non-angular application. amOutsideAngularApp is executed before each step. Fixes #458
  • Added output for steps in hooks when they fail

1.0.1

  • Reporters improvements:
    • Allows to execute multiple reporters
    • Added Mochawesome helper
    • addMochawesomeContext method to add custom data to mochawesome reports
    • Fixed Mochawesome context for failed screenshots.
  • [WebDriverIO] improved click on context to match clickable element with a text inside. Fixes #647
  • [Nightmare] Added refresh function by @awhanks
  • fixed Unhandled promise rejection (rejection id: 1): Error: Unknown wait type: pageLoad
  • support for tests with retries in html report
  • be sure that change window size and timeouts completes before test
  • [Nightmare] Fixed [Wrapped Error] "codeceptjs is not defined"; Reinjectiing client scripts to a webpage on changes.
  • [Nightmare] Added more detailed error messages for Wait* methods
  • [Nightmare] Fixed adding screenshots to Mochawesome
  • [Nightmare] Fix unique screenshots names in Nightmare
  • Fixed CodeceptJS work with hooks in helpers to finish codeceptJS correctly if errors appears in helpers hooks
  • Create a new session for next test If selenium grid error received
  • Create screenshots for failed hooks from a Feature file
  • Fixed retries option

1.0

CodeceptJS hits first stable release. CodeceptJS provides a unified API for web testing for Webdriverio, Protractor, and NightmareJS. Since 1.0 you can also test mobile applications in the similar manner with Appium.

Sample test:

I.seeAppIsInstalled("io.super.app");
I.click('~startUserRegistrationCD');
I.fillField('~email of the customer', 'Nothing special'));
I.see('[email protected]', '~email of the customer'));
I.clearField('~email of the customer'));
I.dontSee('Nothing special', '~email of the customer'));

We also introduced two new helpers for data management. Using them you can easily prepare and cleanup data for your tests using public REST API.

Sample test

// create a user using data factories and REST API
I.have('user', { name: 'davert', password: '123456' });
// use it to login
I.amOnPage('/login');
I.fillField('login', 'davert');
I.fillField('password', '123456');
I.click('Login');
I.see('Hello, davert');
// user will be removed after the test

Next notable feature is SmartWait for WebDriverIO, Protractor, SeleniumWebdriver. When smartwait option is set, script will wait for extra milliseconds to locate an element before failing. This feature uses implicit waits of Selenium but turns them on only in applicable pieces. For instance, implicit waits are enabled for seeElement but disabled for dontSeeElement

Changelog
  • Minimal NodeJS version is 6.11.1 LTS
  • Use within command with generators.
  • Data Driven Tests introduced.
  • Print execution time per step in --debug mode. #591 by @APshenkin
  • [WebDriverIO][Protractor][Nightmare] Added disableScreenshots option to disable screenshots on fail by @Apshenkin
  • [WebDriverIO][Protractor][Nightmare] Added uniqueScreenshotNames option to generate unique names for screenshots on failure by @Apshenkin
  • [WebDriverIO][Nightmare] Fixed click on context; click('text', '#el') will throw exception if text is not found inside #el.
  • [WebDriverIO][Protractor][SeleniumWebdriver] SmartWait introduced.
  • [WebDriverIO][Protractor][Nightmare]Fixed saveScreenshot for PhantomJS, fullPageScreenshots option introduced by @HughZurname #549
  • [Appium] helper introduced by @APshenkin
  • [REST] helper introduced by @atrevino in #504
  • [WebDriverIO][SeleniumWebdriver] Fixed "windowSize": "maximize" for Chrome 59+ version #560 by @APshenkin
  • [Nightmare] Fixed restarting by @APshenkin #581
  • [WebDriverIO] Methods added by @APshenkin:
  • Use mkdirp to create output directory. #592 by @vkramskikh
  • [WebDriverIO] Fixed seeNumberOfVisibleElements by @BorisOsipov #574
  • Lots of fixes for promise chain by @APshenkin #568
    • Fix #543 - After block not properly executed if Scenario fails
    • Expected behavior in promise chains: _beforeSuite hooks from helpers -> BeforeSuite from test -> _before hooks from helpers -> Before from test - > Test steps -> _failed hooks from helpers (if test failed) -> After from test -> _after hooks from helpers -> AfterSuite from test -> _afterSuite hook from helpers.
    • if during test we got errors from any hook (in test or in helper) - stop complete this suite and go to another
    • if during test we got error from Selenium server - stop complete this suite and go to another
    • [WebDriverIO][Protractor] if restart option is false - close all tabs expect one in _after.
    • Complete _after, _afterSuite hooks even After/AfterSuite from test was failed
    • Don't close browser between suites, when restart option is false. We should start browser only one time and close it only after all tests.
    • Close tabs and clear local storage, if keepCookies flag is enabled
  • Fix TypeError when using babel-node or ts-node on node.js 7+ #586 by @vkramskikh
  • [Nightmare] fixed usage of _locate

Special thanks to Andrey Pshenkin for his work on this release and the major improvements.

0.6.3

  • Errors are printed in non-verbose mode. Shows "Selenium not started" and other important errors.
  • Allowed to set custom test options:
Scenario('My scenario', { build_id: 123, type: 'slow' }, function (I)

those options can be accessed as opts property inside a test object. Can be used in custom listeners.

  • Added docs directory to a package.
  • [WebDriverIO][Protractor][SeleniumWebdriver] Bugfix: cleaning session when restart: false by @tfiwm #519
  • [WebDriverIO][Protractor][Nightmare] Added second parameter to saveScreenshot to allow a full page screenshot. By @HughZurname
  • Added suite object to suite.before and suite.after events by @implico. #496

0.6.2

  • Added config object to public API
  • Extended index.js to include actor and helpers, so they could be required:
const actor = require('codeceptjs').actor;
  • Added example for creating custom runner with public API.
  • run command to create output directory if it doesn't exist
  • [Protractor] fixed loading globally installed Protractor
  • run-multiple command improvements:
    • create output directories for each process
    • print process ids in output

0.6.1

  • Fixed loading hooks

0.6.0

Major release with extension API and parallel execution.

  • Breaking Removed path argument from run. To specify path other than current directory use --config or -c option:

Instead of: codeceptjs run tests use:

# load config and run from tests directory
codeceptjs run -c tests/

# or load codecept.json from tests directory
codeceptjs run -c tests/codecept.json

# run users_test.js inside tests directory
codeceptjs run users_test.js -c tests
  • Command multiple-run added, to execute tests in several browsers in parallel by @APshenkin and @davertmik. See documentation.
  • Hooks API added to extend CodeceptJS with custom listeners and plugins. See documentation.
  • [Nightmare][WebDriverIO] within can work with iframes by @imvetri. See documentation.
  • [WebDriverIO][SeleniumWebdriver][Protractor] Default browser changed to chrome
  • [Nightmare] Fixed globally locating nightmare-upload.
  • [WebDriverIO] added seeNumberOfVisibleElements method by @elarouche.
  • Exit with non-zero code if init throws an error by @rincedd
  • New guides published:
  • Meta packages published:

0.5.1

  • Polish translation added by @limes.
  • Update process exit code so that mocha saves reports before exit by @romanovma.
  • [Nightmare] fixed getAttributeFrom for custom attributes by @robrkerr
  • [Nightmare] Fixed UnhandledPromiseRejectionWarning error when selecting the dropdown using selectOption by @robrkerr. See PR.
  • [Protractor] fixed pressKey method by @romanovma

0.5.0

  • Protractor ^5.0.0 support (while keeping ^4.0.9 compatibility)
  • Fix 'fullTitle() is not a function' in exit.js by @hubidu. See #388.
  • [Nightmare] Fix for waitTimeout by @HughZurname. See #391. Resolves #236
  • Dockerized CodeceptJS setup by @artiomnist. See reference

0.4.16

  • Fixed steps output synchronization (regression since 0.4.14).
  • [WebDriverIO][Protractor][SeleniumWebdriver][Nightmare] added keepCookies option to keep cookies between tests with restart: false.
  • [Protractor] added waitForTimeout config option to set default waiting time for all wait* functions.
  • Fixed _test hook for helpers by @cjhille.

0.4.15

  • Fixed regression in recorder sessions: oldpromise is not defined.

0.4.14

  • _beforeStep and _afterStep hooks in helpers are synchronized. Allows to perform additional actions between steps.

Example: fail if JS error occur in custom helper using WebdriverIO:

_before() {
  this.err = null;
  this.helpers['WebDriverIO'].browser.on('error', (e) => this.err = e);
}

_afterStep() {
 if (this.err) throw new Error('Browser JS error '+this.err);
}

Example: fail if JS error occur in custom helper using Nightmare:

_before() {
  this.err = null;
  this.helpers['Nightmare'].browser.on('page', (type, message, stack) => {
    this.err = `${message} ${stack}`;
  });
}

_afterStep() {
 if (this.err) throw new Error('Browser JS error '+this.err);
}
  • Fixed codecept list and codecept def commands.
  • Added I.say method to print arbitrary comments.
I.say('I am going to publish post');
I.say('I enter title and body');
I.say('I expect post is visible on site');
  • [Nightmare] restart option added. restart: false allows to run all tests in a single window, disabled by default. By @nairvijays99
  • [Nightmare] Fixed resizeWindow command.
  • [Protractor][SeleniumWebdriver] added windowSize config option to resize window on start.
  • Fixed "Scenario.skip causes 'Cannot read property retries of undefined'" by @MasterOfPoppets
  • Fixed providing absolute paths for tests in config by @lennym

0.4.13

  • Added retries option Feature and Scenario to rerun fragile tests:
Feature('Complex JS Stuff', {retries: 3});

Scenario('Not that complex', {retries: 1}, (I) => {
  // test goes here
});
  • Added timeout option Feature and Scenario to specify timeout.
Feature('Complex JS Stuff', {timeout: 5000});

Scenario('Not that complex', {timeout: 1000}, (I) => {
  // test goes here
});
  • [WebDriverIO] Added uniqueScreenshotNames option to set unique screenshot names for failed tests. By @APshenkin. See #299
  • [WebDriverIO] clearField method improved to accept name/label locators and throw errors.
  • [Nightmare][SeleniumWebdriver][Protractor] clearField method added.
  • [Nightmare] Fixed waitForElement, and waitForVisible methods.
  • [Nightmare] Fixed resizeWindow by @norisk-it
  • Added italian translation.

0.4.12

  • Bootstrap / Teardown improved with Hooks. Various options for setup/teardown provided.
  • Added --override or -o option for runner to dynamically override configs. Valid JSON should be passed:
codeceptjs run -o '{ "bootstrap": "bootstrap.js"}'
codeceptjs run -o '{ "helpers": {"WebDriverIO": {"browser": "chrome"}}}'

0.4.11

  • Fixed regression in 0.4.10
  • Added bootstrap/teardown config options to accept functions as parameters by @pscanf. See updated config reference #319

0.4.10

  • [Protractor] Protrctor 4.0.12+ support.
  • Enabled async bootstrap file by @abachar. Use inside bootstrap.js:
module.exports = function(done) {
  // async instructions
  // call done() to continue execution
  // otherwise call done('error description')
}
  • Changed 'pending' to 'skipped' in reports by @timja-kainos. See #315

0.4.9

  • [SeleniumWebdriver][Protractor][WebDriverIO][Nightmare] fixed executeScript, executeAsyncScript to work and return values.
  • [Protractor][SeleniumWebdriver][WebDriverIO] Added waitForInvisible and waitForStalenessOf methods by @Nighthawk14.
  • Added --config option to codeceptjs run to manually specify config file by @cnworks
  • [Protractor] Simplified behavior of amOutsideAngularApp by using ignoreSynchronization. Fixes #278
  • Set exit code to 1 when test fails at Before/After hooks. Fixes #279

0.4.8

  • [Protractor][SeleniumWebdriver][Nightmare] added moveCursorTo method.
  • [Protractor][SeleniumWebdriver][WebDriverIO] Added manualStart option to start browser manually in the beginning of test. By @cnworks. PR #250
  • Fixed codeceptjs init to work with nested directories and file masks.
  • Fixed codeceptjs gt to generate test with proper file name suffix. By @Zougi.
  • [Nightmare] Fixed: Error is thrown when clicking on element which can't be locate. By @davetmik
  • [WebDriverIO] Fixed attachFile for file upload. By @giuband and @davetmik
  • [WebDriverIO] Add support for timeouts in config and with defineTimeouts method. By @easternbloc #258 and #267 by @davetmik
  • Fixed hanging of CodeceptJS when error is thrown by event dispatcher. Fix by @Zougi and @davetmik

0.4.7

  • Improved docs for BeforeSuite; fixed its usage with restart: false option by @APshenkin.
  • Added Nightmare to list of available helpers on init.
  • [Nightmare] Removed double resizeWindow implementation.

0.4.6

0.4.5

  • Fixed running codecept def command by @jankaspar
  • [Protractor][SeleniumWebdriver] Added support for special keys in pressKey method. Fixes #216

0.4.4

  • Interactive shell fixed. Start it by running codeceptjs shell
  • Added --profile option to shell command to use dynamic configuration.
  • Added --verbose option to shell command for most complete output.

0.4.3

  • [Protractor] Regression fixed to ^4.0.0 support
  • Translations included into package.
  • teardown option added to config (opposite to bootstrap), expects a JS file to be executed after tests stop.
  • Configuration can be set via JavaScript file codecept.conf.js instead of codecept.json. It should export config object:
// inside codecept.conf.js
exports.config = {
  // contents of codecept.json
}

0.4.2

  • Added ability to localize tests with translation #189. Thanks to @abner
    • [Translation] ru-RU translation added.
    • [Translation] pt-BR translation added.
  • [Protractor] Protractor 4.0.4 compatibility.
  • [WebDriverIO][SeleniumWebdriver][Protractor] Fixed single browser session mode for restart: false
  • Fixed using of 3rd party reporters (xunit, mocha-junit-reporter, mochawesome). Added guide.
  • Documentation for Translation added.
  • Documentation for Reports added.

0.4.1

  • Added custom steps to step definition list. See #174 by @jayS-de
  • [WebDriverIO] Fixed using waitForTimeout option by @stephane-ruhlmann. See #178

0.4.0

  • Nightmare Helper added for faster web testing.
  • [Protractor][SeleniumWebdriver][WebDriverIO] added restart: false option to reuse one browser between tests (improves speed).
  • Protractor 4.0 compatibility. Please upgrade Protractor library.
  • Added --verbose option for run command to log and print global promise and events.
  • Fixed errors with shutting down and cleanup.
  • Fixed starting interactive shell with codeceptjs shell.
  • Fixed handling of failures inside within block

0.3.5

  • Introduced IDE autocompletion support for Visual Studio Code and others. Added command for generating TypeScript definitions for I object. Use it as
codeceptjs def

to generate steps definition file and include it into tests by reference. By @kaflan

0.3.4

  • [Protractor] version 3.3.0 comptaibility, NPM 3 compatibility. Please update Protractor!
  • allows using absolute path for helpers, output, in config and in command line. By @denis-sokolov
  • Fixes 'Cannot read property '1' of null in generate.js:44' by @seethislight

0.3.3

Fixed global installation. CodeceptJS can now locate globally located modules. CodeceptJS is also recommended for local installation. Depending on installation type additional modules (webdriverio, protractor, ...) will be loaded either from local or from global path.

0.3.2

  • Added codeceptjs list command which shows all available methods of I object.
  • [Protractor][SeleniumWebdriver] fixed closing browser instances
  • [Protractor][SeleniumWebdriver] doubleClick method added
  • [WebDriverIO][Protractor][SeleniumWebdriver] doubleClick method to locate clickable elements by text, context option added.
  • Fixed using assert in generator without yields #89

0.3.1

  • Fixed init command

0.3.0

Breaking Change: webdriverio package removed from dependencies list. You will need to install it manually after the upgrade. Starting from 0.3.0 webdriverio is not the only backend for running selenium tests, so you are free to choose between Protractor, SeleniumWebdriver, and webdriverio and install them.

  • [Protractor] helper added. Now you can test AngularJS applications by using its official library within the unigied CodeceptJS API!
  • [SeleniumWebdriver] helper added. You can switch to official JS bindings for Selenium.
  • [WebDriverIO] updated to webdriverio v 4.0
  • [WebDriverIO] clearField method added by @fabioel
  • [WebDriverIO] added dragAndDrop by @fabioel
  • [WebDriverIO] fixed scrollTo method by @sensone
  • [WebDriverIO] fixed windowSize: maximize option in config
  • [WebDriverIO] seeElement and dontSeeElement check element for visibility by @fabioel and @davertmik
  • [WebDriverIO] seeElementInDOM, dontSeeElementInDOM added to check element exists on page.
  • [WebDriverIO] fixed saving screenshots on failure. Fixes #70
  • fixed within block doesn't end in output not #79

0.2.8

  • [WebDriverIO] added seeNumberOfElements by @fabioel

0.2.7

  • process ends with exit code 1 on error or failure #49
  • fixed registereing global Helper #57
  • fixed handling error in within block #50

0.2.6

  • Fixed done() was called multiple times
  • [WebDriverIO] added waitToHide method by @fabioel
  • Added global Helper (alias codecept_helper), object use for writing custom Helpers. Generator updated. Changes to #48

0.2.5

  • Fixed issues with using yield inside a test #45 #47 #43
  • Fixed generating a custom helper. Helper class is now accessible with codecept_helper var. Fixes #48

0.2.4

  • Fixed accessing helpers from custom helper by @pim.

0.2.3

  • [WebDriverIO] fixed seeInField to work with single value elements like: input[type=text], textareas, and multiple: select, input[type=radio], input[type=checkbox]
  • [WebDriverIO] fixed pressKey, key modifeiers (Control, Command, Alt, Shift) are released after the action

0.2.2

Fixed generation of custom steps file and page objects. Please replace require('codeceptjs/actor') to actor in your custom_steps.js. Whenever you need to create I object (in page objects, custom steps, but not in tests) just call actor();

0.2.0

  • within context hook added
  • --reporter option supported
  • [WebDriverIO] added features and methods:
    • elements: seeElement, ...
    • popups: acceptPopup, cancelPopup, seeInPopup,...
    • navigation: moveCursorTo, scrollTo
    • saving screenshots on failure; saveScreenshot
    • cookies: setCookie, seeCookie, ...
    • source: seeInSource
    • form: seeCheckboxIsChecked, selectOption to support multiple selects
    • keyboard: appendField, pressKey
    • mouse: rightClick
  • tests added
  • [WebDriverIO] proxy configuration added by @petehouston
  • [WebDriverIO] fixed waitForText method by @roadhump. Fixes #11
  • Fixed creating output dir when it already exists on init by @alfirin
  • Fixed loading of custom helpers