Cover more of Alsatian with Integration Tests

[jamesadarich]

Create more integration tests to support the unit tests with a more functional focus

CLI

Process DEFAULT (will need to confirm better when default implemented as to whether this will work):

• Run tests from spawn process
• as calls are made concatenate them together
• compare against file containing a line by line update as should happen

Process TAP:

• Run tests from spawn process
• as calls are made concatenate them together
• compare against entire file

Key
D - Default
T - TAP
R - Node returned Report

Areas to check

• fail (D/T)
• pass (D/T)
• test names, numbers and arguments (D/T)
• assertions (D/T)
• count (D/T)
• error (D/T)
• headers (T)
• exit code (D/T)
• summary (D)
• fail details (D)

Node

Similar to the CLI the output stream will need to be checked because this should still be the same, ontop of this will need to interrogate the results returned by the TestRunner

Gulp

Areas to check

• pass (D/T/R) - expectations test set - separate out into passing and failing fail/to-be.spec.ts or to-be.fail.spec.ts
• count (D/T/R) - test number test sets (min 3)
• fail (D/T/R) - expectations test set
• error (D/T/R) - error test sets (min 3)
• headers (T) - TAP specific test (expectations test set)
• test names, numbers and arguments (D/T) - expectations test set / test number test sets
• assertions (D/T) - expectations test set
• exit code (D/T) - simple pass, fail, error test sets
• summary (D) - all test sets
• fail details (D) - all failing test sets

Native

Areas to check

• pass (D/T/R)
• count (D/T/R)
• fail (D/T/R)
• error (D/T/R)
• headers (T)
• test names, numbers and arguments (D/T)
• assertions (D/T)
• exit code (D/T)
• summary (D)
• fail details (D)

[jamesadarich]

closed by #182

[jamesadarich]

closed wrong issue should have been #114 (reopening)

[jamesadarich]

Also include TypeScript builds