Release notes for Vaadin TestBench

Vaadin TestBench is an environment used for automated user interface regression testing of Vaadin applications on multiple platforms and browsers. Learn more about the product at vaadin.com/testbench

The latest stable release of Vaadin TestBench is 4.2.0 for Vaadin Framework 7.

The latest stable release of Vaadin TestBench is 5.0.0 for Vaadin Framework 8.

Browser compatibility

Here are the most common browsers for developers writing the tests. The following browser versions are verified to work. The list doesn't include any of the supported mobile browsers.

  Browser Support Driver Installation Required
  TestBench 4.2 TestBench 5.0 TestBench 4.2 TestBench 5.0
Firefox 38 ESR not recommended - Gecko Driver
Firefox 45 ESR not recommended - Gecko Driver
Firefox 48+ no not recommended - Gecko Driver
Internet Explorer 11 Internet Explorer Driver
Edge Microsoft WebDriver
Chrome Chrome Driver
Safari 9 Safari Driver
Safari 10 Safari Driver
Releases

Vaadin TestBench 4.2 requires Vaadin 7.3 or newer. Does not work with Vaadin 8.

Vaadin TestBench 5.0 requires Vaadin 8.0 or newer.

 

5.0.0

Released 2017-02-22

TestBench 5 is compatible with Vaadin 8. Not compatible with Vaadin 7. See migration guide.

Component Element API changes in vaadin-testbench-api:

  • CheckBoxGroupElement added to test CheckBoxGroup Component
  • RadioButtonGroupElement added to test RadioButtonGroup Component

Changes in vaadin-testbench-core:

  • Uses Selenium 3.0.1
  • RetryRule added to re-run randomly failing tests.

5.0.0.beta1

Released 2016-12-22

TestBench 5 is compatible with Vaadin 8. Not compatible with Vaadin 7.

Component Element API changes in vaadin-testbench-api:

  • CheckBoxGroupElement added to test CheckBoxGroup Component
  • RadioButtonGroupElement added to test RadioButtonGroup Component

Changes in vaadin-testbench-core:

  • Uses Selenium 3.0.1
  • RetryRule added to re-run randomly failing tests.

4.2.0

Released 2016-12-21

Changes in vaadin-testbench-core:

  • Screen comparison is supported for individual elements through TestBenchElement.compareScreen.
  • TestBenchElement can be compared with WebElement using equals().
  • TestBenchElement has getClassNames() and hasClassName(String) for testing class names.
  • Removed Vaadin version detection which was broken in Liferay.
  • List selects in multiselect mode can be tested with PhantomJS.
  • waitForVaadin is executed before each element method, eliminating timing issues in some tests.
  • The hub host name can be overridden using -Dcom.vaadin.testbench.Parameters.hubHostname.

Component Element API changes in vaadin-testbench-api:

  • The input field for a ComboBox can be retrieved using ComboBoxElement.getInputField().
  • GridElement has getRowCount() to get the number of data rows in the grid.
  • GridElement has getRows() for iterating over all data rows in the grid.
  • State of a checkbox can be checked using CheckBoxElement.isChecked()

4.1.0

Released 2016-09-13

Mozilla Firefox changed important APIs in version 48 that affected their compatibility with WebDriver which directly affects TestBench. Firefox 48 and posterior versions will require the use of GeckoDriver that is not feature complete or fully compatible with Selenium currently. As a workaround it is recommended to use either Firefox 47 or Firefox ESR to execute tests on Firefox until this can be fixed with a stable release of GeckoDriver.

  • Add element API helpers from the framework project
  • Allow specifying parameters using system properties
  • Improvements in cursor detection (#18773)
  • Add support for Microsoft Edge
  • Selenium updated to 2.51.0
  • Fixed a bug with button click with ValoTheme.QUIET style

4.1.0.beta2

Released 2016-07-12

  • Selenium updated to 2.53.1
  • PhantomJSDriver updated to 1.3.0

4.1.0.alpha2

  • Add element API helpers from the framework project
  • Allow specifying parameters using system properties
  • Improvements in cursor detection (#18773)
  • Add support for Microsoft Edge
  • Selenium updated to 2.51.0

The full list closed issues in this release at the issue tracking system.

4.0.3

  • Updated to Selenium 2.46.0

The full list closed issues in this release at the issue tracking system.