Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Codeception 5.0 #82

Closed
wants to merge 12 commits into from
6 changes: 3 additions & 3 deletions composer.json
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
{
"name": "codeception/module-visualception",
"description": "Visual regression tests for Codeception",
"name": "nixdrey/wbisualception",
"description": "Visual regression tests for Codeception (fork from https://github.com/Codeception/VisualCeption)",
"homepage": "https://github.com/nixdrey/VisualCeption",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you please revert this change?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry, I accidentally create this pull request

"version": "5.0.0",
"type": "library",
"homepage": "https://github.com/Codeception/VisualCeption",
"license": "Apache-2.0",
"require": {
"php": ">=8.0",
Expand Down
121 changes: 22 additions & 99 deletions readme.md
Original file line number Diff line number Diff line change
@@ -1,119 +1,42 @@
# VisualCeption

![](http://www.thewebhatesme.com/wp-content/uploads/visualception.png)
See project documentation here: https://github.com/Codeception/VisualCeption

Visual regression tests for [Codeception](http://codeception.com/).
# Installation

[![Build Status](https://travis-ci.org/Codeception/VisualCeption.svg?branch=master)](https://travis-ci.org/Codeception/VisualCeption)
`composer require "nixdrey/wbisualception:*" --dev`

This module can be used to compare the current representation of a website element with an expected. It was written on the shoulders of codeception and integrates in a very easy way.

**WARNING** This module can reduce the execution speed of acceptance tests. Use it only for visual regression test suite and not for regular end to end testing.
# What added?

**Example**
## Pixel ratio support
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is good but please keep also the original docs


![](http://www.thewebhatesme.com/VisualCeption/compare.png)
If you use mobile emulation with custom pixelRatio option you need to define pixelRatio for VisualCeption as well:

## How it works

VisualCeption uses a combination of the "make a screenshot" feature in webdriver, imagick and native JavaScript to compare visual elements on a website. This comparison is done in five steps:

1. **Take a screenshot** of the full page using webdriver.
2. **Calculate the position** and size of the selected element using JavaScript.
3. **Crop the element** out of the full screenshot using imagick.
4. **Compare the element** with an older version of the screenshot that has been proofed as valid using imagick. If no previous image exists the current image will be used fur future comparions. As an effect of this approach the test has to be **run twice** before it works.
5. If the deviation is too high **throw an exception** that is caught by Codeception.

## Requirements

VisualCeption needs the following components to run:

* **Codeception** VisualCeption is a module for [Codeception](http://codeception.com/). It will need a running version of this tool.
* **Imagick** For comparing two images VisualCeption is using the imagick library for php. For more information visit [php.net](http://www.php.net/manual/de/book.imagick.php) or the [installation guide](http://www.php.net/manual/en/imagick.setup.php).
* **WebDriver module** This tool only works with the webdriver module in Codeception at the moment.

## Installation

Make sure you have php-imagick extension installed. Run `php -m` to see if imagick extension is enabled.

Then add VisualCeption to composer.json:
acceptance.suite.yml

```
composer require "codeception/visualception:*" --dev
```

### Configuration

To use the VisualCeption module you have to configure it.

**Example Configuration**

```yaml
modules:
enabled:
enabled:
- WebDriver:
url: http://localhost.com
browser: firefox
- VisualCeption:
maximumDeviation: 5 # deviation in percent
saveCurrentImageIfFailure: true # if true, VisualCeption saves the current
fullScreenShot: true # fullpage screenshot
```

* **referenceImageDir** (default: `'VisualCeption/'`) VisualCeption uses an "old" image for calculating the deviation. These images have to be stored in data directory (tests/_data) or be relative to it.
* **currentImageDir** (default: `'debug/visual/'`) temporary directory for current processed images. Relative to output dir `tests/_output`.
* **maximumDeviation** (default: `0`) When comparing two images the deviation will be calculated. If this deviation is greater than the maximum deviation the test will fail.
* **saveCurrentImageIfFailure** (default: `true`) When the test fails, the current image will be saved too, so it's easier to change the reference image with this one. The image will appear beside the compare image with the prefix "current."
* **report** (default: `false`) When enabled an HTML report with diffs for failing tests is generated. Report is stored in `tests/_output/vcresult.html`.
* **module** (default: `'WebDriver'`) module responsible for browser interaction, default: WebDriver.
* **fullScreenShot** (default: `false`) fullpage screenshot for Chrome and Firefox

## Usage

VisualCeption is really easy to use. There are only two methods that will be added to $I <code>seeVisualChanges</code> and <code>dontSeeVisualChanges</code>.

```php
$I->seeVisualChanges("uniqueIdentifier1", "elementId1");
$I->dontSeeVisualChanges("uniqueIdentifier2", "elementId2");

$I->dontSeeVisualChanges("uniqueIdentifier3", "elementId3", array("excludeElement1", "excludeElement2"));

$I->dontSeeVisualChanges("uniqueIdentifier3", "elementId3", array("excludeElement1", "excludeElement2"), $deviation]);
capabilities:
...
chromeOptions:
...
mobileEmulation:
deviceMetrics:
height: 812
width: 375
pixelRatio: 3.0
```

* **uniqueIdentifier** For comparing the images it is important to have a stable name. This is the corresponding name.
* **elementId** It is possible to only compare a special div container. The element id can be passed. *You can use CSS locators*.
* **excludeElements** Optional parameter as string or an array of strings to exclude an element from the screenshot. Maybe there is an animated image in your test container, so you can ignore it. *You can use CSS locators*.
* **$deviation** Optional parameter as float use if it is necessary to establish deviation coefficient other than configuration.
Just add pixelRatio option

**Example Usage**
```php
$I->seeVisualChanges( "subNavigation", "#subNav" );
$I->dontSeeVisualChanges("content", "div.content", array("#intro"));
```

If you need more information about the test run please use the command line debug option (-d or --debug).

## HTML Reports

Enable Reports in config and use nice HTML output to see all failed visual tests with their image diffs on a page:

```yaml
modules:
enabled:
- WebDriver:
url: http://localhost.com
browser: firefox
enabled:
- VisualCeption:
report: true
templateFile: "/report/template2.php" # Absolute path or relative from module dir to report template. Default "/report/template.php"
```

## Restriction

VisualCeption uses the WebDriver module for making the screenshots. As a consequence we are not able to take screenshots via google chrome as the chromedriver does not allow full page screenshots.

## Run tests with Docker
```
docker-compose up --abort-on-container-exit
maximumDeviation: 0.05 # deviation in percent
saveCurrentImageIfFailure: false # if true, VisualCeption saves the current
pixelRatio: 3.0 # pixel ratio
```
21 changes: 19 additions & 2 deletions src/Codeception/Module/VisualCeption.php
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,9 @@
use Codeception\Exception\ImageDeviationException;
use Codeception\Module as CodeceptionModule;
use Codeception\Test\Descriptor;
use Facebook\WebDriver\Exception\UnknownServerException;
use RemoteWebDriver;
use Codeception\Module\VisualCeption\Utils;
use Codeception\TestInterface;
use Facebook\WebDriver\Remote\RemoteWebDriver;

Expand All @@ -30,6 +33,7 @@ class VisualCeption extends CodeceptionModule implements MultiSession
protected array $config = [
'maximumDeviation' => 0,
'saveCurrentImageIfFailure' => true,
'pixelRatio' => 1.0,
'referenceImageDir' => 'VisualCeption/',
'currentImageDir' => 'debug/visual/',
'report' => false,
Expand All @@ -43,6 +47,11 @@ class VisualCeption extends CodeceptionModule implements MultiSession
*/
protected bool $saveCurrentImageIfFailure;

/**
* @var float
*/
protected float $pixelRatio;

/**
* @var string
*/
Expand Down Expand Up @@ -113,6 +122,7 @@ public function _initialize(): void

$this->maximumDeviation = $this->config["maximumDeviation"];
$this->saveCurrentImageIfFailure = (boolean)$this->config["saveCurrentImageIfFailure"];
$this->pixelRatio = (float)$this->config["pixelRatio"];
$this->referenceImageDir = (file_exists($this->config["referenceImageDir"]) ? "" : codecept_data_dir()) . $this->config["referenceImageDir"];

if (!is_dir($this->referenceImageDir)) {
Expand Down Expand Up @@ -503,7 +513,13 @@ private function createScreenshot($identifier, array $coords, array $excludeElem
$screenshotBinary = $this->webDriver->takeScreenshot();

$screenShotImage->readimageblob($screenshotBinary);
$screenShotImage->cropImage((int)$coords['width'], (int)$coords['height'], (int)$coords['offset_x'], (int)$coords['offset_y']);

$screenShotImage->cropImage(
(int) $coords['width'] * $this->pixelRatio,
(int) $coords['height'] * $this->pixelRatio,
(int) $coords['offset_x'] * $this->pixelRatio,
(int) $coords['offset_y'] * $this->pixelRatio
);
$screenShotImage->writeImage($elementPath);
}

Expand Down Expand Up @@ -572,7 +588,8 @@ private function compare($identifier)
if (!file_exists($expectedImagePath)) {
$this->debug("Copying image (from $currentImagePath to $expectedImagePath");
copy($currentImagePath, $expectedImagePath);
return array(null, 0, 'currentImage' => null);

throw (new \Exception("Reference image $expectedImagePath has just been saved. Start test again. If it's CI run - please add reference."));
} else {
return $this->compareImages($expectedImagePath, $currentImagePath);
}
Expand Down
Loading