UIlicious Docs

Release Notes

What the version numbers mean:

<Major>.<Minor>.<Patch>

  • Major: Contains breaking changes
  • Minor: Contains new features
  • Patch: Contains enhancements and bug fixes only

3.39.1

Released 18 Apr 2024

🐞 Fixes

Studio

  • Fixed an issue with test runs using outdated versions of test files due to cache issues.

3.39.0

Released 17 Apr 2024

💪 Enhancement

Test Engine

  • Add new topt plugin for generating time-based OTP. Usage:
    let TOPT = TEST.loadPlugin('topt'); 
let otp = TOPT.generateOTP(<OATH_KEY>
    Read more about generating time-based OTP in this guide.

3.38.1

Released 22 Mar 2024

🐞 Fixes

Test Engine

  • Fixed issue with metamask plugin setup

3.38.0

Released 5 Mar 2024

💪 Enhancement

Studio

  • Jobs:
    • Improved look of job last run result widget
    • Improved performance of job runs history page

3.37.1

Released 28 Feb 2024

🐞 Fixes

  • Fix Discord Notification for test runs triggered by jobs not being sent

3.37.0

Released 14 Feb 2024

Save and select frequently used configurations from the new Run Configuration Menu

💪 Enhancement

Studio

  • Editor:
    • Saved Run Configurations: You can now save test run configurations that you frequently use, so that you can quickly pick a configuration and run a test with the selected configuration.
    • You can also set a saved run configuration as a default. Note that if you have previously set a default dataset and default region, these settings will be ignored when you set a configuration as a default, as the dataset and region will be set from the default configuration instead.
    • "Custom Test Run" is now removed from the "Run" menu in the toolbar. Instead, we've added a Test Run Configuration Mega Menu, accessible via the "Gear" button on toolbar.
    • Updated iconography.

🐞 Fixes

Studio

  • Editor:
    • Fixed a minor bug with Resolutions dropdown that prevents resolution from being changed to another custom resolution when it is currently set to a custom resolution.

3.36.6

Released 22 December 2023

💪 Enhancement

Studio:

  • Jobs:
    • Added more search filters and improved the usability of the search filter component on the Runs tab.

3.36.5

Released 13 December 2023

💪 Enhancement

Studio:

  • Jobs:
    • Fixed a bug with jobs sometimes cancelling automatic retries on system errors.
    • Email verification is now required for creating jobs
    • For trial accounts, all test run credits for a job will be deducted upfront, to prevent jobs from being stuck halfway due to insufficient credits for all of the tests in the job.

CLI:

  • Email verification is now required for running tests using the CLI.

3.36.4

Released 7 December 2023

🐞 Fixes

Test Engine:

  • Fixed issue with I.press / I.type not working in some edge cases on Chrome / Edge Chromium.

3.36.3

Released 6 December 2023

🐞 Fixes

Test Engine:

  • Fixed an issue where files with the "plus" symbol in the file name could not be loaded.

3.36.2

Released 30 November 2023

🐞 Fixes

Test Engine:

  • Fixed issue in Firefox when using I.press / I.type command to send invisible characters such as the arrow keys to input fields
  • Updated I.fill command such at input field still has focus if the command is used to clear the field by setting the field to an empty value

3.36.1

Released 23 November 2023

🐞 Fixes

Test engine:

  • Updated implementation of UI.context to ensure that the context element is rendered and ready for interaction before performing each command in the UI.context block. If the context element is not found after 15 seconds (configurable using TEST.commandTimeout setting), test engine will return a friendly error message instead of “frame element not defined” or “no node with given id” errors.
  • The 'context' option for interactive commands such as I.click should behave exactly like UI.context now. E.g. I.click(”Save”, { context: “.popup-modal” }) is the same as writing UI.context(".popup-modal", ()=> {I.click("Save")} )

3.36.0

Released 22 November 2023

💪 Enhancement

Web Studio:

  • Test runs that are triggered by jobs and were retried automatically due to system errors will now be hidden from the list of test runs under the “Runs” tab.

3.35.3

Released 16 November 2023

🐞 Fixes

Test Engine:

  • Fix bug with IE 11 not being able to open new tabs
  • Improved detection of internal 502 errors so that the system will trigger automatic retries of test runs that encounter such issues

3.35.2

Released 8 November 2023

🐞 Fixes

Web Studio:

  • Fixed bug resulting in system errors due to insufficient test runners due to jobs being allocated more test runners than the capacity that the space actually has.

3.35.1

Released 9 October 2023

🐞 Fixes

Web Studio:

  • Fix issue of status filter not working on the Monitoring page and the Runs page, when filtering for jobs and test runs with “Failure” and “System Error” status

3.35.0

Released 5 September 2023

🚀 New Feature

Web Studio:

  • Owners and admins may now Protect a file to prevent accidental modifications by themselves or their teammates.

3.34.2

Released 25 August 2023

🐞 Fixes

Web Studio:

  • Fix caching of screenshots - screenshots for test run should load faster now

3.34.1

Released 23 August 2023

🐞 Fixes

  • Test Engine:
    • Stack tracing (a.k.a jump to line of code feature)
      • Fix issue where if there’s an syntax error in the test script, the test report did not indicate which file and line the error happened at. Now it does.
      • Now, if a test calls another test using TEST.run command, the test report stack trace will now report the originating files that called the TEST.run command.
    • Fix an issue where the TEST.log command does not format json object / arrays properly and just prints out nothing. e.g. TEST.log.info(”hello: ”, 1, {x: 100}, [”apple”]) should print out all the values passed to the command in the report properly.

3.34.0

Released 14 July 2023

🚀 New Features

  • Test Engine

    • You may choose to run faster but less stable versions of the click command:

      • I.click(”button”, {use: “fast”})
      • I.click(”button”, {use: “javascript”})
      • .click(”button”, {use: “fast-javascript”})

    • You may also disable screenshot for individual commands:

      • I.click(”button”, {use: “fast”, takeScreenshot: false})

3.33.4

Released 7 Jul 2023

💪 Enhancement

  • Web Studio
    • Editor : You can now jump to the file and the line of code for a test step from a test report, making debugging tests easier!

🐞 Fixes

  • Web Studio
    • Editor
      • Fixed issue where sometimes clicking on the "Run" button doesn't start the test run.

3.33.3

Released 28 Jun 2023

🐞 Fixes

  • Test Engine:
    • Hotfix for bug where if a new tab is opened, the reported page title and url for the new tab is incorrect.

3.33.2

Released 27 Jun 2023

💪 Enhancement

  • Test Engine:
    • I.click command:
      • I.click(element, x, y) now support percentages for "x" and "y" parameters. Using percentage offset will click on position x% of the width and y% of the height of the element from its top-left corner.
      • Screenshots are now taken after hover, to capture :hover CSS effects, but before the click operation.
      • Enhanced javscript click fallback to simulate full sequence of mouse click events (mouseenter -> mouseover -> mousemove -> mousedown -> click -> mouseup)
      • Added support for double click and right click operations for testing on Safari and IE11 by simulating mouse events on target element with javascript.
    • I.hoverOn command:
      • I.hoverOn now supports hovering on positions using X and Y offsets from an element or from the screen, similar to I.click command.
      • Added support for hover for testing on Safari and IE11, to a limited extent. This will trigger javascript mouse events on the target element, but will not trigger :hover CSS style changes.
    • TEST.log commands now automatically concatenate multiple arguments, and stringify JSON objects.
    • Added "metamask" plugin which provides helper functions to simplify the setup of the wallet and network on the MetaMask extension.

🐞 Fixes

  • Test Engine:
    • I.click command:
      • Fix issue where I.click doesn't work on elements within some types of iframes
      • Fix issue where I.click has clicked on an element within an iframe, but the click target indicator displayed over the screenshot in test reports shows the incorrect location
    • I.drag commands:
      • Fix issue where drag and drop doesn't work on some types of HTML5 drag and drop elements where other elements move when the drag element passes over them, e.g. sortable lists.
  • Web Studio:
    • Monitoring page: Optimised rendering to fix slowness in opening and closing create/edit job form modal when the project has too many files.

3.33.1

Released 26 Jun 2023

💪 Enhancement

  • Revamped Monitoring Tab:
    • Improved performance of filtering and listing jobs
    • Improved design to make job statuses more easy to see
    • Added new filters and allow multi-select on filters

3.33.0

Released 08 Jun 2023

🚀 New Features

  • Added support for testing on Chrome browser with Metamask extension. Note that this requires the "Metamask Test Runner" add-on.
  • Profile Picture: You may now set your own profile picture.

3.32.0

Released 28 April 2023

🚀 New Features

  • Login with Google / Github is now supported.

3.31.1

Released 20 April 2023

💪 Enhancement

  • Web Studio:
    • "Downloaded Files" tab added to test reports, showing list of files downloaded during the test run, and allowing download of files as a zip.
    • You can now download all your project files as a zip in the "Project Settings" page.

3.31.0

Released 24 March 2023

🚀 New Features

  • Test Engine:
    • New commands under UI.Downloads for listing and referencing downloaded files during test execution:
      • Use UI.Downloads.files or UI.Downloads.listFiles() to get the list of files, which is an array of file metadata, including the file name and sizes
      • Use UI.Downloads.hasFile to validate that a file has been downloaded
      • You may also use the I.upload command to upload a file that has been downloaded.

3.30.4

Released 07 March 2023

💪 Enhancement

  • Web Studio
    • PDF Test Reports:
      • Show annotations and issues in PDF test reports

🐞 Fixes

  • Embeddable test report player
    • Fixed an issue where the screenshots are not displayed in the correct size when viewing the embeddable test report player on Firefox.

3.30.3

Released 01 March 2023

🐞 Fixes

  • Web Studio
    • AI Test Assist:
      • An error message is now shown if the AI isn't able to generate a response for the given prompt, instead of being stuck loading as it automatically retries.

3.30.2

Released 22 February 2023

💪 Enhancement

  • Embeddable test report player
    • The selected dataset and region for the test run is now shown in embeddable test report player
    • You can now set an end step and turn on looping. Setting an end step will stop the player automatically when it reaches the end step during autoplay.
    • Failed steps are now more clearly displayed.

3.30.1

Released 22 February 2023

💪 Enhancement

  • Embeddable test report player
    • Show annotations and issues in embeddable test report player

3.30.0

Released 16 January 2023

🚀 New Features

  • Web Studio
    • You can now create additional workspace(s) in your personal space to better organize your projects.
      • To create a new workspace, click on the ‘Add workspace’ button in the left Workspaces sidebar.

🐞 Fixes

  • Web Studio

    • Fixed newly added workspace is disappearing after refreshing the workspace page.
    • Fixed newly registered accounts don't have any free test runs
    • Fixed message is not showing for users create their own free workspace

  • User Panel

    • Broken redirection after accepting invitation

3.29.6

Released 22 December 2022

💪 Enhancement

  • Web Studio
    • You can now schedule jobs by day of month and/or day of year
      • Every X months on the 3rd day of the month (e.g. 3rd Apr, 3rd Jun, 3rd Aug…)
      • Every year on a specific date (25th of December every year)

3.29.5

Released 8 December 2022

💪 Enhancement

  • Web Studio
    • The credentials for Webdriver connection are now masked out by default to better protect privacy.

🐞 Fixes

  • Fixed an issue where the runs tabs and pagination is not working correctly when there are active running tests.

3.29.4

Released 29 November 2022

💪 Enhancement

  • Web Studio
    • You can now view past notifications received by clicking on the "bell" icon in the top right corner of the main menu.

🐞 Fixes

  • Fixed an issue where the results of jobs are not showing immediately upon loading.

3.29.3

Released 23 November 2022

🐞 Fixes

  • Fixed issue where I.click command will randomly fail with “Cannot perform click on element as it has been detached from DOM” error when the click triggers a page navigation and the subsequent page is slow to load.

3.29.2

Released 14 November 2022

💪 Enhancement

  • Test Engine
    • Added I.getURL command
    • Added TEST.runOnce command

3.29.1

Released 09 November 2022

💪 Enhancement

  • Web Studio
    • Add new browser add-on plan to purchase test runner for chrome, firefox, edge and Safari

🐞 Fixes

  • User Panel
    • Fixed User cannot cancel subscription

3.29.0

Released 07 November 2022

🚀 New Features

  • Web Studio
    • Browser Add-ons
      • You may now purchase additional Safari browser test runners as an add-on
        • The additional Safari browser test runners may only be used for running tests on Safari
        • Additional test runners that are purchased will show up separately
        • You may upgrade / downgrade / remove the browser add-on at any time

💪 Enhancement

  • Web Studio

    • Change tooltip from “Maximise Preview” to “Full Screen”
    • You can now set custom resolution when running a test
    • Skip file naming dialog when creating test files

  • User Panel

    • Revamped “Manage billing” page
    • UI improvements to ensure consistency in styling UI components

🐞 Fixes

  • Web Studio
    • Fixed Project directory context menus should be the same
    • Fixed Editor no longer opens the README file by default
    • Fixed uploading a file, editor should open the uploaded file instead of the scratchpad
    • Fixed “Unsaved changes” warning keeps appearing when editing a file while a test is running
    • Fixed Change “Add issues” hotkey binding
    • Fixed Cannot upload project logo

3.28.2

Released 07 October 2022

🐞 Fixes

  • User Panel
    • Fixed Profile name not updating accordingly

3.28.1

Released 26 September 2022

🐞 Fixes

  • Web Studio
    • Fixed button to start the tutorial

3.28.0

Released 29 August 2022

🚀 New Features

  • Web Studio
    • Test Report Annotaions
      • You can now mark up test run screenshots with comments by pointing or drawing regions.
      • Added ability to manually fail a test by toggling the ‘Fail test run’ switch when adding a new issue. Turning the switch on will change the test run’s status to ‘failed’ even if the run was successful.
      • Added Maximize / minimize preview button. This button expands or minimizes the preview window, allowing the user to draw annotations more easily

🐞 Fixes

  • Web Studio
    • Fixed position issue with dropdown popover menus
    • Fixed error with running test count
    • Fixed steps not showing on runs tab

3.27.0

Released 19 August 2022

🚀 New Features

  • Web Studio
    • Custom Branding on Projects
      • You can now add a logo for your project and change the project’s background color to match your company’s or client’s branding.
      • To update your project branding:
        1. Go to an existing project
        2. Click on the “gear” icon and click on the “Branding” tab
        3. Add your logo and change the background colors
        4. Click update to save your settings

🐞 Fixes

  • Web Studio
    • Fixed issue where the UI is broken after renaming the project.

3.26.2

Released 17 August 2022

🐞 Fixes

  • Inboxkitten
    • Fixed the issue where email content is empty

3.26.1

Released 05 August 2022

🐞 Fixes

  • Web Studio
    • Fixed the issue with incorrect link redirection when inviting a user to create an account on uilicious

3.26.0

Released 04 August 2022

🚀 New Features

  • Web Studio
    • Project Webdriver configuration
      • You can now connect directly to your UIlicious test runner via a Webdriver connection. The Webdriver settings for can be found in Project Settings (the gear icon) > Webdriver.

💪 Enhancement

  • Web Studio
    • Word wrap is disabled by default
    • Added “Auto-Format” button to help you automatically fix code indentation

3.25.2

Released 26 July 2022

💪 Enhancement

  • Web Studio
    • Test Runner Status
      • The UI for the test runner status dropdown has been improved. It now shows the total available test runners and also the ‘Dataset’ for each test run.

3.25.1

Released 22 July 2022

🐞 Fixes

  • Web Studio
    • Fixed an issue where “Edit Dataset” button is hidden when value entered is too long
    • Increased margin size around the URL display in test report
    • Fixed dataset retrieving. Dataset is now retrieved from the server every time the “edit dataset form” button is opened
    • Fixed runs tab pagination and counter not updating properly

3.25.0

Released 21 June 2022

🚀 New Features

  • CLI
    • Added the --userAgent support (chrome only) for test run via CLI

💪 Enhancement

  • CLI
    • Added the option to pass the access key via UILICIOUS_ACCESSKEY, instead of a param on the CLI
    • Improved error handling for upload errors (for debugging a regression issue)

🐞 Fixes

  • CLI
    • Fixed error handling for expired accounts, and several other failure modes, which the CLI would have looped on

3.24.1

Released 25 May 2022

🐞 Fixes

  • Web Studio
    • Fixed "Dataset" filter is not filtering properly on the Monitoring Page

3.24.0

Released 25 May 2022

🚀 New Features

  • Web Studio
    • You can now add file and folders quickly by right-clicking on any directory file or folder.

💪 Enhancement

  • Web Studio
    • The Search bar in the ‘Test Runs’ page has been updated with a greatly improved interface.
      • Multi-select filters: You can now select multiple values for the Status, Browsers, Resolutions, and Triggers filters.
      • Search by Run ID: You can now also search by the Run ID in the search bar.

🐞 Fixes

  • Web Studio
    • The "Enable Job" controls on the Job Settings page will now correctly show when a job is disabled.

3.23.3

Released 26 April 2022

💪 Enhancement

  • Web Studio
    • Region dropdown improvements:
      • Timezones: The region picker now shows the timezone of the region so that it is easier to tell in which timezone your tests will run.
      • Continents: The options in the region picker are now grouped by continents to make it easier to find the region you want.
      • Set default region: You can now set a default region for your tests. Once a default region is test, all tests will be set to run from that region by default.
    • Job scheduling field improvements
      • Presets for "everyday", "on weekdays", "on weekends" has been added to make it easy to setup common scheduling scenarios.
      • Confusing combinations have been removed.
    • Editor: Find and Replace
      • You can now find and replace text in the test script editor. Press Cmd/Ctrl-F or press the search button to open the find and replace popup.
    • Additional info in Test Run reports
      • The region the test was run in (only visible if not default)
      • The dataset used for the test (only visible if not default)
      • The timestamp for the selected test step.

3.23.2

Released 11 April 2022

🐞 Fixes

  • Web Studio
    • Switching away from the Editor tab in large projects with many files is now much quicker and should no longer result in the “Page is unresponsive” error.

3.23.1

Released 04 April 2022

💪 Enhancement

  • Test Engine
    • Improved error messages like cannot read “label” of undefined when you forget an parameter, e.g. I.fill(”label”)
    • I.click now accepts a singlmie numeric field, e.g. I.click(2020)
    • I.fill will accept numbers for the value field, e.g. I.fill(”Year”, 2020)

3.23.0

Released 29 March 2022

💪 Enhancement

  • Web Studio
    • New and improved CSV file
      • Added and improved CSV Handling for easier organization of data
      • Added the following key features to the CSV Editor:
        • Insert rows
        • Delete rows
        • Edit cell values
        • Rename columns
        • Set first row as header

🐞 Fixes

  • Web Studio
    • Files are now saved correctly when quickly switching between files
    • Editor Cursor will now appear correctly when collapsing the “Results” panel

3.22.1

Released 25 March 2022

🐞 Fixes

  • Web Studio
    • Fixed file name in the title bar is clipped off. It should now display the entire name as long as it has enough space.
    • Fixed cloning test files that creates a “.test.js.test.js” file.

3.22.0

Released 24 March 2022

🚀 New Features

  • Web Studio
    • Right clicking on a File in the directory now opens the context (the “...”) menu
    • Files and Folders can now be cloned

💪 Enhancement

  • Web Studio
    • Improved File/folder input component with typeahead suggestion and file picker dialog
    • Drag and Drop to upload files is now supported
    • Multiple Files or a Folder full of files can now be uploaded without using uilicious CLI
    • Double clicking a folder will not collapse the folder

3.21.6

Released 8 March 2022

🐞 Fixes

  • Test Engine
    • Fixed an issue where some self-signed certs will give a 502 error instead of loading the page
    • Fixed unexpected error with I.closeTab command because a bug in switching to the next browser tab after closing the tab.

3.21.5

Released 5 March 2022

🐞 Fixes

  • Web Studio
    • Fixed slowdown in loading Monitoring and Runs tabs due to large queries for test run history

3.21.4

Released 24 February 2022

🐞 Fixes

  • Web Studio
    • Fixed issue where growl alerts (for success and error messages) are not being displayed.
  • Test Engine
    • Fixed intermittent "element is detached from DOM" issue when an I.click operation triggers a page navigation and page takes took long to load causing the webdriver to timeout for the click operation.

3.21.3

Released 23 February 2022

💪 Enhancement

  • Web Studio:
    • Added a Welcome tour to help new users get started with testing using UIlicious
    • Usability improvements to the "Datasets" form to fix several confusing behaviors when adding new properties to the dataset
    • User preferences (e.g. autosave, default dataset) is now saved to server instead of the browser's local storage, and can be restored to browser sessions across different devices.

🐞 Fixes

  • Web Studio
    • Fix issue where the tooltips are sometimes empty

3.21.2

Released 04 January 2022

🐞 Fixes

  • Test Engine
    • Improvements to page element visibility checks for all commands that target an element, e.g. I.click. This fixes an issue in some edge cases where some elements cannot be detected because they are evaluated as invisible.

3.21.1

Released 22 December 2021

🐞 Fixes

  • Web Studio:
    • Fixed an issue where some users are missing in Space's Member lists
  • Test Engine:
    • Fixed the issue with Timezones. System Timezone should now match with the time for the selected region

3.21.0

Released 6 December 2021

🚀 New Features

  • Test Engine
    • New Window resize command
      • UI.resize allows you to change the browser resolution in the middle of the test.
        • UI.resize(<width>, <height>) - to resize window
        • UI.resize(<width>, <height>, {target: "viewport"})
      • Also added some basic properties for the new command
        • UI.outerWidth, UI.outerHeight - get the current width and height of the window
        • UI.innerWidth, UI.innerHeight - get the current width and height of the viewport

🐞 Fixes

  • Test Engine
    • Fixed an issue where I.select doesn't work on some VueJS dropdowns

3.20.0

Released 5 Oct 2021

🚀 New Features

  • Web Studio
    • Changes to user quota count. Now, only Collaborator users count towards the quota. Collaborator users are users that are allowed to edit resources (projects, tests, jobs) in the space, therefore it includes the the Owner, Admin, and Editor roles.

💪 Enhancement

  • Web Studio:
    • Load README file by default. If a README file exists in the project it will automatically load it after accessing the project.

🐞 Fixes

  • Web Studio:
    • Fixed sorting in members list
    • Fixed broken dropdown menu UI

3.19.0

Released 23 Jul 2021

🚀 New Features

  • Web Studio:
    • Added Bulk Enable / Disable feature in Monitoring tab
      • This allows you to enable or disable multiple jobs all at the same time.
    • Added Bulk Delete feature in Monitoring tab
      • This allows you to delete multiple jobs

3.18.0

Released 6 Jul 2021

🚀 New Features

  • Support for testing on Chromium-based Microsoft Edge.
    • The new Edge browser will be referred to as "Edge (Chromium)" and legacy Edge browser will be referred to as "Edge (2019)" within the Studio.
    • If you are using the CLI to trigger test runs, you can set the --browser option to edgechromium to run tests on the new Edge browser. Setting the --browser option to edge will run tests on the legacy Edge browser, for backwards compatibility.
  • New Test Commands:

💪 Enhancement

  • Test Engine:
    • Improvements to selection commands (I.select, I.selected, I.deselect, and I.deselected):
      • Improved smart targeting - previously, if both a <select> dropdown and a toggle field (either a checkbox or a radio button) matched the label, the engine would always prefer the dropdown even if the label matches the toggle field more closely.
      • Blue interaction markers now also indicate where the selection command is targeting

🐞 Fixes

  • Test Engine:
    • Fixed a bug where if I.click triggers an alert, the command will fail indicating the action is blocked by an alert, even though it is actually successful.

3.17.0

Released 24 Mar 2021

Test Suites illustration

We're very excited to announce the Test Suites update! This should help you to organise and manage tests better.

🚀 New Features

  • Web Studio:
    • Jobs:
      • Test Suites - you can now schedule a job to run a suite of tests and get an aggregated report! Read more on our blog here.open in new window
      • More scheduling options - you can now schedule jobs every 45 mins, every 2 weeks, every 30 days, etc...

🐞 Fixes

  • Web Studio:
    • Fixed issue where the space disappears if the last project is deleted.
    • Fixed issue where pressing the "x" to close the modal does nothing.
    • (For UI-licious Enterprise edition) Share report button will be hidden if snippets is not enabled on the instance.

3.16.4

Released 18 Feb 2021

🐞 Fixes

  • Web Studio:
    • Fixed slow scrolling in very large reports in some browsers (e.g. Chromium and WebKit browsers) because too many tooltips rendered on individual steps in the report. Now tooltips are only drawn as needed to reduce rendering overhead.
    • "More info" toggle button on report step will not be shown if there's no additional information available.

3.16.3

Released 17 Feb 2021

💪 Enhancement

  • Web Studio:
    • Improved reports:
      • Fixed alignment issues
      • Added "More info" for each step to show additional information such as the returned value of the command (useful for commands like I.getText, UI.execute / UI.http - which you usually want to save the value to a variable).

3.16.2

Released 10 Feb 2021

💪 Enhancement

🐞 Fixes

  • Test Engine:
    • I.click command:
      • Fix some edge case issues with clicking elements in iframes
      • Fix accuracy of I.click(x, y) and I.click(element, x, y) in some edge cases
      • If for some reason the element is removed or re-rendered in the middle of the click operation, causing a stale element reference error, the command will retried
      • Timing of the command will now include any page navigation triggered after the click
    • I.hover command is now supported for Edge browser
    • Testing within iframes:
      • If a command is executed within an iframe, the reported tabs, url and page title should be that of the top browsing context, not of the iframe's browsing context.
      • Fix the indicated position of interaction commands (as marked by the blue circle in reports) within iframes. There are still some issues in the case where the iframe is a long scrollable container though.

3.16.1

Released 9 Feb 2021

💪 Enhancement

  • UI-licious server (under the hood stuff):
    • Stopping a test will now immediately free up the concurrency instead of waiting until the test fully stops.
    • Changes under the hood in order to support new upcoming features in jobs and reporting. 😉

3.16.0

Released 8 Feb 2021

🚀 New Features

🐞 Fixes

  • Test Engine:
    • Fix bug with I.amAt not honoring TEST.commandTimeout. Now, I.amAt will retry until it succeeds or timed out, instead of failing when current url did not immediately match.

3.15.3

Released 5 Feb 2021

🐞 Fixes

  • Web Studio:
    • UI should probably display appropriate error messages for 4xx errors from the API instead of a vague error message.

3.15.2

Released 15 Jan 2021

  • Web Studio:
    • Fix bug where file cannot be viewed on the Editor if its name contains the square brackets characters - [ and ].
    • Display warning if the configured test for a job has been moved or deleted.

3.15.1

Released 13 Jan 2021

  • Test Engine
    • Fixed bug with TEST.autoScreenshot=false having no effect - it should properly disable screenshots now.

3.15.0

Released 6 Jan 2021

💪 Enhancement

  • Account and billing:
    • If you own more than one space, you can manage billing independently for both spaces.
    • Space members with the Admin role can now manage billing.

3.14.0

💪 Enhancement Released 28 Dec 2020

  • Web studio:
    • All resolutions are now enabled for Safari and IE11
    • Added button to go to Applitools report if test is ran with Applitools integration
    • When loading a report on the Editor for a test ran using a dataset, the dataset will be automatically selected in the Run toolbar
    • Add tooltip to indicate browser name and version number when you hover over the browser icon in reports.

3.13.3

  • Released 17 Dec 2020 *

💪 Enhancement

  • For Enterprise On-Premise Edition:
    • System administrators can now configure system-wide concurrency limits. If there are more requests to run test than the configured limits, then requests will be postponed (if it is a scheduled test triggered via a job) or rejected with "No server available" error (if it is an adhoc test run via the Editor or CLI).

3.13.2

Released 16 Dec 2020

🐞 Fixes

  • Test engine:
    • Fix bug where I.select does not work for <select> element in some iframes

3.13.1

Released 25 Nov 2020

🐞 Fixes

  • Test engine:
    • (Applitools Integration) Fix bug that causes eyes is undefined error if you call TEST.applitools.setup more than once.

3.13.0

Released 14 Sept 2020

💪 Enhancement

  • Test engine:
    • Performance optimisations to improve test start times (reduced from an average of 15 seconds to 7 seconds!)

🐞 Fixes

  • Test engine:
    • Fix issue in Edge browser tests being unable to properly scroll to and target elements in certain layouts.

3.12.1

Released 8 Sept 2020

🐞 Fixes

  • Test engine:
    • Fix issue that causes some files for the I.upload command to be corrupted.

3.12.0

Released 4 Sept 2020

💪 Enhancement

  • Test engine:
    • Faster keyboard input commands for Edge and IE11 tests

🐞 Fixes

  • Test engine:
    • Fix random "file not found" errors with test initialisation

3.11.1

Released 3 Sept 2020

🐞 Fixes

  • Test engine:
    • Fix issue properly targeting deeply nested web components on Chrome tests (affects Salesforce LWC testing)

3.11.0

Released 2 Sept 2020

💪 Enhancement

  • Test engine:
    • Performance optimisations to improve test start times

🐞 Fixes

  • Test engine:
    • Fix IE11 issue with randomly not filling fields sometimes
    • Fix IE11 "e is null" bug

3.10.0

Released 20 Aug 2020

💪 Enhancement

  • Studio
    • Added the "Admin" role - admins may manage users, projects, tests, and scheduled jobs.
  • Test engine:
    • Added user agent support for firefox tests
    • Added TEST.assert command.

🐞 Fixes

  • Studio
    • Fix the "Stop" button - in some cases, it did nothing.
    • Fix styling of "terminated" steps
    • If a step does not have a screenshot (bc. screenshots are disabled, or test was terminated, etc.), the report will fallback to the last available screenshot before step.
  • Test Engine:
    • Fix issue where test will timeout if I.wait is long (like a few minutes) but not that long (more than an hour)
    • Fix user agent support for chrome tests
    • Fix report processing of some errors causing error messages to be formatted as a blank string
  • (On-premise only) System administration
    • Fix search for user's access to a space, project, job, or test

3.9.0

Released 5 Aug 2020

💪 Enhancement

  • Studio:
    • You can now drag and drop to move files. 😃
    • Better page titles across the application

🐞 Fixes

  • Studio:
    • Fix janky tooltip display issues - sometimes tooltips will get stuck and doesn't go away

3.8.0

Released 3 Aug 2020

💪 Enhancement

  • Studio:
    • You can now set a dataset as a default for the Editor, so that when ever you load the Editor, it automatically gets selected as the dataset you want to run your tests with.
    • When you move away from the Editor tab to other tabs like "Monitoring", the last opened file is remembered, so that if you go back to the Editor, you'll see the last opened file instead of a blank file.

3.7.0

Released 23 Jun 2020

💪 Enhancement

  • Test Engine:
    • Added SAMPLE.fromList method - this will allow you to randomly pick a value from a list, e.g. SAMPLE.fromList("Red", "Green", "Blue")

🐞 Fixes

  • Test Engine:
    • Fix a bug with SAMPLE.id that causes the tests to crash

3.6.1

Released 22 Jun 2020

🐞 Fixes

  • Test Engine:
    • Fix issue when test cannot be run on application where window.self property has been overwritten
    • Improved error handling for unexpected session termination on Chrome and Edge browsers so that such test runs will be automatically retried when triggered by a job.

3.6.0

Released 16 Jun 2020

💪 Enhancement

  • We now support the ability to transfer projects to another space. Please contact your administrator (for UI-licious Enterprise Edition) or [email protected] to do so.

🐞 Fixes

  • Fix bug with cloning dataset

3.5.0

Released 9 Jun 2020

💪 Enhancement

  • Webhook reports - Improved error preview for failed tests
  • Clean up and restructuring underneath the hood to improve performance and support new features in the future.

🐞 Fixes

  • Jobs:
    • Fix bug enabling/disabling jobs.
    • Fix bug where scheduled jobs would sometimes skip timings in some edge cases
    • Fix bug where jobs that failed due to system errors are retried excessively due to race conditions.
    • Fix messy UI display of retry attempts for job test runs - hide previous attempts if the final attempt completed properly, otherwise show test run ID and attempt counts.

3.4.0

Released 2 Jun 2020

💪 Enhancement

  • UI-licious Cloud Testing Grid:
    • Performance optimisations to increase startup and execution time for Safari, Edge, and IE11 test sessions
  • Test Engine:
    • Taking screenshots for Safari tests is now faster.

3.3.1

Released 29 May 2020

🐞 Fixes

  • Studio
    • Fix bug where the running tests pill always showed 0 tests running.

3.3.1

Released 28 May 2020

🐞 Fixes

  • Studio
    • Fix bug - "Resend" space invitation was not working

3.3.0

Released 27 May 2020

💪 Enhancement

  • Clean up and restructuring underneath the hood to improve performance and support new features in the future.

3.2.4

Released 14 May 2020

🐞 Fixes

  • Studio
    • Dropped feature to download MP4 video for test report due to stability issues and lack of use.
  • Test Engine
    • Fix bug where the User-Agent string is set to null when running Chrome tests, causing issues in applications that rely on user agent detection.

3.2.3

Released 12 May 2020

  • Test Engine:
    • Fix issue with compile reports for tests that are terminated before completion.

3.2.2

Released 11 May 2020

🐞 Fixes

  • Studio - Monitoring Tab:
    • Fix time display for jobs that are set to start at exact 12:00 PM (was showing 12:00 AM instead)
    • Updated "Bulk Edit" interface so that it is neater and shows errors better.

3.2.1

Released on 7 May 2020

🐞 Fixes

  • Test Engine
    • Add relative path support for I.upload command

3.2.0

Released on 28 Apr 2020

🚀 New Features

  • Test Engine:
    • Added new commands to get and assert element attributes and classes:
      • UI.getAttribute(element, attribute) - returns the value of an attribute on an element
      • UI.hasAttribute(element, attribute, [value]) - assert the existance or value of an attribute on an element
      • UI.doesNotHaveAttribute(element, attribute) - asser the absence of an attribute on an element
      • UI.hasClass - assert the existance of a CSS class on an element
      • UI.doesNotHaveClass - assert the absense of a CSS class on an element

🐞 Fixes

  • Test Engine
    • Fix issue with executing click commands on IE11 in some edge cases

3.1.0

Released on 21 Apr 2020

💪 Enhancement

  • Studio - Monitoring Tab:
    • Add "Dataset" filter to make it easier to view jobs ran with specific datasets.
    • Add "Bulk Run" button to allow you to trigger "Run" on multiple jobs at a time.

🐞 Fixes

  • Studio - Editor:
    • Fix bug where "Region" setting from the "Advanced Run Settings" dialog "sticks" and also gets applied when triggering runs using the quick "Run" button on the toolbar afterwards.

3.0.1

Released on 17 Apr 2020

🐞 Fixes

  • Test Engine:
    • Improve error message when I.goTo command times out because the target page took too long to load.
    • Increase timeout for I.goTo command to fail if page takes too long to load from 1 minute to 5 minutes.

3.0.0

Released on 14 Apr 2020

This release contains a minor breaking change that only affects you if you've used TEST.loadDataFromCsv with only the file parameter passed in to read a CSV file with exactly one entry. See details below.

View TEST.loadDataFromCsv documentationopen in new window

❗️ Breaking Changes

  • Previously, TEST.loadDataFromCsv(file) could be used to read a CSV with exactly one entry. As this is an uncommon use case and support to read all entries in an CSV is a popular request, it made more sense for TEST.loadDataFromCsv to load all entries if dataset parameter is not provided, TEST.loadDataFromCsv(file) will now return all entries as a JSON object array instead. If your tests are failing due to this change, you need to update your test like this:

    // this will no longer work
var admin = TEST.loadDataFromCsv("admin_user.csv");

// fix by adding [0] to read the first element from the returned array
var admin = TEST.loadDataFromCsv("admin_user.csv")[0];

🐞 Fixes

  • Fix bug with processing TEST.loadDataFromCsv(file, options) method signature.
  • Fix bug with handling CSV files with exactly 2 rows and 2 columns.

2.23.12

Released on 27 Mar 2020

💪 Enhancement

  • You can now bulk edit notifications settings for jobs from the Monitoring dashboard.

2.23.11

Released on 24 Mar 2020

💪 Enhancement

  • Studio - Spaces:
    • Renamed the "Invite" button to "Manage members" button because it wasn't obvious that the button opens the controls for editting and removing team members as well.

🐞 Fixes

  • Studio - Editor:
    • Fix bug with failed steps with error supressions are being included in the error count.

2.23.10

Released on 20 Mar 2020

🐞 Fixes

  • Studio
    • Fix bug with "Try it" button on "Learn" pane not working
  • Test Engine:
    • Fix issue with I.click missing the target element on websites where the layout changes on scroll.
    • Fix missing return value for click, select, deselect, and drag commands - these commands will return true or false depending on where the action was performed successfully or not. E.g. false will be returned if the target element is not found.

2.23.9

Released on 16 Mar 2020

💪 Enhancement

  • Email reports:
    • Display test run time in more human-friendly way (now it shows 4:00 PM GMT+8 instead of 16:00 +0800)

🐞 Fixes

  • Email reports:
    • Fix issues with processing failed tests steps caused by non-assertion errors, causing some Test Failure reports to be unsent.
    • Fix bug were timezone offset for test run time was incorrectly computed
    • Display test run time in more human-friendly way (now it shows 4:00 PM GMT+8 instead of 16:00 +0800)

2.23.8

Released on 12 Mar 2020

🐞 Fixes

  • Fix issues with I.click targeting elements in scrollable dropdown menus.

2.23.7

Released on 04 Mar 2020

💪 Enhancement

  • Testing nested iframe elements is now supported - using nested UI.context

🐞 Fixes

  • Fix bug where the first command used in UI.context will always fail when used to target an iframe.

2.23.6

Released on 02 Mar 2020

🐞 Fixes

  • Fix bug with I.click not working on elements in iframes on Chrome 80.

2.23.5

Released on 28 Feb 2020

🐞 Fixes

  • Fix bug where PDF report show test run start time as 1 Jan 1970
  • (On-premise only) Fix link to PDF reports

2.23.4

Released on 20 Feb 2020

Several fixes for edge cases with click operations, and other minor fixes and improvements in the Test Engine.

💪 Enhancement

  • Test Engine:
    • Improve error handling for UI.execute so that it reports the actual javascript error now instead of a generic error.
  • Studio:
    • Minor performance improvements to reduce time to load UI-licious Studio

🐞 Fixes

  • Test Engine:
    • Fix evaluation of XPATH selectors in IE11 tests
    • Fix edge case issues with targeting element using coordinates or pixel offsets from target elements using I.click(x,y) and I.click(target, x, y)
    • Fix edge case issues with I.rightClick
    • Fix edge case issues with I.click on Salesforce navigation bar and dropdown components
    • Fix incorrect information about browser tabs and current page url being reported when I.click triggers a page navigation. Previously, I.click will show the screenshot taken before the click operation, but reports the browser tabs and current page url after the click operation instead. Now I.click commands will report the screenshot, browser tabs, and current page url before the click operation.
    • Fix bug where browser tabs and current page url does not update after I.closeTab commands are used

2.23.3

Released on 11 Feb 2020

💪 Enhancement

  • Spaces:
    • Clicking on the UI-licious Cake logo should bring you to the Spaces page without doing a full page reload
    • Spaces can be renamed directly by click on the name of the space on the Spaces page [Only for Space Owner roles]
  • Editor:
    • Added preview for .md files
  • Monitoring:
    • Added dropdown menu with quick actions to disable or delete a job from the Job list page.

🐞 Fixes

  • Editor:
    • Fix broken layout when viewing an image in the project files in Editor

2.23.2

Released on 14 Jan 2020

🐞 Fixes

  • Fix bug with tests not being ran with the selected dataset for users with the Editor role.

2.23.1

Released on 10 Jan 2020

💪 Enhancement

  • Editor:
    • New syntax highlighting theme to make it easier to read and understand test scripts
  • Test Engine:
    • Performance improvements during test initialising process. Projects that were very large were experience issues with very slow starts and occasionally timeouts due to the slow down.

2.23.0

Released on 12 Dec 2019

Major update to the test-engine - we've added I.hoverOn and I.rightClick command, ability to send chords in I.press and I.type, and fixed several issues.

🚀 New Features

  • New commands:
    • I.hoverOnopen in new window lets you hover on target elements, e.g. I.hoverOn("Help"), I.hoverOn(".menu")
    • I.rightClickopen in new window lets you press right mouse button on target element. However, if the action opens the default OS context menu, there is no way to interact with this menu or to take a screenshot of it. This command should only be used if you have a custom behavior for the element on right click.
  • I.press and I.type now supports key chords, e.g. I.press(["Alt", "r"]) will press "Alt" and "r" keys together.

🧪 Experimental (currently under Beta):

🐞 Fixes

  • Fixed issue with clearing fields with I.clear or I.fill("my field", "") commands on right-aligned fields or fields with values in RTL languages.
  • Fixed issue with test crashing when new tab to specific websites are opened
  • Fixed issue with I.dontSee always returning false - it should return true when target is not visible.
  • Fixed: improved error message if element cannot be found for I.getText and I.getValue commands
  • Fixed issue with alerts being auto-dismissed by default on Firefox
  • Fixed issue with test crashing when alerts are opened on Safari and IE11.

2.22.1

Released on 28 Nov 2019

🐞 Fixes

  • Fixed issue with UI showing no controls when the last project in the space is deleted.

2.22.0

Released on 13 Nov 2019

Applitools

🧪 Experimental (currently under Beta):

2.21.1

Released on 4 Nov 2019

💪 Enhancement

  • Editor: Pressing the "Stop" button now releases the Report pane immediately instead of waiting for the test run to be fully stopped, so that you can immediately execute another test.

🐞 Fixes

  • Fixed issue on "Manage Datasets" modal cannot be scrolled
  • Fixed issue with newly created jobs showing last run time as 1 Jan 1970.
  • Fixed layout on "Monitoring" tab to accomodate narrow screen sizes.

2.21.0

Released on 25 Oct 2019

🚀 New Features

  • Editor: Code hinting and auto complete is available as you type!
  • Browser Notifications: Get browser notifications whenever tests (triggered manually from the Editor) are completed.

💪 Enhancement

  • Jobs:
    • You can now get a quick glance of the schedule configured for a job on the Monitoring tab
    • Dates are now displayed in localised format.

🐞 Fixes

  • Runs page: Fixed Enter key support for submitting search query on the test runs

2.20.1

Released on 14 Oct 2019

Run tab filters

💪 Enhancement

  • Runs page: Added filters for searching test runs by Name, Status, Browser, and Trigger.

🐞 Fixes

  • Runs page: Fixed issue with pending test run reports not updating automatically.

2.20.0

Released on 8 Oct 2019

Microsoft Teams

🚀 New Features

  • Jobs: Integration with Microsoft Teams now supported - you can now get error reports sent straight to your channels in MS Teams.

2.19.3

Released on 2 Oct 2019

💪 Enhancement

  • Jobs: You can now enable / disable jobs to temporarily pause them.

2.19.2

Released on 23 Sept 2019

💪 Enhancement

  • Spaces page: (For cloud edition) Added tag to display subscription plan for each space

2.19.1

Released on 11 Sept 2019

💪 Enhancement

  • Reporter role: You can invite a team member as a Reporter. Reporters may only view reports.
  • Spaces page: Add indicator of your role in each space.

2.19.0

Released on 06 Sept 2019

Invite team members to your space

🚀 New Features

  • Spaces & Teams: You can now invite your team members to your Space (your collection of projects) as Editors! Editors may create, edit, run tests and schedule jobs, but may not manage users or billing.

💪 Enhancement

  • Editor Tab:
    • Added preview for your image files
    • Added icons to help you differentiate between different files types

2.18.8

Released on 26 Aug 2019 💪 Enhancement

We've made the Monitoring Dashboard richer to help you identify problems faster!

More Info and Actions on the Jobs List
  • Latest results at a glance: You can now see the latest result for each job at a glance, and click on the status to view the report directly.
  • More Info and Actions:
    • Added the browser, resolution, and dataset configuration information for each job to help you differentiate similar jobs at a glance.
    • Added the "Edit" button to allow you to edit your Job configuration without leaving the Jobs list page.
  • New Filters:
    • Added the resolution filter.
Bulk Edit Jobs
  • Bulk edit:
    • You can now select multiple jobs and bulk edit the browsers, resolutions, and schedule configurations for the selected jobs.

2.18.7

Released on 22 Aug 2019

🐞 Fixes

  • Drag and drop commands:
    • Fixed issues with the drag commands on implementations of the Drag and Drop UI where the original drag element is destroyed after dragging.

2.18.6

Released on 16 Aug 2019

🐞 Fixes

  • Drag and drop commands:
    • Fixed issues with the drag commands on various implementations of the Drag and Drop UI, including:
      • Native HTML5 implementations
      • Implementations that creates ghosts during dragging,
      • Implementations that detaches the drag element from its parent during dragging

2.18.5

Released on 8 Aug 2019 💪 Enhancement

  • PDF reports:
    • Added interaction highlighting to indicate targeted elements for interaction commands.
    • Buffered rendering to improve experience of loading really huge reports

🐞 Fixes

  • Reports:
    • Fixed janky scrolling issues when selecting a report step.
    • Fixed Preview Window not resizing to fit on Firefox, Safari, and Edge browsers.
  • Run Tab:
    • Fixed list display issue on Safari.
  • PDF reports:
    • Fixed overflow issues happening on certain screen sizes and zoom levels.

2.18.4

Released on 1 Aug 2019

💪 Enhancement

  • Improve performance of retrieving screenshots of the tests

2.18.3

Released on 19 July 2019 💪 Enhancement

  • Job filters:
    • Added filters to quickly filter jobs by name, and by statuses.

2.18.2

Released on 18 July 2019 💪 Enhancement

  • Added raw time taken to execute tests, including post-processing time.
    • Previously, we only displayed the time taken to execute a test excluding post-processing time (which includes time taken for capturing screenshots and other telemetry) and other script processing time (for example, if you have a long running loop to compute stuff in between test commands). Depending on the browser used for the test, the post-processing time can be significant. Some users requested for raw time taken in order to accurately predict the total time needed to execute the full test suite.

2.18.1

Released on 24 Jun 2019

💪 Enhancement

  • Editor: We've made some improvements to the editor to increase your productivity in writing tests.
    • Added hotkeys to quickly comment and uncomment lines using (CTRL + /, or CMD + / for Mac users)
    • Added hotkeys to quickly indent and un-indent using TAB and SHIFT + TAB.
    • Defaults for auto-indentation is now 1 tab instead of 2 spaces (sorry spaces!)
    • Braces and quotes are now automatically closed for your convenience.
  • Offline Warning: Display warning if you are currently offline

2.18.0

Released on 23 May 2019 🚀 New Features

  • Added new commands to assert HTTP status code of the current page:
    • UI.isStatusCode(code), UI.is200, UI.isNot200, UI.is404, UI.isNot404, UI.is500, UI.isNot500

💪 Enhancement

  • Improve report status message for terminated tests - add cause of test termination e.g. stopped by user, reached max test run time limit, reached max concurrency.

2.17.3

Released on 21 May 2019

🐞 Fixes

  • Fixed an issue that causes ESOCKETTIMEOUT errors in the test when a new tab is opened.

2.17.2

Released on 17 May 2019

💪 Enhancement

  • Update the report for test runs in jobs, replaced with the same report component as the editor for a more consistent look.
  • Added 🎨 color to browser icons so that it's faster to visually differentiate browsers

2.17.1

Released on 15 May 2019

🐞 Fixes

  • Fixed: Reports can't be loaded if they are too large (>2000 steps) and crashes the browser instead. Buffered rendering of the report to prevent browser from crashing.

2.17.0

Released on 13 May 2019

🚀 New Features

  • Added "Runs" tab - We added a new "Runs" tab so that you can view all your previously ran tests in one place.

💪 Enhancement

  • Test reports now shows you which tabs are opened at each step of the test.
  • Added browser icon to the preview window in test reports to indicate which browser the test was ran in.

2.16.1

Released on 6 May 2019

🐞 Fixes

  • Fixed: Safari tests freezes whenever native <select> dropdowns are opened.

2.16.0

Released on 23 Apr 2019

🚀 New Features

  • Added "Learn" pane to the editor which contains tutorials and references on how to write UI-liicous test scripts.

💪 Enhancement

  • Added prettier "Running Tests" dropdown to the top nav bar. Removed "Running Tests" drawer at the bottom of the screen.

🐞 Fixes

  • Fix slowdown of tests due to slow merge array function

2.15.3

Released on 1 Apr 2019

💪 Enhancement

  • Added TEST.browser, TEST.width and TEST.height to expose the settings for the current test run
  • Added I.pressDelete and I.pressBackspace commands for convenience.
  • Added I.clear to clear input fields (basically the same as I.fill using an empty string)

🐞 Fixes

  • Fixed issue with scrolling elements into center when elements are within scrollable elements within the page body. Elements within scrollable elements were often scrolled to the top of the screen which caused problems, especially for dropdown elements.
  • Fixed issue with I.fill command being able to properly clear certain input fields, and instead append the value instead.

2.15.2

Released on 26 Mar 2019

🐞 Fixes

  • Fixed issues with tab handling when alert popups are opened

2.15.1

Released on 25 Mar 2019

💪 Enhancement

  • Added new SAMPLE commands
    • SAMPLE.name - Generate random full name
    • SAMPLE.last - Generate random last name
    • SAMPLE.first - Generate random first name
    • SAMPLE.email - Generate random email address
    • SAMPLE.phone - Generate random phone number
  • Now you can close tabs with I.closeTab command! 😀

2.15.0

Released on 6 Mar 2019

🚀 New Features

  • Added editing and linting support in the web studio for .json, .csv, .md files.
  • Added new commands for loading test data from .json and .csv files within the project:
    • TEST.loadDataFromJson, TEST.loadDataFromCsv, TEST.loadDataFromFile

💪 Enhancement

  • Retrieval of test run results are now faster and more accurate!

🐞 Fixes

  • Fix error handling when user attempt to create a file when it already exists.

2.14.2

Released on 5 Mar 2019

💪 Enhancement

  • Sort dataset and dataset variables alphabetically. 😃

2.14.1

Released on 4 Mar 2019

💪 Enhancement

  • Improvements to web reports - added controls to allow you to jump directly to errors.

🐞 Fixes

  • Fix webhook report - When test fails, the report was showing last 3 steps from the end of the test instead of the last 3 steps from the first error occurrence, which isn't very helpful.

2.14.0

Released on 1 Mar 2019

🚀 New Features

  • You can now share test run results publicly with an unlisted url and as an embedded iframe.

2.13.1

Released on 29 Jan 2019

🐞 Fixes

  • Fix UI.context - UI-context was failing when single quotes are used in the selector

2.13.0

Released on 11 Jan 2019

🚀 New Features

  • You can download test results as MP4 Video

2.12.1

Released on 8 Jan 2019

🐞 Fixes

  • Fix I.seeCount - the assertion was still passing even if the count is incorrect

2.12.0

Released on 7 Jan 2019

🚀 New Features

  • Drag and drop commands are now available:
    • I.dragTo - Allows you to drag an element to another target element.
    • I.dragBy - Allows you to drag an element in a direction using (x,y) pixel offset.
    • I.dragUp, I.dragDown, I.dragLeft, I.dragRight - Shortcuts for I.dragBy

2.11.5

Released on 12 Dec 2018

💪 Enhancement

  • Improved performance on the test run history page for individual jobs.

2.11.4

Released on 5 Dec 2018

💪 Enhancement

  • Added test run durations to reports sent via webhooks.

2.11.3

Released on 30 Nov 2018

💪 Enhancement

  • UI.context can now be used to explicitly switch the context to an iframe. This is useful in cases where security policies on the web application or on specific browsers prevents UI-licious from normally being able to see the contents of iframes and test it.

2.11.2

Released on 25 Nov 2018

💪 Enhancement

  • UI.execute now prints out a snippet of the script to execute to make the test reports and flow easier to understand. And you may also override the log message for UI.execute.

2.11.1

Released on 20 Nov 2018

💪 Enhancement

  • You may now override xpaths and css selectors with more human-friendly labels in reports for every command, please refer to the documentation for each command.

2.11.0

Released on 7 Nov 2018

🚀 New Features

  • Datasets: You can now configure variables for running tests on different environments.
  • New commands:
    • I.getValue - Allows you to grab the value of an input field and set it to a variable
    • New scroll commands for conveninence - I.scrollUp, I.scrollDown, I.scrollLeft, I.scrollRight.
    • Error supression - For all I and UI commands, you can suppress the error with the $ variant of the command - e.g. I.see$("Flying pigs"). This may be useful when you want so suppress the errors for commands used as conditional expressions in if/else blocks.
    • Error and log suppression - For all I and UI commands, you can suppress the error and logs with the $$ variant of the command - e.g. UI.execute$$(...).

💪 Enhancement

  • Better error logging about errors in the test script itself.

2.10.0

Released on 25 Oct 2018

We'll be taking it slow for the next couple of months for some major refactoring under the hood so that we can write code more efficiently, improve the performance of UI-licious, and support development of features planned in our roadmap.

🚀 New Features

  • Stop button. Yes, you have been asking for it. Now there's a way to stop tests.
  • You can now see which tests that are currently being ran, how are they triggered, and how many of your concurrent test sessions are being used.

💪 Enhancement

  • Studio - Monitoring View
    • Added sorting controls to the Jobs overview.

2.9.0

Released on 20 Sept 2018

🚀 New Features

  • Test Engine:
    • You can take full page screenshots with these new configuration and commands:
      • Add TEST.fullScreenshot configuration option to set screenshots to be taken as full page screenshots. Set TEST.fullScreenshot = true to enable full page screenshots for all subsequent commands. Note that this slows down testing time significantly, you should use it only when necessary.
      • Add TEST.takeFullScreenshot() command to take a full page screenshot
  • Studio:
    • You can now download test run reports as JSON and CSV.
  • (For Enterprise On-Premise):
    • Added views to monitor running tests, all tests, and all scheduled jobs system-wide.

💪 Enhancement

  • Studio - Editor View:
    • You can now share reports of tests ran from the Editor view by grabbing the URL of report.
    • Where I.fill is performed on the screen is now highlighted
  • Studio - Monitoring View:
    • You can now set the User Agent in jobs. This setting currently only works for tests running on Chrome.
    • Added pagination for list of tests ran for a scheduled job to view reports for test ran further back.

🐞 Fixes

  • Studio - Editor View:
    • Editor wasn't loading new tests immediately after creation.

2.8.0

*Released on 6 Sept 2018

Highlights:

  • Studio - Editor View:
    • Where I.click are performed on the screen is now highlighted. However, screenshots for I.click now shows the screen before the click is performed, instead of the screen after the click is performed. If you need to view the screen after the click is performed, simply add another command after I.click such as I.see to capture the screen after.

🚀 New Features

  • Studio - Editor View:
    • "Autosave" switch to enable / disable autosaving of your test scripts.

💪 Enhancement

  • Studio - Editor View:
    • Added a warning if you try to leave the Editor with unsaved changes to prevent accidental loss of work.
    • For each step in the test report, we've added a "View Test" link so that you can jump to the script for that step. *

2.7.0

Released on 29 Aug 2018

🚀 New Features

  • Test Engine:
    • Added supported for User-Agent settings for tests ran on Chrome. You can now set User-Agent from the advanced run configuration in "Run" pane in the Studio Editor.
    • New commands for custom logging to support custom functions TEST.log.info, TEST.log.pass, TEST.log.fail.

💪 Enhancement

  • Studio:
    • We've changed our chat and ticketing system from Zendesk to Intercom for a better experience in supporting you. 😃

2.6.8

Released on 14 Aug 2018

🐞 Fixes

  • (Chrome, Safari, Edge, IE) Fix I.doubleClick
  • (Firefox) Fixed bug with I.click not working for some elements
  • (IE) Fix bug with handling XPATH selector

2.6.7

Released on 10 Aug 2018

🐞 Fixes

  • (Firefox) Fixed bug with I.click not working on elements within iframes

2.6.6

Released on 31 Jul 2018

🐞 Fixes

  • (Firefox) Fixed bug with I.click not working

2.6.5

Released on 30 Jul 2018

💪 Enhancements:

  • UI.context can now handle and target within multiple context matches
  • Added I.see.signpost for more explicit hints to the test engine to resolve similar matches using a related element

2.6.4

Released on 20 Jul 2018

🐞 Fixes

  • (Firefox) Fixed bug typing space characters

2.6.3

Released on 19 Jul 2018

💪 Enhancements:

  • You can now use relative paths for TEST.run

2.6.2

Released on 16 Jul 2018

🐞 Fixes

  • Fixed bug typing special characters

2.6.2

Released on 13 Jul 2018

💪 Enhancements:

  • Added workaround to perform keyboard actions on input fields that override values on input event causing characters to be erased

2.6.1

Released on 12 Jul 2018

💪 Enhancements:

  • Added I.clickXY command to click on an element using (x,y) coordinates

2.6.0

Released on 2 Jul 2018

🚀 New Features

  • (Beta) You can now select from which region you want to run your test for certain plans (for Pro users only)
    • Available Regions : Singapore, Frankfurt, California, Taiwan, Japan
    • Support browsers : Chrome, Firefox
  • (Beta) You can now run test on Safari (for Pro users only)

🐞 Fixes

  • Error test run notification report was missing ❗ from email subject

2.5.4

Released on 1 Jul 2018

💪 Enhancements:

  • Improve I.select so that it can handle hidden checkboxes that is styled using an associated label that is visible

2.5.3

Released on 28 Jun 2018

🐞 Fixes

  • (Firefox) Fixed bug in getting element from browser

2.5.2

Released on 13 Jun 2018

🐞 Fixes

  • Fixed error that happens when cancelling rename file action from title bar in the Editor
  • Block very edge case race condition where a file will override another

2.5.1

Released on 8 Jun 2018

💪 Enhancements:

  • I.amAt - Now supports partial matching of paths and handles RegExp.

2.5.0

Released on 4 Jun 2018

🚀 New Features

  • Added I.doubleClick command

🐞 Fixes

  • Fixed I.amAt - clean up extra / characters before asserting path to prevent incorrect failed assertions
  • Fixed I.filled - fails to catch errors
  • Screenshot does not automatically center target elements for selection commands.

2.4.0

Released on 1 Jun 2018

🚀 New Features

  • Add I.count and I.getCount to count elements and assert count of text and elements.

      Example:
  I.goTo("https://store.com/alcohol");
  I.count("beer", 99); // searchs for 99 occurances of "beer"
  var n = I.getCount("beer"); // gets the number of occurances of "beer" on the page as a variable

💪 Enhancements:

  • Better reports for the Editor Tab
    • Improved design - nicer preview window, better layout for mobile resolution tests
    • There's now URL and page title information for each step
    • You can now download test run screenshots as an animated GIF for up to 100 steps.
  • Scheduled jobs:
    • You can now set multiple email address for the job notification emails.
    • Added last 3 steps until first error in error reports sent to Webhooks.
  • Test engine:
    • aria-labelledby is now evaluated when searching for elements
    • Search expression will now match all variants of single-quotes and double-quotes.

🐞 Fixes

  • I.deselect and I.deselected wasn't working

2.3.1

Released on 18 May 2018

💪 Enhancements:

  • (On-premise only) You can download debugging logs for test runs.

🐞 Fixes

  • Some XPATH expressions didn't work
  • SSL certificate checks on Firefox was not skipped
  • When jobs fail due to network errors, automatically retry the job.

2.3.0

Released on 8 May 2018

🚀 New Features

  • You can limit search scope by using UI.context or providing a context option in test commands.

2.2.0

Released on 22 Apr 2018

🚀 New Features

  • New commands to assert, accept, cancel, and fill alert/confirm/prompt dialogs.

🐞 Fixes

  • Unable to set timezone for job schedule sometimes.

2.1.13

Released on 13 Apr 2018

🚀 New Features

  • New command UI.execute to execute javascript on the browser.

2.1.12

Released on 12 Apr 2018

💪 Enhancements:

  • Improved design for configuring webhook notification

🐞 Fixes

  • Webhook notifications was triggering for every test run even when notification is set to send on errors only.
  • Unable to disable webhook notification when editing job.

2.1.11

Released on 05 Apr 2018

💪 Enhancements:

  • Advanced options for scheduling jobs (Pro plan only).

2.1.10

Released on 02 Apr 2018

🚀 New Features

  • You can use webhooks to get notifications about the status of your jobs on your own Slack / Telegram channels.

💪 Enhancements:

  • You can now download all the images of a test run from the Editor.

2.1.9

Released on 15 Mar 2018

🚀 New Features

  • You can now run tests on Microsoft Edge!

💪 Enhancements:

  • I.fill and I.click commands can now target elements by aria-label
  • You can now target input fields by their current value when using I.fill
  • Added XPATH support for I.fill
  • I.see and I.click now applies to the value and placeholder of textual input fields too
  • You can use I.type in place of I.press for keyboard inputs
  • Added I.pressTab command

2.1.8

Released on 12 Mar 2018

🐞 Fixes

  • Fix bug that prevented jobs from running.

Others:

  • Capped maximum run time of tests to 1 day. Tests running longer than that will time out. If you have tests running for such a long time, you should split them into smaller tests.
  • Improve performance of retrieving test run results.

2.1.7

Released on 9 Mar 2018

🐞 Fixes

  • Fixed bug that caused application to crash when polling for the status of pending jobs.

2.1.6

Released on 6 Mar 2018

🚀 New Features

🐞 Fixes

  • Fixed: Jobs being ran and crashing when their tests get moved or deleted.

2.1.5

Released on 20 Feb 2018

🚀 New Features

  • Added SAMPLE.id method for generating sample data for random base58 strings.

2.1.4

Released on 12 Feb 2018

🐞 Fixes

  • Fixed: Unable to retrieve job status sometimes.

2.1.3

Released on 11 Feb 2018

🐞 Fixes

  • Fixed: Cannot open "Create Project" dialog

2.1.2

Released on 6 Feb 2018

💪 Enhancements:

  • Friendly reminders to ask you to pay us for our work. 😉

2.1.1

Released on 27 Jan 2018

🐞 Fixes

  • Fixed: Editor tab - Test report window could not be resized

2.1.0

Released on 23 Jan 2018

🚀 New Features

  • You can now automatically pay us for our work. 😉

2.0.0

Released on 3 Jan 2018

🚀 New Features

  • Documentation Tab: Now you can view this documentation site with UI-licious Studio with your tests side-by-side

💪 Enhancements:

  • Internal changes to improve the performance of the application and test engine.
  • Prettier web reports for your scheduled tests.
  • You can specify the full path when creating or moving a file or folder. All intermediate folders to the destination path will be automatically created.

1.5.1

Released on 9 November 2017

💪 Enhancements:

  • Editor Tab:
    • Improved resolutions dropdown in Run pane - group resolutions by device class, and label resolutions by common screen size names
    • Display folder path in Script pane title bar
    • New tests/files/folders will be created as siblings to the currently selected test/file on the Directory pane.
    • When a folder is selected on the Directory pane, the Script pane will not navigate away to a blank page.

🐞 Fixes

  • Editor Tab:
    • Fixed: Script pane does not automatically display the new test after creation, when test is created by clicking on the "Create Test" button on the blank Script pane.
    • Fixed: Tests get overridden when the switching between tests while a test is being saved

1.5.0

Released on 11 October 2017

🚀 New Features

  • Scheduled tests: You can schedule tests to run automatically, and send email alerts when there's an error.

💪 Enhancements:

  • Reports now show you the total time taken for the entire tests.
  • Changes to the color scheme to improve contrast and visibility.

1.4.3

Released on 28 September 2017

  • Improved I.upload command to better handle hidden <input type=file> fields
  • Improved I.press command to support active elements within <iframe> and <frame> elements

1.4.2

Released on 9 September 2017

  • Improved CSS selector support for I.fill command

1.4.1

Released on 25 August 2017

  • Improved I.select command - Better identification of target element with option parameter alone
  • Improved support for testing within <frame> elements

1.4.0

Released on 21 August 2017

Breaking Changes

  • When I.click opens a page in a new tab, the browser will be automatically switched to it.
    • If you are using I.switchTab to switch tabs after I.click, you can remove I.switchTab, or (not recommended) add TEST.autoSwitchTab = false or TEST.autoSwitchTabOff() to the start of your test scripts to disable this behavior.

Highlights

  • You can set the max duration to attempt a command before raising an error with the TEST.commandTimeout setting.

New

New Commands:

  • Refresh a page: I.refreshPage
  • Scrolling a page: I.scrollBy, I.scrollTo, I.scrollToTop, I.scrollToBottom
  • ↑ ↑ ↓ ↓ ← → ← → B A
    Shortcuts to press arrow keys: I.pressUp, I.pressDown, I.pressLeft, I.pressRight

New Configurations:

  • You can set the max duration to attempt a command before raising an error with the TEST.commandTimeout setting.
  • You can enable / disable automatic screenshots taken during test runs with the TEST.autoScreenshot flag.
  • You can enable / disable automatic tab switching when new tab is open with the TEST.autoSwitchTab flag.

Enhancements

  • Condensed the project directory, so you can see more.
  • Asset optimizations to improve load time
  • Separate runner pane from script pane so that the runner pane doesn't reload as you switch between different scripts which can be annoying during test runs.

Fixes

  • Fixed: Layout of UI-licious Studio is broken on Safari.
  • Fixed: Error moving files to project root.

1.3.0

Released on 21 June 2017

  • Added support for testing Web Componentsopen in new window! Polymeropen in new window is now a supported framework. Woohoo!

  • Added I.grabTextopen in new window command to read a text from an element in a web page to use as an input variable for subsequent test commands:

    // example usage:
I.see("Thank you for ordering from UI-licious pizza. Your order number is"); // you have finished ordering pizza
var orderId = I.grabText("#orderId"); // read the text from the #orderId element on the webpage
I.goTo("/orders"); // go to your order history page
I.click(orderId);

  • Added CSS class selector and XPATH support for I.clickopen in new window command

    • It is recommended that you use these sparingly, because it would make your tests harder to maintain.

  • Fixed: I.press support on Firefox

  • Fixed: Studio briefly flashes when a project or a test loads.

1.2.0

Released on 03 May 2017

I.goTo("https://petstore.com/store");
I.goTo("/toys"); // this will navigate to https://petstore.com/store/toys
  • Powered up the I.fillopen in new window command. It's now better at identifying input fields. Now it handles non-semantic field labels.
  • Capture screenshots every second during I.waitopen in new window command. Now you can watch lolcats videos at 1FPS in UI-licious
  • Shortened the timeout when a command fails from 30 seconds to 15 seconds.
  • You can move files and folders.
  • Sort file and folders by name.
  • Folders can be collapsed/expanded to hide/show their contents. They will be collapsed by default.
  • More condensed report - so that you will have to scroll less while reading very long test run reports.
  • You are no longer allowed to enter the following characters in your project/folder/file names: / ? % * : | < > "
  • Fixed: Test report summary gets scrolled out of view when report is very long. We've fixed the position of the test report summary so that it doesn't happen.

1.1.0

Released on 28 Feb 2017

  • Test Engine
  • Studio
    • Support nested directory structure in project workspace
    • Support file upload
    • Improvements to test run preview:
      • Show summary when test run is complete
      • Show the latest screenshot while test is running in case of long running steps
      • Autoscroll to selected steps
      • Select steps using up/down arrow keys
    • Add mobile resolutions to test run configurations

1.0.0

Released on 8 Feb 2017

Command Line Interface

1.5.8

  • Automated patch version bump

1.5.7

  • Fixed : Exit an error process with an error code 1

1.5.6

  • Enhancement : simplifying overwrite param for import operation

1.5.5

  • Enhancement : Update version number and fix version command so that it grabs the version number from package.json

1.5.4

  • New Feature : Import image files into the workspace directory

1.2.12

  • Show summary of test run errors in test run report.

1.1.10

  • Fixed: Error running scripts in nested folders, e.g. /folder_a/folder_b/test_c

1.1.7

  • Add list command to list projects.

v1.0.6

  • Add run command to run a script.
Last Updated: