Changelog

October 2020

New features

  • New media files for WebRTC testing - We have updated our built-in media files for simulating microphone and webcam inputs. Now all of them are running at 30 FPS with specific common audio files and frame markers that aid quality assessment.

  • Access to location for your tests - We added access to location for tests created in Loadero, now you can test websites that require location access.

Fixes and improvements

  • Added support for Mozilla Firefox 81/82 and Google Chrome 85/86 browsers.

  • We have refactored project API access - it is simpler to add authorization for the requests you make to Loadero now. We also added an API endpoint for reading all classificator values at once, which will simplify the development of your tests if you are using Loadero API.

August 2020

New features

  • Machine graphs - you can now inspect results for each individual test participant to see their machine resource usage over time.

  • Optional API parameters - When creating or modifying participant information, it is no longer necessary to provide location, network and media type values in the request, they will always be initialized to defaults (for location Oregon region will be used as the default).

  • Adjustable script modal - now you can see more of the script in a single view.

Fixes and improvements

  • Added support for Mozilla Firefox 80 and Google Chrome 85 browsers.

  • Performance and stability improvements for Loadero API. This should result in improved app loading times as well as API response times.

  • We completed a major refactoring of Loadero backend infrastructure meaning that we will be able to deliver new awesome features to you even faster!

  • Updated setRequestHeader() and setUserAgent() custom commands so that you can modify User-Agent header value using any of the two commands.

  • Minor fixes as well as performance improvements for the Loadero web application.

July 2020

New features

  • Export WebRTC charts images - now you can export each WebRTC chart as a PNG image so you can integrate them in your reports more easily.

  • A new custom command to change any HTTP request header - override any HTTP header value for the requests your service makes using setRequestHeader() function! This enables testing of different functionality that could only be tested when a custom header value is present. Read more about this command here for JavaScript and here for Java.

  • New API endpoints - allow you to read test run results without specifying the test ID in the request path- only project ID is mandatory. Check out our API documentation to find out technical details about the new endpoints.

  • New script variables - a unique identifier of the participant across all tests ever launched in Loadero (run participant ID) as well as a sequential number of the participant within the scope of the test (participant global ID). Read more about these two variables in our wiki for JavaScript and Java.

  • WebRTC internals dump in load tests - more data from your load tests including automatic post-run assertions for WebRTC metrics.

Fixes and improvements

  • Added support for Mozilla Firefox 78 and 79 as well as Google Chrome 84 browsers.

  • Various bug fixes and performance improvements.

June 2020

New features

  • Audio recording - allows recording full audio from a participant session.

  • Fully customized network conditions - we have added configuration options and functions that allow you to update only a specific parameter of the current network conditions, such as bitrate. Read more in our wiki about how to do that using JavaScript + Nightwatch and Java + TestUI.

  • Additional filtering options - added more filtering options for Machine Statistics overview in test results. While charts for these statistics are coming in the future, additional filtering options allow you to get a better overview of the resources used during the test.

Fixes and improvements

  • We added support for Mozilla Firefox 77 browser

  • We have been working on multiple internal systems to reduce the time needed to notice and resolve different issues that can come up. With all these systems in place, we are able to monitor service status with much higher precision and are able to react to events faster than ever before.

May 2020

New features

  • Additional aggregators for machine statistics - machine statistics now can be analyzed in more detail filtering by new categories (StdDev, Relative StdDev, 25%, 50%, 75%, 95%, 99%).

Fixes and improvements

  • Added support for Mozilla Firefox 76 and Google Chrome 83 browser.

  • Fixed timing issue for linear increment strategy where some participants would start the test execution at the same time.

  • Improved media stream quality at the start of the test – media streams are at their top quality from the very beginning of test execution.

  • Fixed typo in one of our constant names: “asymmetric network”. We’ve stopped supporting the version with the typo and made sure the existing tests keep running even if you had been using it.

  • Fixed an issue when sometimes WebRTC statistics would not get recorded.

  • General performance updates for Loadero web application.

April 2020

New features

  • waitForDownloadFinished() - a new custom command for "Javascript + Nightwatch" and "Java + TestUI" languages. This command will be helpful when downloading files in tests to ensure that the download has finished before the test exits.

  • Multiple downloads in Google Chrome - we’ve updated the options for the Google Chrome browser so that it now allows multiple downloads from the same page.

  • New media files - There are 3 new media types. These media types all have 1080p video feed with markers for visual verification of media quality. Each of the media types has an audio feed with different sound levels: -20dB, -30dB and -50dB.

Fixes and improvements

  • We added support for Mozilla Firefox 75 and Google Chrome 81 browsers.

  • We’ve done improvements to Loadero’s test queue by improving the processing of aborted tests that were still in the queue. This means that the waiting time for the test execution to start has gotten even shorter!

  • Fixed an issue where WebRTC dump sometimes would not be available.

  • Fixed a problem that media type assert preconditions would not be evaluated.

  • Fixed an issue where double quotes in test name would cause the test to crash.

March 2020

New features

  • New wiki - we’ve updated our documentation site! Check it out as you will definitely find something that is helpful to you. If you notice anything missing or unusual, don’t hesitate to let us know!

  • Multiple parallel tests - we have completed a major upgrade of the test run scheduling mechanism, now you can run tens or even hundreds of tests in parallel. This update applies to all test modes and, of course, to tests launched on custom AWS accounts.

  • Assert preconditions - we have added assert preconditions to our web application! Head to loadero.com to add preconditions to your existing asserts!

  • Resource ID - added resource ID subheader in our web app. This will help you to start using our API – just copy and paste ID where resource ID is needed.

Fixes and improvements

  • Improved reliability of session record test mode for short tests – sometimes the recording was not stored.

  • Fixes and improvements for app loading screens, now when fetching data for logs and WebRTC statistics you will see a progress bar of how much of your data has been downloaded so far.

  • We added support for Mozilla Firefox 74 browser. Due to the current global situation, Google has decided to postpone the release of Google Chrome 81 browser hence new Google Chrome releases in Loadero will be postponed as well.