Release Notes

v2.28.0

Jul 28, 2025

New Features and Changes:

• Upgrade Postgres to v16.9.
• Updated CLI to trigger a job set.
• Changed unzip/untar to use unbuffered IO.
• Documented YAML parameters for Agent, Job Package, and DIPs.
• WebApp now hosts the output adapters.

v2.27.0

Jul 8, 2025

New Features and Changes:

• Improved consistency of the user experience and addressed several UI related bugs.
• Fixed issue where job package name disappears from existing jobs when package is deleted.
• Fixed broken job throughput metrics in Lab View.
• Fixed issue in project dashboard where data from all projects would be presented if no build/release filter is present.
• Added Google and Yahoo OAuth signin.
• Added buttons to allow viewing and/or downloading an artifact file from the job details page.
• Fixed a bug that prevented updating the agent when used in 3rd party environments.
• Fixed a bug in the agent where its PID file was not properly guarded and could lead to multiple agents running together on the same host.

v2.26.0

May 16, 2025

New Features and Changes:

• Added initialize and finalize hooks to DIP.
• Increased max size limit to 5GB on uploaded objects.
• Fixed bug in device view which improperly hyperlinked hosts to devices page.

v2.25.0

Apr 22, 2025

New Features and Changes:

• Added new scheduling metaphore called "Job Sets" that are similar to Workflows but allows users to assign Jobs to target DUTs or pools.
• Added configurable upload folders that can be periodically uploaded during run time.
• Added environment configurations to Job Packages.
• Updated timeout values in web UI to be displayed in hours/minutes/seconds instead of just total seconds.
• Fixed broken Raspberry PI and Linux SSH DIP packages.
• Fixed incorrect command line parsing by the Agent.
• Fixed a panic in Download Manager that could occur under certain network conditions.
• Fixed table searches in Web UI to search on all columns.

v2.24.0

Mar 13, 2025

New Features and Changes:

• Added Pie Charts to test and workflow result details pages.
• Added warnings when selecting device pools with no online devices.
• Added environment variable editor to Run a Test wizard.
• Added UI to display number of online devices in Run a Test wizard.
• Added horizontal scrolling in matrix views.
• Added build events to Releases/Builds page.
• Fixed a bug where canceled jobs may continue running.
• Fixed formatting problems in Audit viewer.
• Fixed a bug where Agent would panic if PID file was corrupted.
• Fixed a bug where canceled jobs did not display the time they were canceled.

v2.23.0

Feb 20, 2025

New Features and Changes:

• Added state metrics to Agent page.
• New Agent and CLI installations now use MQTT over WebSockets by default.
• Reinstallation of existing agent will automatically stop previous agent if it is running.
• Demo projects now have more mock data to demonstrate capabilities.
• Moved artifacts list from Job description to a tab in the Test Results section of the Job Details pages.
• Agent now supports uploading entire directories of files.
• Agent can now break large artifact files into smaller pieces before upload.

Bug Fixes:

• Reintroduced tooltips in minimized sidebar menu.
• Fixed z-ordering bug in dialogs and sidebar.
• Fixed disappearing dialog that prevented users from installing the CLI or getting new keys.
• Fixed a bug where the upload modal dialog did not dismiss itself after successful uploads.
• Fixed a bug where refreshing Job Packages page resulted in a 404.

v2.22.0

Jan 24, 2025

New Features and Changes:

• Display device metrics with test results for the given test results over the same span of time.
• Ability to auto discover Android devices and add new devices to the "Auto Discover" pool.
• Ability to filter results using parameters: Device_Under_Test, Build, Station and Date/Time range.
• Ability to generate comprehensive views at different levels.
• Added crash statistics.
• Added memory and CPU utilization on device and raise alarm past a threshold.
• Provided alarm notifications for any setup-related issues.
• Provided health checks for the overall setup.
• Provided a dashboard to display the execution status and results for each Device_Under_Test.
• Improved Dashboard for Test Reports.

Bug Fixes:

• Fixed several links in Labs & Devices root page that did not link to the appropriate locations.
• Fixed installation leaves behind intermediate tar file.
• Fixed Agent repeatedly stopping and restarting.
• Fixed Agent updates in wrong folder.
• Fixed Agent is unkillable after device config update.

v2.21.0

Dec 3, 2024

New Features and Changes:

• Improved Test Results report:
  • Added ability to show individual test cases.
  • Each cell in the table now links to the job(s) for that result (including missing results.)
  • Added ability to filter rows that have “no jobs”.
  • Optimized the test result aggregation and queries.
  • Fixed and issue where no results in the project would cause the Test Results page to raise an error.
• Improved Host Agent debug logging.
• Improved auto-refresh for static pages and reduced refresh frequency.
• Project Dashboard now default to most recently created release & build.

Bug Fixes:

• Fixed an issue where cancelled workflows continued to track elapsed time instead of showing cancelled time.
• Fixed an issue where recursive entry into details page results in runtime error.

v2.20.0

Nov 12, 2024

New Features and Changes:

• Overhauled the UI to provide a more consistent and streamlined user experience.
• Fixed an issue where the service would periodically run out of database connections leading to problems with agent authentication with the backend broker.
• Fixed an issue where invited team members were not able to join a team due to email capitalization mismatch.

v2.19.0

Oct 14, 2024

New Features and Changes:

• Added audit log and viewer.
• Services now sends a "Welcome" email after signup.
• Improved appearance invitation email.
• Fixed various issues surrounding deployment into sites that are not in the LabScale domain.
• Fixed race conditions that can occur on initial signup and team creation that can cause confusion for new users.

v2.18.0

Sep 24, 2024

New Features and Changes:

• Added agent log viewer accessible from agent details page.
• Added ability to define environment variables for a lab, accessible by all jobs that run on devices in the lab.
• Added various security improvements and patches.

v2.17.0

Aug 26, 2024

New Features and Changes:

• Updated subscription plans and added subscription management.
• Updated lab stats to separate out agents and hosts.
• Device monitoring data now have a retention period of 30 days.

Bug Fixes:

• Fixed lab stats not counting devices properly.
• Fixed job package list doesn't auto refresh when adding a new package.
• Fixed broken agent link in device details page.
• Fixed broken lab link in agent/host/device details page.
• Fixed unable to delete various data objects, delete should as expected across the board unless noted.

v2.16.0

Jul 3, 2024

New Features and Changes:

• New Custom Metrics admin interface for adding and managing custom metrics definitions.
• Added Custom Metrics section to device details page to show plots for custom metrics.
• Removed legacy (non-OTEL) device metrics collection and related tables.

v2.15.0

Jun 10, 2024

New Features:

• New Agent management UI: Agents are now separated from Hosts and can be installed on Hosts or Devices.
• Improved Host handling: Hosts are now optional and can be used as a job target similar to Devices.
• New DIP management improvements:
  • Separated DIPs from Device Types: DIPs are now managed separately in their own section and Device Types are mapped to DIPs. This makes it easier for multiple Device Types to re-use the same DIP and to avoid naming conflicts.
  • DIPs can now be configured to download from a remote URL instead of requiring the package to be uploaded.
  • All LabScale managed/sample DIPs have been moved to our central files server and corresponding DIP entries have been updated to link to them remotely. All future updates to these DIPs will be automatic as they are pulled from our central location.
  • All example DIPs have been updated and renamed to more appropriately reflect the protocols being used.
  • Added new Linux Host, MacOS Host, and Linux Device over SSH DIPs and Device Types.
  • Added new Virtual Linux Device and Virtual MacOS Device that re-uses the corresponding host DIPs.
• New Device/Host metrics format (OTEL) and ability to handle user-defined metrics from get-metrics DIP API.

v2.14.0

May 17, 2024

New Features:

• Support for self-hosted deployment for users that would like host LabScale in their own infrastructure
• Support for OAuth/OIDC SSO integration
• Jobs can produce artifacts that will be uploaded and downloadable from job details
• Slack notification integration are now configured using user created webhooks, multiple Slack integrations are now supported
• Added device status notification
• Devices can now be set as Out of Service status to pause scheduler and monitoring of the device
• Test results now support additional metadata: start/stop time, duration, and location
• Added option for job packages to treat timeout as success

v2.13.0

May 01, 2024

New Features:

• Automatic agent token rotation every 45-90 days
• Automatic cleanup of expired or unused agent tokens
• Team subscription license management

Bug Fixes:

• Fixed device config changes were not sent to agent immediately
• Fixed retry handling on download expiration
• Fixed scheduling edge case that can cause duplicate jobs

v2.12.0

Apr 08, 2024

New Features:

• Added Device Type filter to test results and performance results reports
• Added ability to set different performance baselines for each Device Type
• Agent log capture and push to backend for remote debugging
• New backend service for capturing/managing agent and service logs
• Updated latest events formatting and added agent/device events
• Added optional launch scripts to run Agent as a service for Ubuntu and MacOS

Bug Fixes:

• Fixed agent/device status still shows online even if agent is stopped
• Fixed counting workflow steps and jobs
• Fixed DIP error not showing for device
• Fixed workflow job scheduling order
• Fixed various agent bugs

v2.11.0

Mar 08, 2024

New Features:

• Added Agent version and additional event data logging to debug host/device/DIP issues
• Jobs in pending state will expire automatically after 7 days
• CLI command to upload job packages
• Improved performance results charts

Bug Fixes:

• Fixed missing certains host/device events
• Inconsistent table sorting for devices and hosts
• Various small UI bugs

v2.10.0

Feb 09, 2024

New Features:

• Improved agent update mechanism
• Added latest events and release summary to home dashboard

Bug Fixes:

• Fixed not using UTC in all places in backend

v2.9.0

Jan 14, 2024

New Features:

• Added baselines to performace visualization
• Ability to download performance data file of a job
• Ability to filter performance results by workflow
• Added performance test writing how-to guide

v2.8.0

Jan 05, 2024

New Features:

• New Agent v2.0.0.214
• Open Telemetry Metrics JSONL file format added as a supported performance test result type
• Added performance reporting and visualization to UI
• Added NVIDIA Jetson DIP
• Optimized auth service
• Fixed issue where agentctl would start agent but exit with an error about not starting the agent
• Rewrote agentctl in Go
• Added Linux and Android Basic Acceptence Test (BAT) examples
• Added performance test suite example

v2.7.0

Dec 05, 2024

New Features:

• New Agent v2.0.0.206
• Added RTOS sample DIP
• Created new Labscale CLI for triggering Workflows and monitoring status
• Fixed issue where changing a device type in UI was not properly updated by the agent

v2.6.0

Nov 10, 2023

New Features:

• Can now delete Slack notification
• Obscure user data in log files

Bug Fixes:

• Fixed not able to set "Is Test Suite" to false
• Application error when editing a trigger
• Download manager crash on invalid cache
• Custom device type config not loading/updating

v2.5.0

Oct 27, 2023

New Features:

• New Agent v2.0.0.189
• New Agent CLI installer and simplified the Agent installation process
• Sample DIP for Android
• Slack notification integration

v2.4.0

Oct 11, 2023

New Features:

• New Agent v2.0.0.175
• Host and Device System Metrics collection and monitoring
• Improved Executive Summary to include more drill-down reporting
• Add running jobs to Job Throughput Metrics

Bug Fixes

• Fixed not able to re-assign pool for a device
• Fixed not able to add a device without assigning a pool

v2.3.0

Sep 21, 2023

New Features:

• New Agent v2.0.0.153
• Lab dashboard
• Option to target all devices when running a workflow

v2.2.0

Sep 08, 2023

New Features:

• Workflow management and execution
• Automated Trigger management
• Build event publishing

v2.1.0

Aug 24, 2023

New Features:

• Add custom Device Types and DIP upload
• Upload custom Job Packages / Test Suites

v2.0.0

Aug 12, 2023

New Features:

• New Agent v1.0.0.102 - automatic updates, log rotation, improved stability
• New UI with improved usability
• Free trial signup