Platform Release Notes Release Notes

This release includes a number of small but meaningful improvements and bug fixes. While the team continues to work on major backend updates, this update focuses on performance optimisations and fixes that improve clarity and usability.

Performance Improvements

To improve platform performance and reduce unnecessary load, we have made the following changes:

• Feature flag: We no longer fetch data older than 30 days by default
• Long-running experiments: We have reduced how frequently data is updated for experiments running longer than 60 days

These changes help improve performance without impacting the accuracy or freshness of recent results.

Notable Bug Fixes

• Table sorting restored: Sorting on list tables has been re-enabled after being unintentionally removed in a previous release
• Improved clarity for GST experiments: To avoid confusion during interim analyses, the GST data switch is now disabled until the experiment is complete. Previously, we showed non-GST-adjusted data when no boundary had been crossed, which led to misinterpretation.
• Caching issues on the Activity tab fixed: We addressed some caching issues on the activity tab where data would not update until the page was refreshed.
• Add to favourites fixed: Resolved an issue where adding experiments to favourites did not always work.

Please let us know if you have any questions or feedback — and stay tuned for more significant changes coming soon!

This release includes a number of small but meaningful improvements and bug fixes. While the team continues to work on major backend updates, this update focuses on performance optimisations and fixes that improve clarity and usability.

Performance Improvements

To improve platform performance and reduce unnecessary load, we have made the following changes:

• Feature flag: We no longer fetch data older than 30 days by default
• Long-running experiments: We have reduced how frequently data is updated for experiments running longer than 60 days

These changes help improve performance without impacting the accuracy or freshness of recent results.

Notable Bug Fixes

• Table sorting restored: Sorting on list tables has been re-enabled after being unintentionally removed in a previous release
• Improved clarity for GST experiments: To avoid confusion during interim analyses, the GST data switch is now disabled until the experiment is complete. Previously, we showed non-GST-adjusted data when no boundary had been crossed, which led to misinterpretation.
• Caching issues on the Activity tab fixed: We addressed some caching issues on the activity tab where data would not update until the page was refreshed.
• Add to favourites fixed: Resolved an issue where adding experiments to favourites did not always work.

Please let us know if you have any questions or feedback — and stay tuned for more significant changes coming soon!

This release includes a number of small but meaningful improvements and bug fixes. While the team continues to work on major backend updates, this update focuses on performance optimisations and fixes that improve clarity and usability.

Performance Improvements

To improve platform performance and reduce unnecessary load, we have made the following changes:

• Feature flag: We no longer fetch data older than 30 days by default
• Long-running experiments: We have reduced how frequently data is updated for experiments running longer than 60 days

These changes help improve performance without impacting the accuracy or freshness of recent results.

Notable Bug Fixes

• Table sorting restored: Sorting on list tables has been re-enabled after being unintentionally removed in a previous release
• Improved clarity for GST experiments: To avoid confusion during interim analyses, the GST data switch is now disabled until the experiment is complete. Previously, we showed non-GST-adjusted data when no boundary had been crossed, which led to misinterpretation.
• Caching issues on the Activity tab fixed: We addressed some caching issues on the activity tab where data would not update until the page was refreshed.
• Add to favourites fixed: Resolved an issue where adding experiments to favourites did not always work.

Please let us know if you have any questions or feedback — and stay tuned for more significant changes coming soon!

This release includes a number of small but meaningful improvements and bug fixes. While the team continues to work on major backend updates, this update focuses on performance optimisations and fixes that improve clarity and usability.

Performance Improvements

To improve platform performance and reduce unnecessary load, we have made the following changes:

• Feature flag: We no longer fetch data older than 30 days by default
• Long-running experiments: We have reduced how frequently data is updated for experiments running longer than 60 days

These changes help improve performance without impacting the accuracy or freshness of recent results.

Notable Bug Fixes

• Table sorting restored: Sorting on list tables has been re‑enabled after being unintentionally removed in a previous release
• Improved clarity for GST experiments: To avoid confusion during interim analyses, the GST data switch is now disabled until the experiment is complete. Previously, we showed non-GST-adjusted data when no boundary had been crossed, which led to misinterpretation.
• Caching issues on the Activity tab fixed: We addressed some caching issues on the activity tab where data would not update until the page was refreshed.
• Add to favourites fixed: Resolved an issue where adding experiments to favourites did not always work.

Please let us know if you have any questions or feedback — and stay tuned for more significant changes coming soon!

This release brings several UX improvements and bug fixes aimed at making experimentation and collaboration smoother and more reliable. We’ve made owner management more flexible, improved graph interactions, and fixed key issues around estimations and data tables.

Improved Owner Filters and Flexibility

• An owner can now be a single user or a team.
• The Owner filter now accepts both users and teams when filtering, making results more inclusive.

Bug Fixes and Usability Improvements

• MDE and Max Runtime Automatic Estimation Refresh: Estimates now update automatically when the standard deviation changes. We have also improved estimation precision.
• Graph Zoom Behavior: Y-axis now updates correctly when zooming in, giving you a clearer view of trends.
• GST Estimate Accuracy: The next GST analysis estimate now correctly respects the minimum time between analyses.

Please let us know if you have any questions or feedback — we're always happy to hear from you.

This release introduces a brand-new notification system to help teams stay on top of what matters, along with the official launch of the improved Metrics Overview tab. These updates are designed to make your workflow more informed, timely, and collaborative.

New Feature: Built-In Notifications

Never miss a key event again. Our new built-in notification system ensures you're always up to date with what's happening on the platform.

• Team assignments: Get notified when you're added to or removed from a team
• Experiment/feature lifecycle updates: Get alerts when an experiment starts, stops, is put Full On, or when a feature is turned on/off.

More alert types will be added in upcoming releases — stay tuned!

New Feature: Impact per Day Estimates

We've added new Impact per Day estimates to all relevant metric types in the experiment overview to help you better understand the real-world significance of your experiment results. This gives you a clearer picture of the daily impact your changes could have when rolled out, making it easier to evaluate their practical value.

Metrics Overview Tab Out of Beta

Thanks to all your feedback, the new Metrics Overview tab is now officially out of beta.

• Cleaner layout and better tooltips and timestamps
• Consolidation of GST and Fixed Horizon experiment results in a single table
• Display Impact per Day for all relevant metrics
• More actionable information at a glance

These changes are designed to help you make faster, more informed decisions when reviewing experiment results.

Please let us know if you have any questions or would like to discuss future features with us.

Our latest release introduces new features to support better collaboration, data access, and metric/goal discoverability. With foundational Team Management features and a faster way to download experiment data, this update sets the stage for a more streamlined and scalable experimentation experience.

New Feature: Team Management (Foundations)

Teams are now much more than just metadata. You can properly define and manage teams within the platform. This update allows you to map your internal organisational structure directly into the product by:

• Creating and managing teams
• Assigning users to teams
• Structuring teams hierarchically (e.g. parent and child teams)

This is the first step toward upcoming improvements around ownership, permissions, and team-level collaboration. Go to Settings > Teams to get started with managing your team and inviting your team members. If you already have teams defined in ABsmartly, you can simply move them to the right place in your org structure. Check our wiki page for more information on creating and managing teams in ABsmartly.

New Feature: One-Click Experiment Data Export

We added an Export data button to the experiment overview page, allowing you to export participant exposures and goal event data for that experiment with a single click.

• No need to navigate through the events page or APIs
• Directly download all experiment-related data with a single click
• Makes it easier for teams to access raw data for custom analysis or deep dives

From the experiment overview page:

• Click on ... and select Export data.
• You will get a confirmation that the request is in progress. The process might take a while depending on the size of the experiment.
• You will get a notification on the experiment activity page once the export file is ready.
• The export file will be available for 30 days once it has been created. Only users with the "Events:List" permission can trigger the export and download the file.

Improved Metrics & Goals List Pages

Improve searchability and filtering (archived vs. unarchived)

• Improve searchability and filtering (archived vs unarchived)
• Help you quickly identify and select the metrics and goals that matter

Other Fixes & Improvements

This release also includes several smaller enhancements and bug fixes to improve overall platform stability and performance.

Feedback and Next Steps

As always, we value your feedback, so please share with us what you would like to see improve in the future.

This release focuses on backend improvements and foundational work to support future features. While there are few visible changes for you today, these updates improve platform stability and pave the way for upcoming capabilities. We still managed to squeeze a few improvements to the Velocity report and to the Experiment Dashboard redesign.

Velocity Report

• View the list of experiments: Our most‑requested Velocity Report enhancement: you can now click any chart in the Velocity Report to view the underlying experiments.
• Early stop vs Early full-on: The Experiments not completed graph now shows the breakdown between the early full-on and early stops.

Experiment Dashboard Redesign

Our new Experiment Dashboard redesign is still in progress and available for preview. The main goal is to consolidate how Fixed Horizon and Group Sequential experiments are shown and to make it easier for everyone to make quality decisions. In this release, we added GST data to the metrics table. Please have a look and let us know what you think.

• How to see it? Within the dashboard of any existing experiment you will have a 'Load new UI' button which will enable you to toggle between the old and the new view.
• What’s next? Give us your feedback below or send it to [email protected].

Feedback and Next Steps

As always we value your feedback so please share with us what you would like to see improve in the future. We have some really exciting new features coming your way in the next few releases so stay tuned.

In this release, we focused mainly on improvements to the Velocity and Decisions Report. All those improvements are driven by feedback we received from you, so keep them coming. Here are some of the most important updates.

Velocity Report

• Aggregate data per quarter: To help you run your quarterly experimentation reports we made it possible to aggregate the data per quarter (previously you could only aggregate per year, month or week).
• Aborted reasons report: We introduced a new Aborted Reasons report. This report breaks down all aborted experiments (experiments stopped early) by their aborted reason which is captured when the experiment is stopped. This new report will make it easier to understand bottlenecks and current issues in your experimentation program.
• Experiment completed: We fixed an issue where we were over-reporting the number of completed experiments.

Stay tuned: One of the main feature requests we received for the Velocity Report is to be able to open the list of experiments in each report. We are hoping to introduce this feature in one of our upcoming releases.

Decisions Report

Earlier this month we launched the new Decisions Reports (Beta). In this release we are introducing a few improvements to provide better insights into each decision.

• Secondary & Guardrail metrics: Like with the primary metric, you can now see the experiment results on the secondary and guardrail metrics. This helps understand the rationale behind each decision.
• Health checks: We are now surfacing any health check violations in the reports so you can get better insights into the quality of each decision.

Feedback & Next Steps

As always we value your feedback so please share with us what you would like to see improve in the future. We have some really exciting new features coming your way in the next few releases so stay tuned.

This release focuses mainly on our reports by improving the Velocity Report and launching the new Decisions Report. Both of those reports will help you get a better overview and track your experimentation program more effectively.

Velocity Report updates

In this release we focused on improving the Velocity Report which we launched in February. Thank you for all the great feedback you sent us (keep it coming), we tried to address as many of them as possible. Here are some key updates:

• Added Teams and Tags filters: Being able to report on specific teams and filter on tags was the main feedback we received.
• Improved Filters usability: We made it easier to select multiple values in the filters.
• Unique Experiments toggle: We replaced the old 'Show iterations' toggle with a new 'Unique Experiments' toggle.
• Not Completed widget: To make it clear that it includes early Full On as well as early stops, we renamed the Aborted widget to Not completed.

Beta Feature: Decisions Report

After the Velocity Report, we are also excited to launch the second part of our reports, the Decisions Report. While the Velocity Report focuses on the experiments you and your colleagues run, the Decisions Report focuses on the choices you make as a result of those experiments. Those decisions include Full On, Keep Current, and Abort. This report also includes a Decisions Timeline, which makes it easy to quickly browse through past decisions.

• How to enable it? If you have not enabled reports yet, your platform admin can turn on the beta version of 'Experiment reports' from the platform settings page.
• What's next? We are already working on some improvements but like with the Velocity Report we are very much looking forward to getting your feedback on this first release of the Decisions Report so we can make it right for you.

Experiment Dashboard redesign

We are working on a new improved version of one of the most important parts of the product, the Experiment Dashboard page (which we renamed the Experiment Overview page), and while we did not quite manage to finish it in time for this release we want to give you a preview of what we are doing so you can give us some early feedback. The main reason behind this redesign is to consolidate how Fixed Horizon and Group Sequential experiments are shown and to make it easier for everyone to make quality decisions.

• How to see it? Within the dashboard of any existing experiment you will have a 'Load new UI' alert which will enable you to toggle between the old and the new view.
• What's next? Give us your feedback below or send it to [email protected].

Feedback & Next Steps

We want to build the best possible experimentation platform for you, so if you have any thoughts on this release or other features, please let us know. In the next few weeks, we will start improving our Feature Flags capabilities. While we have a good idea of the problems to solve and features to deliver, we would love to hear your use cases. If you have particular needs or requirements, let us know and we can schedule time to chat.