Growthbook Release Notes

Release Highlights

Experiments

• Post-Stratification - uses dimensions to reduce variance and get to statistical significance faster.
• Result Filters - quickly narrow which metrics are visible by tag, group, or slice.
• Result Drilldowns - view additional info by clicking on any row in the results table
• Daily Participation Metrics - a new metric type that's analogous to Daily Active Users (DAU)
• Fact Table Filtering - more flexible filtering UI when defining metrics
• Query Performance - increased number of metrics that can be combined in a single SQL query, reducing warehouse costs.

Feature Flags

• Nested Saved Groups - more powerful and composable targeting logic
• Case Insensitive Targeting - match things like email addresses where case doesn't matter
• OR Targeting Conditions - build complex targeting rules without using advanced mode
• Feature Diagnostics - warehouse native tool to debug real world flag usage in your application
• New Rust and Roku SDKs - use GrowthBook inside performance critical back-ends and on millions of TVs
• Performance and UI Improvements - faster load times and snappier UX in the GrowthBook app when there are thousands of feature flags and large JSON values.

Other

• Fix broken browser back button on many pages in the app
• New API endpoints to manage experiment dashboards and custom fields
• New Project Admin role to make it easier to manage a large distributed team
• New Custom Hook option to only validate incremental changes
• Kerberos auth support for Trino/Presto
• Support additional AI models from Anthropic, Gemini, xAI, and Mistral
• Option to auto-update metric slice values
• UI improvements to data source page
• Incremental refresh bug fixes and improvements
• Product Analytics fixes and improvements
• Plus many other bug fixes and performance improvements
  Note: Internally, we migrated from yarn to pnpm. We included a small shim script for self-hosted users, so any Docker commands (e.g. yarn start) should continue working without modification unless you are doing something very custom and bespoke.

New Contributors

• @siarheipashkevich made their first contribution in #5008
• @vovapyc made their first contribution in #5050
• @hq6 made their first contribution in #5074
• @oelshaikh made their first contribution in #5031
• @fsarachu made their first contribution in #5166

Plus a ton of returning contributors:
@jdorn @ahdriel @royalfig @Kevin-Chant @mknowlton89 @lukesonnet @tzjames @madhuchavva @bryce-fitzsimons @msamper @itsgrimetime @august-growthbook @Hephaest @lukebrawleysmith @Auz @natasha-growthbook

Full Changelog: v4.2.0...v4.3.0

Original source

GrowthBook 4.3 Release: Run experiments with 20% more traffic using post-stratification, metric drilldowns for deeper insights, and feature evaluation diagnostics. Plus Rust & Roku SDKs.

At GrowthBook, we're focused on helping you learn faster and ship with confidence. GrowthBook 4.3 delivers on both fronts, with post-stratification to reach statistical significance sooner, metric drilldowns to understand results more deeply, and feature evaluation diagnostics to verify your flags are working correctly in production.

GrowthBook 4.3 is now available to all cloud and self-hosted users.

GrowthBook 4.3 Live Demo with Q&A
Faster Experiments, Deeper Insights

Experiment Analysis

Post-Stratification (Enterprise only)

Experiment analysis now supports post-stratification, a powerful variance reduction technique that produces more precise results.

Here's the idea: if you know revenue varies by country, post-stratification uses that information to isolate the treatment effect from between-group noise. The result is tighter confidence intervals from your existing traffic. In the right conditions, CUPED + post-stratification can be equivalent to running your experiment with 20%+ more traffic!

Configure post-stratification at the organization level under Settings → General, or override it at the metric or experiment level. To enable it, you'll need to have pre-computed dimensions configured in your experiment assignment query.

Post-stratification is available to Enterprise customers. CUPED (without post-stratification) is available to Pro and Enterprise customers.

Experiment Metric Drilldowns (All editions)

Understanding experiment results just got a lot easier. Click any metric row to open a Metric Drilldown, a focused view with everything you need to interpret that metric without jumping between pages:

• The Overview tab shows metric details, time series, and a results table with analysis controls.
• The Slices tab lets you see how your metric breaks down across different values.
• The Debug tab reveals how CUPED, post-stratification, capping, and priors are affecting your numbers.

Metric slices are an Enterprise feature. See Metric Slices for configuration details.

Experiment Result Filters (All editions)

Experiments with dozens or hundreds of metrics can be overwhelming to review. You can now filter results by tag, slice, or metric group to focus on what matters.

Once you find a view you like, use Add to Dashboard to save it for later and share with your team. We also cleaned up the results UI to reduce clutter and keep the focus on your data.

Daily Participation Metrics (All editions)

We added a brand new metric type: Daily Participation. For each user, this measures the fraction of days they were active while enrolled in the experiment (active days ÷ days exposed), then averages that value across users in each variation.

Think of it as DAU normalized per user and exposure window, but more stable for experiments than raw daily active user counts.

This is a really valuable metric for any website or app that is trying to grow daily usage.

Better Fact Table Filters (All editions)

Metrics are built on Fact Tables, and often you only need a subset of rows. This release adds a powerful filtering UI to define exactly which rows to include, without writing SQL.

Feature Flags

Feature Evaluation Diagnostics (All editions)

When a flag isn't behaving as expected, debugging can be frustrating: you're left guessing whether the issue is in your targeting rules, SDK configuration, or something else entirely.

Feature evaluation diagnostics solves this by querying SDK evaluation events stored in your data warehouse. See exactly what evaluated in production, not just what the rules say should happen. Troubleshoot targeting conditions, rollouts, and experiment rules with real data instead of guesswork.

Nested Saved Groups (All editions)

Saved Groups now support nesting, letting you define groups in terms of other groups. Build complex targeting logic while keeping base definitions centralized and reusable.

For example, combine "Beta Users" AND "Enterprise Plan" to create "Beta Enterprise Users." Update the base group, and nested groups update automatically.

This makes it faster and easier to create targeting rules for feature flags.

Case-Insensitive Regex Targeting (All editions)

New targeting options for case-insensitive regex and "in list" matches—useful for matching email addresses and other values where case shouldn't matter.

Available now in the latest JavaScript, React, Node, and Python SDKs. More SDKs coming soon.

Rust and Roku SDKs (All editions)

We're excited to announce two new official SDKs: Rust and Roku.

Rust is the language of choice for modern performance-critical applications. Special shout out to the community, who authored the initial version of this SDK.

GrowthBook, now on your TV? That’s right, the next time you watch your favorite show, GrowthBook might be working behind the scenes with the launch of our official Roku SDK, a leading smart TV platform that powers millions of streaming devices and TVs worldwide.

With these additions, GrowthBook now offers 23 SDKs spanning client-side, server-side, mobile, and edge.

Quality-of-Life Improvements

Big thanks to all of our users who reported bugs, shared feedback, and contributed ideas to this release on GitHub or Slack.

Many small improvements add up to a big boost in usability:

• Improved query performance for fact metrics
• Cleaner experiment results UI with fewer distractions
• OR targeting conditions
• Updated SDK support
• New API endpoints to manage experiment dashboards and custom fields
• New Project Admin role to make it easier to manage a large distributed team
• New Custom Hook option to only validate incremental changes
• Kerberos auth support for Trino/Presto
• Option to auto-update metric slice values
• Support for additional AI models from Anthropic, Mistral, xAI, and Gemini

Plus dozens of smaller fixes and performance improvements.

Join our webinar on February 19 at 10:00 AM PT for a live demo of 4.3 features and a Q&A session.

Original source

Release Highlights

Product Analytics (preview)

Turn your warehouse data and metrics into actionable product insights. Explore user behavior, share dashboards, and make smarter decisions about what to build next. This release is just the beginning and we have much more planned for Product Analytics in the coming months.

Metric Slices

Automatically break down metrics into key “slices”. This can drastically reduce the number of metrics you need to create and can help organize experiment results. For example, if you have an Orders fact table, you can enable “Auto Slices” on the product_category and device_type columns. Now, when you add a Revenue metric to an experiment, it will also include breakdowns for each of these, so you can easily compare mobile vs desktop revenue or revenue from different product categories. You no longer need to maintain 10+ separate metrics that are all slight variants of each other!

Incremental Refresh

We revamped our Data Pipeline Mode to drastically reduce data warehouse costs and increase query speeds for long-running experiments and high-traffic apps. We do this by storing intermediate results back into the data warehouse and incrementally refreshing it throughout the experiment. We’re starting with BigQuery, where we’ve seen some users save up to 85% in query costs.

Statsig Importer and Code Migration Tool

OpenAI recently acquired Statsig and the future of the platform is uncertain. Everyone is asking “will Statsig shut down?” We built an importer and migration tool so teams can be ready to switch to GrowthBook on a moment’s notice. Our Importer lets you instantly copy over all feature gates, dynamic configs, segments, and more. Our Code Migration tool (built on Claude Code) can seamlessly migrate your app from using the Statsig SDK to the GrowthBook SDK.

Official Metrics

Many companies have a core set of metrics that have been validated and battle tested over time. GrowthBook lets you mark these metrics as “Official”, which gives them a special badge in the UI, elevates them in the app, and locks down editing. We’ve had Official metrics for a while, but they had to be managed entirely through the API. In this release, we now let admins manage these metrics directly from the UI, making them more accessible and easy to use.

Custom Validation Hooks

GrowthBook has always been extremely customizable, but this release brings it to a new level. Self-hosted users can now write fully custom javascript code snippets that hook into our validation logic. Require feature flags to have tags, block targeting rules that contain PII, enforce custom naming conventions - the possibilities are endless. The validation code runs in a sandbox based on V8 isolates for ultimate security and performance. We only have a couple hooks to start, but we’d love to hear your ideas and use cases for additional ones!

New SQL Template Variables

You can now access custom field values and phase data within your metric and experiment SQL! This unlocks 3 important use cases:

1. Add highly custom query optimization by taking advantage of non-date partition keys.
2. Re-use the same SQL definitions when only minor tweaks are needed per-experiment.
3. More accurately join experiment exposure events to experiment phases.

Edge Remote Eval

Remote Eval lets client-side SDKs offload feature flag evaluation to a back-end server, which prevents leaking targeting logic to your users. Previously, this required running your own GrowthBook Proxy servers (and dealing with all of the associated infrastructure and maintenance). We now offer a simpler option based on Cloudflare Workers. Deploy a blazing fast and cheap Remote Eval server on Cloudflare’s global infrastructure with zero maintenance required.

Quality-of-Life Improvements

Big thanks to all of our users who reported bugs, provided feedback, and worked with us to make GrowthBook better. This release includes many quality-of-life improvements that, while small on their own, add up to make a big impact. Here are a few highlights:

• Brand new search algorithm for features, metrics, and experiments. Results are now much more relevant and search is faster overall, even when there are thousands of potential matches.
• Ability to create feature rules in multiple environments at once
• Better column-type detection for Fact Tables when using BigQuery
• You can now add metric row filters based on boolean columns in your Fact Tables
• We stopped sending feature.updated webhooks for unpublished draft changes (reducing noise).
• Slack and Discord notifications now include more details about the change in GrowthBook that triggered the notification.
• Custom Pre-launch experiment checklist items can now be scoped to specific projects.
• Much faster database schema browser when there are hundreds or thousands of tables
• New settings option to disallow creating legacy metrics. This can help ease the transition to using fact tables. There is more planned here so stay tuned!
• The experiment results table is now sortable, so you can quickly see the best (or worst) performing metrics based on either significance or lift.
• Complete revamp of the included sample data and experiments to better showcase the GrowthBook platform and all that it can do.
• Plus dozens of bug fixes and smaller improvements.

New Contributors

• @kosmoz made their first contribution in #4011
• @aalfalah made their first contribution in #4520

Plus a ton of returning contributors:
@ahdriel @gazzdingo @mknowlton89 @bryce-fitzsimons @Kevin-Chant @madhuchavva @royalfig @kosmoz @tzjames @lukesonnet @aalfalah @msamper @Auz @jdorn @nodirnasirov @Bohdan-Kim @lukebrawleysmith @natasha-growthbook

Full Changelog: v4.1.0...v4.2.0

Original source

GrowthBook 4.2 release

GrowthBook 4.2 introduces Product Analytics (beta), a Statsig migration kit, and enterprise-scale enhancements. One platform for features, experiments, and analytics.

At GrowthBook, our mission is to provide the insights you need to build better products that grow your business faster. With GrowthBook 4.2, we’ve added a beta version of GrowthBook Product Analytics. Now our users will have a single integrated platform for feature management, experimentation, and product analytics.

In addition, we’ve continued to enhance the developer experience, making experimentation at scale and integration into any stack easier than ever. Finally, for companies seeking an alternative to Statsig, our Statsig to GrowthBook Migration Kit automates importing feature gates and dynamic configs while replacing Statsig SDKs with GrowthBook SDKs.

Release 4.2 is available immediately to both our cloud and self-hosted users. Visit our Pricing page for details about Starter, Pro, and Enterprise options.

Join us for a GrowthBook 4.2 Live Demo with Q&A
Thursday, December 4 at 10AM PT / 1PM ET

GrowthBook Product Analytics (Beta)

Adding Product Analytics to the GrowthBook platform closes the loop for development. Now, you can go from feature management to experimentation to product analytics in a single tool. While in beta, Product Analytics will be available to all users.
Turn your warehouse data and metrics into actionable product insights. Explore user behavior, share dashboards, and make smarter decisions about what to build next. With Product Analytics, you will be able to:

• Build and share dashboards that combine graphs, pivot tables, and text
• Create custom charts and tables from any data in your warehouse
• Use GrowthBook SQL Explorer with our AI-powered text-to-SQL capabilities to query, aggregate, and group data
• Access any metric defined in GrowthBook and track its performance over time

This Product Analytics beta provides a glimpse of what’s to come as GrowthBook develops more self-service tools for building, analyzing, and exploring all of your product data. Let us know what you think in our Slack community!

Statsig to GrowthBook Migration Kit

With the OpenAI acquisition of Statsig, we saw a spike in interest in GrowthBook. Product teams looking for alternatives expressed concern about what would happen to their data. Others worried that the product might be discontinued or deprioritized. To make the transition from the acquired platform to an open-source alternative as effortless as possible, we created the Statsig to GrowthBook Migration Kit, free for all users.

• Statsig Importer instantly copies over feature gates, dynamic configs, and segments.
• Statsig Code Migration Tool (powered by Claude Code) automatically replaces Statsig SDKs with GrowthBook SDKs.

Enterprise Enhancements

The 4.2 features below continue our investment in the developer experience that makes GrowthBook a top choice for product development teams with high volume apps and advanced experimentation programs.

Metric Slices: Simplify Experiment Design

When users create experiments, they often want to look at a number of metrics across common dimensions like product categories or device types. This can lead to the need to manage a number of metrics. Metric slices solves this problem. Enable auto slices on a Fact Metric once, and GrowthBook automatically generates drill-down analyses for each dimension value across all experiments using that metric.

Instead of creating separate “Orders” metrics for each product category or device type, you can enable Auto Slices on those columns with a single metric which means fewer redundant metrics, faster setup, and cleaner reporting.

Incremental Refresh

We revamped our Data Pipeline Mode to lower query costs and improve performance for long-running experiments and high-traffic apps. By storing intermediate results and incrementally refreshing them, we’ve seen users save up to 85% in query costs. This first version is available on BigQuery, Presto, and Trino. We’ll be adding support for more data warehouses based on customer demand.

Official Metrics

Many organizations rely on a trusted set of “official” metrics. GrowthBook now makes these easier to manage by letting admins mark and edit official metrics directly from the UI (previously API-only). This helps standardize measurement, reduce confusion, and promote consistency across teams.

New SQL Template Variables

You can now access custom field values and phase data directly in your metric and experiment SQL, unlocking several use cases:

• Fine-tuned query optimization using non-date partition keys
• Reuse of SQL definitions with minor tweaks per experiment
• More accurate joins between experiment exposure and phase data

Custom Validation Hooks

GrowthBook has always been flexible — and now it’s even more so. Self-hosted enterprise users can write custom JavaScript validation hooks that run in secure V8 isolates. Use them to:

• Require tags on feature flags
• Prevent targeting rules containing PII
• Enforce naming conventions or internal policies
  These hooks let teams automate governance without slowing down development.

Edge Remote Eval

Edge Remote Eval lets client-side SDKs offload feature flag evaluation to a backend server, preventing targeting logic from leaking to users. Previously, this required managing your own GrowthBook proxy servers. Now, you can deploy a Cloudflare Workers–based Remote Eval server — a fast, low-cost, zero-maintenance alternative built on Cloudflare’s global infrastructure.

Quality-of-Life Improvements

Big thanks to all of our users who reported bugs, shared feedback, and contributed ideas to this release on GitHub or Slack.
Many small improvements add up to a big boost in usability:

• Faster and more relevant search algorithm for features, metrics, and experiments
• Create feature rules in multiple environments at once
• Better column-type detection for BigQuery Fact Tables
• Add metric row filters based on Boolean columns
• Reduced webhook noise (no more notifications for unpublished drafts)
• Slack and Discord notifications now include more detailed change info
• Custom pre-launch checklist items can be scoped to specific projects
• Faster database schema browsing, even with hundreds of tables
• New setting to disable legacy metrics for smoother transition to Fact Tables
• Sortable experiment results tables — quickly see top or bottom performers
  Plus dozens of smaller fixes and performance improvements.

2025: A Year of Rapid Innovation

The 4.2 release is GrowthBook’s sixth major update in 2025, capping off what has easily been the biggest year of innovation in our company’s history. GrowthBook launched over 45 new features across four major themes in 2025:

• Experimentation at Scale: New metrics, templates, dashboards, and analytics
• Feature Management: Safe rollouts and feature analytics
• Artificial Intelligence: A new MCP server and embedded AI capabilities
• Developer Experience: Managed data warehouse, native Vercel integration, 13 updated SDKs, enhanced server-side rendering, and support for new CMSs and FerretDB

Whether you’re on the Starter plan ready for more advanced experimentation and analytics or a Pro user building a culture of experimentation, we’re ready to help you grow. We’re excited to see what you build — and how you use these new tools to learn faster.

Live Demo with Q&A

Thursday, December 4 at 10AM PT / 1PM ET
Register Now

Original source

GrowthBook version 4.1 includes Holdouts, Dashboards, AI features, and More!

This release continues the momentum of GrowthBook 4.0 by adding two of our most requested Enterprise features - Holdouts and Experiment Dashboards. Plus, we’ve made several significant enhancements to our integrations with AI coding tools and our MCP server capabilities. If you’re not yet using GrowthBook with your AI coding tools, we highly recommend it!

Read on to learn more about these features and everything else we’ve been working on these past 2 months.

Holdouts

Holdout experiments measure the long-term impact of features by maintaining a control group that doesn't receive new functionality. While most users experience your latest features and improvements, a small percentage remains on the original version, providing a baseline to measure cumulative effects over time. Read more about holdouts.

Experiment Dashboards

Experiment Dashboards let you create tailored views of an experiment. Highlight key insights, add context, and share a clear story with your team. For example, highlight the key goal metric results, show an interesting dimension breakdown, and link to supporting external documents, all in a single view. Dashboards are available for all Enterprise customers. We have a lot planned for this in the future, so stay tuned!

AI Features

This release deeply integrates AI to help accelerate your workflows within GrowthBook. Auto-summarize experiment results, get help writing SQL, improve hypotheses, detect similar past experiments, and more. These features are available even if you’re self-hosted, just supply an OpenAI API key. See the AI features in action or read detailed information on how these features work.

MCP Updates

We've updated our MCP Server to allow creating experiments directly from your AI coding tool of choice without needing to context switch to GrowthBook. This change unlocks a bunch of new, exciting workflows, and we can't wait to see how you use it!

Vercel Native Integration

We're excited to announce that GrowthBook is now available as a native integration in the Experimentation category on the Vercel Marketplace! This integration makes it easier than ever to add feature flagging and A/B testing to your Vercel projects, with streamlined setup, unified billing, and ultra-low latency performance. Read more on our announcement post.

Pre-computed Dimensions

You can now pick a set of key experiment dimensions and pre-compute them along with the main experiment results. This allows for more efficient database queries and instant dimension breakdowns in the UI. Read more in our docs.

FerretDB Support

FerretDB is a MongoDB-compatible database that is open source and free to use. It serves as a drop-in replacement for MongoDB, converting MongoDB wire protocol queries to SQL and using PostgreSQL as its backend storage engine. We're pleased to support FerretDB officially!

Sanity CMS Integration

Sanity is a real-time content backend for all your text and assets. You can now use GrowthBook feature flags to seamlessly test different content variations within Sanity. Check out our announcement video and tutorial or our docs.

The 4.1 release includes over 150 commits, way more than we can quickly summarize here. View the release details on GitHub for a more comprehensive list. As always, we love feedback - good and bad. Let us know what you think of the new features and what you want to see as part of 4.2!

Original source

Release Highlights

Holdouts

Holdout experiments measure the long-term impact of features by maintaining a control group that doesn't receive new functionality. While most users experience your latest features and improvements, a small percentage remains on the original version, providing a baseline to measure cumulative effects over time.

Experiment Dashboards

Experiment Dashboards let you create tailored views of an experiment. Highlight key insights, add context, and share a clear story with your team. Dashboards are available for all Enterprise customers. We have a lot planned for this in the future, so stay tuned!

Vercel Native Integration

We're excited to announce that GrowthBook is now available as a native integration in the Experimentation category on the Vercel Marketplace! This integration makes it easier than ever to add feature flagging and A/B testing to your Vercel projects, with streamlined setup, unified billing, and ultra-low latency performance.

AI Features

This release deeply integrates AI to help accelerate your workflows within GrowthBook. Auto-summarize experiment results, get help writing SQL, improve hypotheses, and detect similar past experiments, and more. These features are available to everyone, even self-hosted (just supply an OpenAI key).

Pre-computed Dimensions

You can now pick a set of key experiment dimensions and pre-compute them along with the main experiment results. This allows for more efficient database queries, and instant dimension breakdowns in the UI.

FerretDB Support

FerretDB is a MongoDB-compatible database that is open source and free to use. It serves as a drop-in replacement for MongoDB, converting MongoDB wire protocol queries to SQL and using PostgreSQL as its backend storage engine.

Sanity CMS Integration

Sanity is a real-time content backend for all your text and assets. You can now use GrowthBook feature flags to seamlessly test different content variations within Sanity.

MCP Updates

We've updated our MCP Server to allow creating experiments directly from your AI tool of choice without needing to context switch to GrowthBook. This change unlocks a bunch of new exciting workflows and we can't wait to see how you use it!

New Experiment Results Tooltip

We've completely redesigned the tooltip when mousing over experiment results. The new design provides more context and insights at a glance, making it easier to understand the impact of your experiments.

SQL Auto-Complete

We've added context-aware SQL auto-complete suggestions for table and column names to help you write queries faster and with fewer errors.

Official Segments and Dimensions

You can now mark specific segments and user dimensions as Official via the GrowthBook API. This will give them a little badge in the UI and lock down editing to prevent unwanted changes. Use this to differentiate important segments and dimensions from ad-hoc or exploratory ones.

Self-Hosting Improvements

For anyone self-hosting GrowthBook, we've greatly improved observability and customization. We now support full monitoring and tracing of all background jobs, plus distributed tracing within the Python stats engine. We also added a number of new env vars to more easily split the GrowthBook monolith into microservices for those that need extra scalability.

SDK Updates

• React - Full React 19 Typescript support
• Golang - SSE streaming fixes
• PHP - sticky bucketing fixes
• Java - new caching and refresh options, memory optimizations
• Flutter - many bug fixes and updates
• C sharp - SSE streaming, attribute targeting fixes
• Swift - sticky bucket fixes, support for bearer auth, logging improvements, and memory optimization
• Kotlin - async-safe sticky bucketing, new streamingHost setting, suspend entry points to avoid blocking
• Flutter - TTL-based fetch option, cache improvements, attribute targeting fixes
• Edge - many new options for advanced integrations

REST API Updates

• New GET /settings endpoint to fetch all of your organization's current settings
• Fix PUT /metric/:id endpoint that was ignoring the archived setting
• New GET /feature/:id/revisions endpoint to fetch all revisions for a specific feature with pagination
• New endpoints to create, update, and delete dimensions and segments
• Ability to archive fact tables and fact metrics
  Plus a lot more
• New is:watched filter on experiment search
• Enable encryption option for back-end SDKs
• Add user-agent header to all HTTP requests (webhooks, etc.)
• Various date and timezone fixes
• Various SQL editing and schema browser fixes
• Properly close MySQL connections
• Ability to remove LIMIT 5 when testing SQL queries
• Use Webhook Secrets by default for new webhooks
• ClickHouse - add support for new JSON data types
• Wrap user-supplied SQL in parentheses to avoid edge cases
• Fix divide-by-zero bug in stats engine
• Jira integration update to support a custom field
• Fix stale feature detection logic
• New Big Number visualization type in the SQL Explorer
• Enable the schema browser for self-hosted orgs that use config.yml
• Improve fact metric query performance by filtering rows earlier
• Fix broken SRM check when one variation has 0 users
• Fix bugs with quantile and percentile capped metric settings
• Audit log entries now show the full date time instead of "X days ago"
• Power calculator fixes
• Allow manual seed selection for feature rollout rules
• Skip feature.updated webhooks until draft changes are actually published
• Improve handling of unit quantiles when "ignore zero" is set
• Persist last viewed tab on the experiment list

New Contributors

• @nodirnasirov made their first contribution in #4296
• @kweic made their first contribution in #4315
• @denisov-vlad made their first contribution in #4351
• @Khrol made their first contribution in #4339
• @benruehl made their first contribution in #4254

Plus a ton of returning contributors:
@jdorn @royalfig @tzjames @ahdriel @mknowlton89 @madhuchavva @bryce-fitzsimons @natasha-growthbook @Auz @lukesonnet @Kevin-Chant @lukebrawleysmith @Hephaest @gazzdingo @ari-party @msamper @itsgrimetime

Full Changelog: v4.0.0...v4.1.0

Original source

GrowthBook 4.0 includes a huge number of new features and updates. Continue reading for a full list of changes.

We shipped so many new features in our June Launch Month that we decided that it deserved a major version increase. Version 4.0 brings a huge array of new features. Here’s a quick summary of everything it includes.

GrowthBook MCP Server

AI tools like Cursor can now interact with GrowthBook via our new MCP server. Create feature flags, check the status of running experiments, clean up stale code, and more.

Safer Rollouts

Building upon our Safe Rollouts release last version, we added gradual traffic ramp up, auto rollback, a smart update schedule, and a time series view of results. All of these combine to add even more safety around your feature releases.

Decision Criteria

You can now customize the shipping recommendation logic for experiments. Choose from a “Clear Signals” model, a “Do No Harm” model, or define your own from scratch.

Search Filters

We’ve revamped the search experience within GrowthBook to make it easier to find feature flags, metrics, and experiments. Easily filter by project, owner, tag, type, and more.

Insights Section

We added a brand new left nav section called “Insights” with a bunch of tools to help you learn from your past experiments.

• The Dashboard shows velocity, win rate, and scaled metric impact by project.
• Learnings is a searchable knowledge base of all of your completed experiments.
• The Experiment Timeline shows when experiments were running and how they overlapped with each other.
• Metric Effects lists the experiments that had the biggest impact on a specific metric.
• Metric Correlations let you see how two metrics move in relation to each other.

SQL Explorer

We launched a lightweight SQL console and BI tool to explore and visualize your data directly within GrowthBook, without needing to switch to another platform like Looker.

Managed Warehouse

GrowthBook Cloud now offers a fully managed ClickHouse database that is deeply integrated with the product. It’s the fastest way to start collecting data and running experiments on GrowthBook. You still get raw SQL access and all the benefits of a warehouse native product, without the setup and maintenance cost.

Feature Flag Usage

See analytics about how your feature flags are being evaluated in your app in real time. This is built on top of the new Managed Warehouse on GrowthBook Cloud and is a game changer for debugging and QA.

Vercel Flags SDK

GrowthBook now has an official provider for the Vercel Flags SDK. This is now the easiest way to add server-side feature flags to any Next.js project. We have an even deeper Vercel integration coming soon to make this experience even more seamless.

Official Framer Plugin

You can now easily run GrowthBook experiments inside of your Framer projects. Assign visitors to different versions of your design (like layouts, headlines, or calls to action), track results, and confidently choose the best experience for your audience.

Personalized Landing Page

There’s a new landing page when you first log into GrowthBook. Quickly see any features or experiments that need your attention, pick up where you left off, and learn about advanced GrowthBook functionality to get the most out of the platform.

New Experimentation Left Nav

There’s a new “Experimentation” section in the left nav. Experiments and Bandits now live within this section, along with our Power Calculator, Experiment Templates, and Namespaces. We’ll be expanding this section soon with Holdouts and more, so stay tuned!

REST API Updates

• Filter the listFeatures endpoint by clientKey
• Support partial rule updates in the putFeature endpoint
• New Queries endpoint to retrieve raw SQL queries and results from an experiment
• Added Custom Field support to feature and experiment endpoints
• New endpoints for getting feature code refs
• New endpoint to revert a feature to a specific revision

Performance Improvements

We’ve drastically improved the CPU and memory usage when self-hosting GrowthBook at scale. On GrowthBook Cloud, we’ve seen a roughly 50% reduction during peak load, leading to lower latency and virtually eliminating container failures in production.

Original source

Release Highlights

GrowthBook MCP Server

AI tools like Cursor can now interact with GrowthBook via our new MCP server. Create feature flags, check the status of running experiments, clean up stale code, and more.

Safer Rollouts

Building upon our Safe Rollouts release last version, we added gradual traffic ramp up, auto rollback, a smart update schedule, and a time series view of results. All of these combine to add even more safety around your feature releases.

Decision Criteria

You can now customize the shipping recommendation logic for experiments. Choose from a “Clear Signals” model, a “Do No Harm” model, or define your own from scratch.

Search Filters

We’ve revamped the search experience within GrowthBook to make it easier to find feature flags, metrics, and experiments. Easily filter by project, owner, tag, type, and more.

Insights Section

We added a brand new left nav section called “Insights” with a bunch of tools to help you learn from your past experiments.

• The Dashboard shows velocity, win rate, and scaled metric impact by project.
• Learnings is a searchable knowledge base of all of your completed experiments.
• The Experiment Timeline shows when experiments were running and how they overlapped with each other.
• Metric Effects lists the experiments that had the biggest impact on a specific metric.
• Metric Correlations let you see how two metrics move in relation to each other.

SQL Explorer

We launched a lightweight SQL console and BI tool to explore and visualize your data directly within GrowthBook, without needing to switch to another platform like Looker.

Managed Warehouse

GrowthBook Cloud now offers a fully managed ClickHouse database that is deeply integrated with the product. It’s the fastest way to start collecting data and running experiments on GrowthBook. You still get raw SQL access and all the benefits of a warehouse native product, without the setup and maintenance cost.

Feature Flag Usage

See analytics about how your feature flags are being evaluated in your app in real time. This is built on top of the new Managed Warehouse on GrowthBook Cloud and is a game changer for debugging and QA.

Vercel Flags SDK

GrowthBook now has an official provider for the Vercel Flags SDK. This is now the easiest way to add server-side feature flags to any Next.js project. We have an even deeper Vercel integration coming soon to make this experience even more seamless.

Official Framer Plugin

You can now easily run GrowthBook experiments inside of your Framer projects. Assign visitors to different versions of your design (like layouts, headlines, or calls to action), track results, and confidently choose the best experience for your audience.

Personalized Landing Page

There’s a new landing page when you first log into GrowthBook. Quickly see any features or experiments that need your attention, pick up where you left off, and learn about advanced GrowthBook functionality to get the most out of the platform.

Experimentation Left Nav

There’s a new “Experimentation” section in the left nav. Experiments and Bandits now live within this section, along with our Power Calculator, Experiment Templates, and Namespaces. We’ll be expanding this section soon with Holdouts and more, so stay tuned!

REST API Updates

• Filter the listFeatures endpoint by clientKey
• Support partial rule updates in the putFeature endpoint
• New Queries endpoint to retrieve raw SQL queries and results from an experiment
• Added Custom Field support to feature and experiment endpoints
• New endpoints for getting feature code refs
• New endpoint to revert a feature to a specific revision

Performance Improvements

We’ve drastically improved the CPU and memory usage when self-hosting GrowthBook at scale. On GrowthBook Cloud, we’ve seen a roughly 50% reduction during peak load, leading to lower latency and virtually eliminating container failures in production.

New Contributors

• @paigeruppel-upstart made their first contribution in #3992

• @jrnold made their first contribution in #4056

• @devcodes9 made their first contribution in #4109

• @kabam-blambert made their first contribution in #4070

• @matttenenbaum-qz made their first contribution in #4172

• @edisonmoy made their first contribution in #4266

• Plus a ton of returning contributors:
  @ahdriel @gazzdingo @Auz @lukesonnet @tzjames @mknowlton89 @lukebrawleysmith @jdorn @romain-growthbook @natasha-growthbook @Kevin-Chant @royalfig @august-growthbook @msamper @bryce-fitzsimons

Full Changelog: v3.6.0...v4.0.0

Original source

Managed Warehouse

This week we're launching our Managed Warehouse and Feature Flag Usage Analytics.

Launch month continues with our Managed Warehouse product and feature flag usage analytics.

We’ve talked to thousands of companies and have seen our fair share of data warehouse and event tracking setups. We’ve noticed 3 consistent problems:

• 1. They are a LOT of work to set up and maintain, especially for companies without dedicated data engineers. Google Analytics + BigQuery is the most common one we see and that takes over 40 steps to configure (yes, we counted).
• 1. Data is often refreshed on a schedule instead of in real-time. You don’t want to wait 24 hours to find out a new feature or experiment is killing your metrics.
• 1. Pricing and performance are optimized for batch workloads. Refreshing experiment results frequently or exploring your data can become slow and costly.

This week, we’re excited to launch our new Managed Warehouse product on GrowthBook Cloud. We set out to solve all of these issues and we’re super happy with the results:

• 1. One-click setup and zero maintenance. Doesn’t get much easier than that!
• 1. Data arrives within seconds, letting you quickly detect issues.
• 1. Queries are crazy fast and free (only pay for ingesting the data, not querying it)

Under the hood, this is powered by ClickHouse, an open source database optimized for fast analytics at scale. You still get raw SQL access and all the other benefits of a true Warehouse Native platform, just without the cost.
The first 2 million tracked events each month are free for Pro users and we have super affordable usage-based pricing beyond that.

Feature Usage Analytics

This week we’re also launching Feature Usage Analytics, which was built to take advantage of many of the benefits of the new Managed Warehouse.
For each feature flag, you can see how often it's been evaluated, which values are being served, which rules are being hit, and more. This is a game changer for feature flag management and makes debugging issues so much faster. As an extra benefit, this also helps you stay on top of tech debt by highlighting stale flags that are no longer being used.
So how does it work? The GrowthBook SDK sends an event to the Managed Warehouse every time a feature flag is evaluated in your app. This usage data is then aggregated and displayed within seconds.
For now, this is only available for the new Managed Warehouse on GrowthBook Cloud, but we want to eventually open this up to everyone. If you are interested in this, but are self-hosting (or already have a data warehouse), let us know and we can keep you in the loop!

Original source

For week 3 of our Launch Month, we're releasing SQL Explorer, which lets you query your data and visualize results.

For week 3 of our Launch Month, we’re excited to announce the SQL Explorer!

At GrowthBook, we love dogfooding our product (most of our launches this month started behind feature flags). Along the way, we kept running into a common frustration: answering simple data questions meant jumping into separate tools like Looker, Mode, or Tableau - just to write some quick SQL or generate a basic chart.

All of that context switching adds up, which is why we built SQL Explorer - a lightweight, built-in SQL editor that lets you query your data, create visualizations, and save results right inside of GrowthBook. It's perfect for quick analyses without the overhead of a full BI platform. Check it out and let us know what you think.

We’ll be adding more features and integrating the SQL Explorer more deeply in the product in the coming weeks, so keep an eye out!

Original source

This week we're launching Insights, which includes a new Executive Dashboard, searchable experiment learnings, timeline visualizations, and deep metric analysis.

This week is all about Insights, the brand new section in our sidebar. In there, you’ll find a revamped Executive Dashboard, new Learnings and Timeline pages, plus some powerful metric analyses to help you get the most out of your experimentation program. This section becomes more useful the more experiments you run, so if you needed an excuse to run more tests this is it!

Executive Dashboard

The brand new dashboard gives you a 10,000 foot view of your organization’s experimentation program. Quickly see your team’s velocity, win rate, and impact. Enterprise users can also select a metric and see the cumulative effect from all the experiments that were run. Everything can be filtered by project and date range.

Learnings

The Learnings page is a searchable knowledge base of every experiment your team has completed. For each experiment, see the winning variation, a summary of results, and other key details. This page is a great place for new team members to learn about what has been tried and what has and hasn’t worked.

Fun fact: This was the original reason we started GrowthBook and how we got our name. We envisioned a digital book of everything you’ve learned about growth.

Experiment Timeline

The Timeline page lets you visualize when experiments were running in relation to each other. Experiments are color-coded by status (running, won, lost, etc.) and split up by phases. This is a valuable tool for managing your experimentation workflow, identifying bottlenecks in your process, and planning future tests.

Metric Effects

Do a deep-dive for a given metric and see the range of effect sizes from all the experiments that included it. Use this to learn how easy/hard it is to move your metric in general and see which specific experiments had the biggest impact (both good and bad).

Metric Correlations

See how any 2 metrics tend to move in relation to each other within experiments. This is especially useful for identifying proxy metrics that are highly correlated with your long term goals, but can get you results much faster.

We hope you find these new pages useful and we look forward to hearing your feedback. See you again soon for our Week 3 launches!

Original source

This June is our Launch Month! Every week, we’ll announce major new features and changes to GrowthBook that you can try out early, before the final release at the end of the month.

We have so many exciting projects we’re working on, we decided to do something a little different for this next release. June will be our official Launch Month! Every week we’ll announce major new features and changes to GrowthBook that you can try out early, before the final release at the end of the month.

Let’s kick things off with the Week 1 launches:

GrowthBook MCP Server

We launched the first ever MCP server for feature flagging and experimentation! MCP (Model Context Protocol) allows AI tools to communicate and do actions directly with services like GrowthBook. Now you can use AI to create feature flags, check experiment results, clean up stale code, and more, directly within your IDE. Read our announcement blog post for more info and a demo.

Even Safer Rollouts

We made three big changes to Safe Rollouts to make them even safer:

• 1. Traffic now gradually ramps up from 10% to 100%
• 1. Results are checked more frequently at the start of a Safe Rollout (and less frequently the longer it’s running)
• 1. There’s a new setting to automatically roll back if any guardrails are failing or the data looks unhealthy

When combined, these changes help make your rollouts even safer by minimizing the user impact when things go wrong. As always, you can learn more about this in our docs.

Custom Decision Criteria

You can now customize the logic that powers our Experiment Decision Framework on a per-experiment basis.

• Clear Signals (the default) - Ship only with clear goal metric successes and no guardrail failures.
• Do No Harm - Ship so long as no guardrails and no goal metrics are failing. Useful if the costs of shipping are very low.
• Custom - Define your own fully custom decision criteria logic using our intuitive UI.

Check out our docs for more information.

Search Filters

We’ve revamped the search experience within GrowthBook to make it easier to find feature flags and metrics. Easily filter by project, owner, tag, type, and more. The best part is that all of your filters are encoded in the URL, so once you find a view you like you can easily get back to it or share it with your team. We’ll be rolling this out to other parts of the app soon.

Original source

This release includes an exciting new feature flag rule, a long-awaited addition to experiment results, an integration sure to make PMs happy, and a lot more! Keep reading for details.

Safe Rollouts

Introducing our newest type of feature flag rule—Safe Rollouts!

Safe Rollouts let you gradually release a feature while monitoring guardrail metrics for regressions. It’s designed to be simple to use, so there’s no reason not to wrap it around every bit of code you release. In fact, we used Safe Rollouts to release Safe Rollouts in GrowthBook Cloud just this week. So meta!

Under the hood, Safe Rollouts uses sequential testing and one-sided confidence intervals to continuously monitor guardrail metrics and quickly detect harmful changes, without inflating the false positive rate.

We couldn’t wait to get this into your hands and hear your feedback, so this initial release is intentionally minimal. Don’t worry though, we have a lot planned for the near future: automated ramp ups (10% → 25% → 50% → 100%), time series view of results, deep dives, and more. Stay tuned!

Time Series

We’ve added one of our most requested features to experiment results: a Time Series view for metrics! Now you can expand any metric and see how it has changed throughout the lifetime of the experiment. The best part? We were able to add this without any additional (and expensive) SQL queries against your data warehouse, so it all comes for free.

Official Jira Integration

We just launched our first official Jira integration! You can now install the GrowthBook app from the Atlassian Marketplace and easily link a feature or experiment to any Jira issue. See key details and up-to-date statuses directly in Jira without needing to switch contexts.

Check out the Jira Integration docs to learn more and get started.

Decision Framework Events and API

In the previous release, we launched the Experiment Decision Framework to give you recommendations in the UI about when an experiment is ready to stop and what decision you should make (ship or rollback). In this release, we extended this info to both the REST API and Webhooks. That means you can get an alert in Slack whenever an experiment is ready to call or build your own custom workflows around these events.

Dev Tools for SSR

Our GrowthBook Dev Tools browser extension has always been a great way to debug and QA feature flags, but it was limited to client-side applications only. We’re excited to finally bring the same developer experience to the back-end, starting with Server-Side Rendered (SSR) Javascript applications. All it requires is a few small changes to your back-end GrowthBook implementation.

So how does it work? When you override a feature flag, experiment, or attribute in Dev Tools, we persist it in a cookie. This is sent to the back-end and applied locally before processing the request. Then, debug logs from the back-end SDK are injected into the rendered HTML and picked up by Dev Tools.

Fact Table JSON Columns

It’s common to have a single shared “Events” table in your data warehouse where everything from page views to purchases are logged together. While a JSON blob column is a convenient way to store meta info about each event, it also makes it harder to query and use as part of metric definitions.

Fact Tables in GrowthBook now have native support for JSON columns. When creating metrics, you can easily reference nested fields in row filters and even use them as metric values. No more writing custom SQL filters and trying to remember the syntax.

Fun fact: Every single database engine decided to come up with their own syntax for querying JSON data, so we had to reimplement this feature 10+ different times.

👉 Find the full release notes on GitHub.

Original source

Highlights

• Safe Rollouts by @msamper @lukebrawleysmith @gazzdingo @lukesonnet @ahdriel in #3556 and many more
• Time Series on Experiment Results by @ahdriel @lukesonnet in #3779 and many more
• Official Jira Integration by @Kevin-Chant in #3944 #3956 #4012
• Dev Tools for Back-end by @bryce-fitzsimons in #3911 #3958
• Decision Framework Notifications by @lukesonnet in #3762 #3909
• Fact Table JSON Columns by @jdorn in #3768

Other Changes

• JS/React SDK version 1.5.0 by @bryce-fitzsimons @jdorn in #4009
• Add metric overrides to reports and bandits by @lukesonnet in #3764 #3875
• Added Microsoft Clarity Heatmap integration guide by @Auz in #3782
• Make metrics links on overview page by @lukesonnet in #3797
• Enable duplicating metrics from details page by @Kevin-Chant in #3999
• Remove hypothesis check from bandit pre-launch checklist by @lukesonnet in #3796
• [api] Add user filter to fact metric API and add validation by @lukesonnet in #3798
• Add prerequisite targeting as auto checklist item by @lukesonnet in #3811
• REST API: add "withRevisions" option to getFeature endpoint by @bryce-fitzsimons in #3808
• Allow creation of Experiments with no DataSource specified via API by @ahdriel in #3819
• Allow editing variation metadata for running experiments by @lukesonnet in #3832
• Only show reweighted events for bandit SRM graph by @lukesonnet in #3834
• Add heartbeat update when starting query execution by @Kevin-Chant in #3771 #3881
• Enrich metrics with project names for project search by @lukesonnet in #3853
• Expose more fields in the various REST API experiment endpoints by @bryce-fitzsimons in #3861 #3864
• Add detail to make changes usage by @lukesonnet in #3866
• Adding more classes to facilitate science work data processing by @lukebrawleysmith in #3546
• adding 'RegressionAdjustedRatioStatistics' to gbstats by @lukebrawleysmith in #3885
• Rework bandit SRM to run in SQL by @lukesonnet in #3845
• Render abs. differences in proportion metrics with pp notation by @lukesonnet in #3891
• Add number field for rollouts (allow fractional percentages) by @bryce-fitzsimons in #3901
• Decision Criteria model and creator by @lukesonnet in #3847
• Update how we calculate readAccess for Metric Groups by @mknowlton89 in #3905
• Move visual editor / redirect paywall to publish step by @jdorn in #3898
• Add decision criteria data to getExperiment api endpoint by @Kevin-Chant in #3945
• Give old portals priority over radix portals by @bryce-fitzsimons in #3954
• show feature dependent warnings by @bryce-fitzsimons in #3964
• Ensure p-value adjustment applied to analysisSummary by @lukesonnet in #3972
• Auto closes pre launch checklist when complete by @mknowlton89 in #3975
• [stats] changing condition for theta == 0 to theta < 1e-8 by @lukebrawleysmith in #3795
• Advanced feature discoverability by @mknowlton89 in #3951 #3969 #3920
• Bug Fixes
  • Fix: Hide exp data if exp doesn't have enough data by @mknowlton89 in #3744
  • Fix: Prevent metrics without a data source from being used as North Stars by @jdorn in #3763
  • CUPED ratio bug fixes by @lukebrawleysmith in #3767
  • UI Updates by @Kevin-Chant @lukesonnet in #3897 #3773
  • Force auto-updates for bandits by @lukesonnet in #3807
  • Fix next update status by @lukesonnet in #3786
  • Fix notification text bug for multiple exposures by @lukesonnet in #3831
  • fixing bug in degrees of freedom for bandits srm by @lukebrawleysmith in #3826
  • Fix difference type in reports by @lukesonnet in #3854
  • fix(BaseModel): Ensure index exists before dropping by @ahdriel in #3868
  • Fix date in Health Tab graph being always interpreted as UTC by @ahdriel in #3872
  • experiment overview: fix attribute targeting wrapping by @bryce-fitzsimons in #3877
  • Fix live sql preview to show >= exposure timestamp by @lukesonnet in #3890
  • Fix: Add metrics in metric groups to override by @lukesonnet in #3983
  • Fix: ignore CR character for group csv import by @bryce-fitzsimons in #3985
  • Fix redirect checkbox state for nodejs sdk connections by @bryce-fitzsimons in #3948

Docs and Misc

• Linking tooltip for risk thresholds being violated to docs by @lukebrawleysmith in #3746
• Add percentile language to quantile docs by @lukesonnet in #3789
• Lint Some Docs by @alai97 in #3800
• Various doc updates by @natasha-growthbook @august-growthbook @royalfig in #3840 #3842 #3957 #3818 #3784 #3793 #3940 #3980
• Performance improvements by @jdorn in #3932 #3930
• Add new Query Optimization docs and updates to "View Docs" link by @jdorn in #3805
• Remove duplicated word "the" in docs/guide/nextjs-app-router.mdx by @DanieleGrizzi in #3939
• Dependency and Security Updates by @ahdriel @Auz @jdorn @bryce-fitzsimons in #3836 #3827 #3839 #3812 #3791 #3855 #3912 #3998
• Performance and Observability improvements by @romain-growthbook in #3863 and many more
• Billig updates for GrowthBook Cloud by @mknowlton89 @tzjames and others
• Update latest SDK versions and docs by @madhuchavva @royalfig @ahdriel in #3904 #3962 #3803 #3820 #3828 #3833 #3857

New Contributors

• @alai97 made their first contribution in #3800
• @choshsh made their first contribution in #3803
• @DanieleGrizzi made their first contribution in #3939

Full Changelog

v3.5.0...v3.6.0

Original source

Highlights

• New Dev Tools Browser Extension by @Kevin-Chant @bryce-fitzsimons @gazzdingo in #3618 #3739 #3696
• Experiment Decision Framework by @ahdriel @lukebrawleysmith in #3540 #3683 #3557
• Power Calculator by @lukesonnet in #3695 #3638 #3564
• CUPED for Ratio Metrics by @lukebrawleysmith in #3649 #3698 #3727
• Major JS, Go, Java, Python, C# SDK Updates by @madhuchavva @mkurkov in #3566 #3635 #3688

Bug Fixes

• Fix bandit periods for funnel metrics by @lukesonnet in #3667
• Fix next update status by @lukesonnet in #3786
• Fix notification text bug for multiple exposures by @lukesonnet in #3831
• Fix difference type in reports by @lukesonnet in #3854
• Fix live sql preview to show >= exposure timestamp by @lukesonnet in #3890
• Fix: Add metrics in metric groups to override by @lukesonnet in #3983

Docs and Misc

• Various doc updates by @lukesonnet @royalfig and others

Full Changelog

• v3.4.0...v3.5.0

Original source