Optimizely Web Experimentation Review
Updated November 06, 2025
Optimizely Web Experimentation Review
Score 10 out of 10
Vetted Review
Verified User
Overall Satisfaction with Optimizely Web Experimentation
We do a lot of data analysis on our e-commerce journeys and one of our biggest, I guess, goals is conversion rate. So we use Optimizely Web to understand the insight that we're getting through either focus groups or other experiments, whether we should roll out a particular change or whether we should add additional information. And whether that basically enhances the journey enough to give us a better conversion uplift.
Pros
- I think the best aspect of it is because I also manage a team that builds agent experiments, which are a little more complicated. They involve a lot of complex logic and conditions and really focuses in on certain audiences. So when we look at web experiments, the best benefits are getting things off the ground within a matter of minutes. Whereas agent experiments, there's a lot of background build involved with web experiments, we can have an idea, we can build it in web and it can be launched the same day. So it really helps us get to answers faster and make those decisions faster and then lead to other ideas for things we can do on other parts of the website.
Cons
- I think because I work with both types of experiments, web and agent experiments, the sort of drawbacks come with web that it's the audience logic. Sometimes we have to identify specific customers that we want to target with the change. And a lot of it is probably down to our infrastructure on the site. It's not giving Optimizely the right level of data to target these customers. But I think, yeah, if we had a little bit more understanding of how we could get to that data through optimizing web, that would be useful for us.
- I can't probably speak to exact numbers because we're not really allowed to share, but it's in the millions we see conversion rate uplift and obviously that is our main metric. But also in terms of experiments we've done to try to increase our POO, we've seen definite success in being able to use web to validate some of our hypotheses. And like I said, the win rate is so strong that there is no, I guess question on the turn on investment.
We tend to take analysis out of Optimizely, so I would say we're not probably using the analysis tools that we should be using and maybe I need to look into that, but a lot of it is down to looking at the top level results and then interrogating that through the heat maps that we see through Content Square and the different, I guess, sort of funnel visit rates through Adobe. And yeah, we probably don't utilize it to its full abilities.
Do you think Optimizely Web Experimentation delivers good value for the price?
Yes
Are you happy with Optimizely Web Experimentation's feature set?
Yes
Did Optimizely Web Experimentation live up to sales and marketing promises?
Yes
Did implementation of Optimizely Web Experimentation go as expected?
Yes
Would you buy Optimizely Web Experimentation again?
Yes
Optimizely Web Experimentation Feature Ratings
Using Optimizely Web Experimentation
| Pros | Cons |
|---|---|
Like to use Relatively simple Easy to use Well integrated Consistent Quick to learn Feel confident using | Lots to learn |
- Traffic Allocation
- Confirmation of set up
Comments
Please log in to join the conversation