Difficult to navigate documentation, overloaded and overcomplicated for our use cases
May 05, 2023

Difficult to navigate documentation, overloaded and overcomplicated for our use cases

Anonymous | TrustRadius Reviewer
Score 5 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Web Experimentation

We are using Optimizely Feature Experimentation to help us with A/B testing new changes. We have used it for layout tests to test if user conversion is increased by changes and we have also used it for new features to see if general user engagement with the website increases.

Pros

  • Testing new layouts for conversion
  • Testing new features for user interaction
  • Tracking user engagement

Cons

  • Better documentation. It's very fragmented and hard to navigate.
  • More opinionated API. Multiple ways to get the same functionality, but with various degrees of documentation. For example, do you activate an experiment or do you use the user decision?
  • More examples for common patterns would be nice. For example, generation and storage of a user ID in a cookie.
  • money saved not investing in feature/design initiatives showing insignificant effect
  • increased conversions/revenue from implementing successful experiments
  • negative: performance was severely impacted by using the React SDK for SSR
had troubles with performance for SSR and the React SDK
The website is easy to use and once Optimizely is actually implemented, it takes very little work to spin up new tests.
It is not needed when using a platform like Adobe Experience that already has things like A/B testing in addition to a comprehensive analytics data collecting.

Optimizely Feature Experimentation Feature Ratings

Comments

  • Emma Davis | TrustRadius Reviewer
    Hi There, Thanks for leaving us a review, we appreciate it! We’d like to get back to you here on a few of the drawbacks you’ve been experiencing with Optimizely Feature Experimentation, but we ask that you address the remainder with your Customer Success Manager. On your piece about documentation- we always have room for improvement here and agree that it could be more consolidated across product versions. Improvements to come soon! Surrounding your comment on ‘more examples for common patterns’- this is good feedback, and we think that we could be providing more examples for various use cases. This is top of mind for us to improve the developer experience. And on your last statement about Adobe Experience- On top of our native Results dashboard and reporting, we do offer integration with various third-party analytics platforms via notification listeners. Developers can extend these as needed to dispatch decision and conversion events to desired destination systems. We hope these responses were helpful and we look forward to you reaching out. You can also contact us at reviews@optimizely.com with any questions or concerns. Thanks!

More Reviews of Optimizely Feature Experimentation