What is our primary use case?
We are looking for someone experimental and feature flagging, so we are evaluating some applications, libraries, and SDKs, and we found Eppo is one of the great options, so we are integrating that.
For the LiteX application, we are trying to do feature flagging, as we have two applications like image to video or text to video options, and we want to determine which type of model will generate more revenue or be more user-interface friendly for users. We initially tried to do this with Firebase, but we did not get much result from that, and some results were confusing too; perhaps we were not able to understand, or something else was the issue, but we are now exploring other options, so we are exploring Eppo.
I am looking for a way to run experiments where we can have 10% of users on experiment A and 10% on experiment B to get a real example of how many users are interacting with that model and how much our revenue is going, so we want to split that way.
What is most valuable?
Based on my exploration, I find Eppo to be more powerful in providing result-oriented, data-oriented results for feature flagging and experiments. I am expecting that if Eppo tracks data on how 10% of users are engaging with experiment A and 10% with experiment B, it will provide insights on how many users are using our features and how much revenue generation is occurring. That type of data is what I think Eppo will work more result-oriented on. The main thing we are looking for regarding features is that Eppo stands out to me because I am exploring something, and the data is easily aligning with our needs.
Eppo is stable, and I have not encountered any crashes or issues. Based on our early evaluation, I see that Eppo will work great for me regarding the accuracy and reliability of its output.
What needs improvement?
I do not have anything to add about my main use case or how I hope Eppo will help.
Till now, I do not have any improvement points, so I cannot comment on that at this time.
I do not want to add more about the needed improvements for the evaluation or integration process.
For how long have I used the solution?
Until now, we have not deployed Eppo; we are still exploring options.
What do I think about the stability of the solution?
Based on my evaluation so far, Eppo is stable, and I have not encountered any crashes or issues.
What do I think about the scalability of the solution?
I am hoping that Eppo's scalability will handle growth as our usage increases.
How are customer service and support?
Until now, I do not prioritize customer support much because if the finance team has connected with them, my team as developers or engineering managers has not coordinated with any customer support.
Which solution did I use previously and why did I switch?
I was using Firebase as a different solution for feature flagging and experiments.
How was the initial setup?
We are still in the evaluation phase, so we cannot determine how much Eppo has helped us; that will be determined in the future. I am expecting that Eppo will work closely with our needs, leading to improvements.
So far, there have been some challenges in integration, particularly with SDK detailing, but overall I have managed to work through the process, and we are trying to experiment with something and evaluate.
What was our ROI?
It is too early to tell if we have seen a return on investment because I am still exploring, so I cannot answer that yet.
What's my experience with pricing, setup cost, and licensing?
The pricing, setup cost, and licensing are part of the finance team, so I am not able to answer that.
Which other solutions did I evaluate?
Until now, we are exploring other tools such as Split and Statig. I have explored Statig before choosing Eppo among other options.
I found that competitors such as Statig and Firebase do not provide me actual results, which is why I am switching to Eppo.
What other advice do I have?
We will use something else for other purposes. For feature flagging, we will not require Azure; based on my exploration, if we determine which SDK we are using, we will not deploy on AWS or something similar.
I am hoping that Eppo will work closely with our data and provide better results, unlike the experiences we had with Firebase. I am hoping Eppo will perform better compared to others. I would rate Eppo as nine overall based on the process we have experienced so far.