We use ELK primarily for enterprise monitoring and analytics through log ingestion. The data collected in Elasticsearch will be used for near real-time monitoring, analytics, and machine learning.
Technology Delivery Lead - Enterprise Monitoring at a financial services firm with 10,001+ employees
Data collected will be used for near real-time monitoring, analytics, and machine learning
Pros and Cons
- "X-Pack provides good features, like authorization and alerts."
What is our primary use case?
How has it helped my organization?
All new applications have been onboarded and used by the application teams. The initial feedback has been positive, and its capabilities seem to be a descent fit for our needs.
What is most valuable?
ELK being an open source certainly provided a platform for our organization to get involved.
X-Pack provides good features, like authorization and alerts. An X-Pack license is more affordable than Splunk.
What needs improvement?
Logstash has been a challenge and needs improvements in data ingestion reconciliation. The Kibana Cross Cluster feature is long awaited and I hope 6.0 will address it without issues.
Buyer's Guide
Elastic Search
January 2025
Learn what your peers think about Elastic Search. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
831,997 professionals have used our research since 2012.
For how long have I used the solution?
Less than one year.
What's my experience with pricing, setup cost, and licensing?
ELK has been considered as an alternative to Splunk to reduce licensing costs.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Senior Solutions Architect at a tech services company with 51-200 employees
A competitively priced, fast solution with easy indexing, but room for improvement in the graph and reporting features and network monitoring
Pros and Cons
- "The solution has great scalability."
- "Both the graph feature and the reporting feature are a little bit lacking. The alerting also needs to be improved."
What is most valuable?
There are a lot of good things about this solution. First, it is an extremely fast search. We have quite an extensive number of logs, and we can search through billions of documents in just a few minutes, and get the results we're looking for.
The second is easy indexing. We can index almost anything that comes from a log. Anything produced in the system can be ingested in Elastic Search.
What needs improvement?
I want the solution to improve the graph feature because it is a little bit poor. Both the graph feature and the reporting feature are a little bit lacking. The alerting also needs to be improved.
As for new features, I would like to see more on the network monitoring side. I can see that a lot has been done in server management, security, and application. However, I would love to see the same attention given to network management. If we could go and harvest the network information and bring it into Elastic Search, it would be the perfect solution for achieving a NOC and SOC environment.
For how long have I used the solution?
I have been using this solution for five years.
What do I think about the stability of the solution?
We haven't had any stability issues at all. You just have to make sure that you are ingesting the right amount of data and maintaining your cluster by clearing up all of the data regularly. We input some script that tells the solution to drop any data it sees that is older than three months. It's as simple as that, and we're very happy with it.
If you size your nodes properly, and a node drops or there is a problem, the product will still function. Last night, one of the nodes in my cluster crashed. I went in to check it and restarted the node, and the data appeared and everything was fine. I cannot say the same for a lot of other solutions.
What do I think about the scalability of the solution?
The solution has great scalability. We started with one node, then went to three nodes, as recommended by Elastic. We then found ourselves with seven nodes, and eventually 11 nodes. Then we said, "Wait a minute, this is not going well because we keep adding data and running out of storage." That's when we decided to start dropping data after three months.
How are customer service and support?
I've seen a lot of improvement over the last five years. Five years ago, there was a little bit of tech support but it was not great. Recently, I opened some cases and the team gave me answers that included exactly what to do to resolve the problems. This shows that the support team has knowledge. It's not just someone who is sitting in the office and try to figure out the problem. When you give them a problem, they know exactly what's wrong and they'll offer the precise solution that will solve the problem. We have seen a lot of improvements in the last six months. I would rate the technical support as a four out of five because they are very knowledgeable.
How would you rate customer service and support?
Positive
How was the initial setup?
I would rate the initial setup process as a five out of five because it's the easiest product I've ever dealt with. When it needs to be upgraded, you just tell it to upgrade and the solution does it for you.
What's my experience with pricing, setup cost, and licensing?
We started with the open-source version and the price increases as you add nodes because it's node-based. The price kept increasing, so we decided to buy a license to get all the features and manage the clusters more efficiently. The price of Elastic Enterprise is very, very competitive. I think it was around $700. It was very cheap for our budget. We have other solutions from other vendors that are way more expensive.
The beauty of Elastic Search is that it's based on an open-source solution, so even if you don't want to keep your license, you can just switch it off and go back to the open-source version. You'll lose some of the features, but your data will still be there, and you'll still be able to manipulate it.
You can scale the pricing up and down, which is great flexibility for us because we are a government organization. When it comes to invoicing and payment, the government is a little slow. For example, we found that our license expired on December 31st, but the vendor still hadn't been paid, so they would not issue us a new license. We switched our license off and went back to open source mode until we were able to get our license again and switch back to Enterprise.
What other advice do I have?
One time, we had a remote customer who was complaining about response time, and we couldn't figure out where the problem was located. We created a small setup, just one node of Elastic Search, and we started using it to ingest the network traffic that was going from that customer to our main site. Once we started ingesting the network traffic, we saw exactly what the problem was. We were able to solve the problem, and it only took us an hour.
What sets this solution apart from its competitors is the innovation. For example, look at the number of releases they're doing. About every three to six months, you have a new release with new features, and it's great. The good thing is that even if you don't like the innovation, you still follow an upgrade line, which means you don't lose anything from the past. You just keep getting new stuff pumped into Elastic Search. As a result, it's becoming more like an overall operational solution, when before, it was just a place where you dumped your logs.
My advice to new users of this solution is to start with a specific use case that's a simple or complicated problem that you want to address. Start with that use case, address it straight away, and keep expanding. For example, we started with a network traffic use case, then expanded into Syslog management of a network device. Next, we expanded to an event management server, and then we went into application management. Now we are in security logs, and it keeps expanding.
I would rate this solution as a seven out of ten because there is still a lot missing regarding network management. Also, machine learning is still not clear to me. A lot of the things in machine learning can be addressed straight away with other features, like a watcher or alerting. At this point, I don't see the benefit of machine learning when it comes to IT infrastructure.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Elastic Search
January 2025
Learn what your peers think about Elastic Search. Get advice and tips from experienced pros sharing their opinions. Updated: January 2025.
831,997 professionals have used our research since 2012.
Senior Analyst at a tech services company with 10,001+ employees
A very good product with good visualizations and stability
Pros and Cons
- "I really like the visualization that you can do within it. That's really handy. Product-wise, it is a very good and stable product."
- "They should improve its documentation. Their official documentation is not very informative. They can also improve their technical support. They don't help you much with the customized stuff. They also need to add more visuals. Currently, they have line charts, bar charts, and things like that, and they can add more types of visuals. They should also improve the alerts. They are not very simple to use and are a bit complex. They could add more options to the alerting system."
What is our primary use case?
We are primarily using it for monitoring. It is used for server monitoring.
What is most valuable?
I really like the visualization that you can do within it. That's really handy. Product-wise, it is a very good and stable product.
What needs improvement?
They should improve its documentation. Their official documentation is not very informative. They can also improve their technical support. They don't help you much with the customized stuff.
They also need to add more visuals. Currently, they have line charts, bar charts, and things like that, and they can add more types of visuals.
They should also improve the alerts. They are not very simple to use and are a bit complex. They could add more options to the alerting system.
For how long have I used the solution?
I have been using this solution for one year.
What do I think about the stability of the solution?
Stability-wise, it is very good. Once the data starts coming in, it is very stable. I didn't find any big glitches in it.
How are customer service and technical support?
We contacted their technical support once. I didn't find them very good. They are there just to provide documentation and stuff. They don't help you much with the customized stuff. They could improve that. I would rate them a two out of five.
How was the initial setup?
It is complex because it is not Windows-based. It is Linux-based, so one must know Linux to deploy it properly. It is not a product that you can install with just multiple clicks. You need to understand it.
What was our ROI?
It seems good in terms of return on investment. It is a monitoring solution, and it triggers alerts before something happens. For example, it triggers an alert when the space in Windows reaches an 80% limit. I would say it is a good investment. We are able to fix things before they go wrong. If we didn't have Elasticsearch, things would go wrong, and we would be spending more time fixing them later on.
What other advice do I have?
I would advise others to first know Linux because it would most probably be on Linux. If you're good at Linux, you will be good at this as well.
I would rate ELK Elasticsearch an eight out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
You're right Ayesha. ELK stack is not for the faint of heart. One needs strong Linux admin skills and also to understand KQL, data structures, data pipelines, etc.
It is a very customizable product and if using an on-prem solution one needs to understand Sharding, Index Lifecycle management, etc.
Highly recommended.
Data Engineer at Behsazan Mellat
Can search large amounts of data across multiple systems, and is easily scalable, but needs better automapping
Pros and Cons
- "The forced merge and forced resonate features reduce the data size increasing reliability."
- "The one area that can use improvement is the automapping of fields."
What is our primary use case?
The primary use case of this solution is to search large amounts of data across multiple systems.
How has it helped my organization?
The solution has improved our organization by allowing us to quickly search data from multiple systems saving valuable time.
What is most valuable?
The most valuable features are full-text search, the ability to index large amounts of data, map data in areas that are not fully structured, and scaling out.
What needs improvement?
The one area that can use improvement is the automapping of fields.
This may have been improved in the latest version.
For how long have I used the solution?
I have been using the solution for a year.
What do I think about the stability of the solution?
The solution is stable.
What do I think about the scalability of the solution?
The solution is easily scalable.
How are customer service and support?
There has not been a need to use customer service or support because of the vast amount of reliable forums available online.
How was the initial setup?
The initial setup is straightforward. If you understand Linux you can deploy in a couple of days.
What about the implementation team?
The implementation was completed in-house.
What's my experience with pricing, setup cost, and licensing?
To access all the features available you require both the open source license and the production license.
What other advice do I have?
I rate the solution seven out of ten.
In cases where the memory of the nodes is exceeded, you will need to manually step in to delete some data, otherwise, the solution maintains itself automatically with little need for human intervention.
The forced merge and forced resonate features reduce the data size, increasing reliability.
The open source license is not enough when dealing with a large amount of data. The production license is required when you have larger requirements.
I recommend the solution to anyone who needs to integrate a lot of old systems into a data lake.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Business Intelligence at UTE
Supports different languages for querying the database and has a free version and community support
Pros and Cons
- "The flexibility and the support for diverse languages that it provides for searching the database are most valuable. We can use different languages to query the database."
- "It is hard to learn and understand because it is a very big platform. This is the main reason why we still have nothing in production. We have to learn some things before we get there."
What is our primary use case?
We are mainly using it for analytics reports for the data taken from our call center. We are using the entire stack. We are using Kibana and Elasticsearch. Kibana is the front end for dashboards, reports, etc.
What is most valuable?
The flexibility and the support for diverse languages that it provides for searching the database are most valuable. We can use different languages to query the database.
What needs improvement?
It is hard to learn and understand because it is a very big platform. This is the main reason why we still have nothing in production. We have to learn some things before we get there.
I have reported and had discussions about several bugs at discuss.elastic.co, but that happens with many products. It is not only with this product.
For how long have I used the solution?
We have been using it for about one year, but it is not yet in our production environment.
What do I think about the stability of the solution?
It is reliable.
What do I think about the scalability of the solution?
If you use a cloud platform or a cloud environment, it is easy to scale.
For on-premises, we are using OpenShift. We are using a cluster on OpenShift, and we are facing some issues, but they are not related to Elastic. They are related to our infrastructure of OpenShift because OpenShift is deployed on VMware, and the storage of VMware doesn't allow us to take backup snapshots in a secure way. We are thinking of migrating this cluster of OpenShift to another platform.
Currently, we have a few users of this product because we have been using it only for one year, and we are the first ones in our company. In the future, we will have more people involved with the product.
How are customer service and support?
We have only used their community support from the discuss.elastic.co site.
What's my experience with pricing, setup cost, and licensing?
There is a free version, and there is also a hosted version for which you have to pay.
We're currently using the free version. If things go well, we might go for the paid version.
What other advice do I have?
It is a good choice, but you have to take your time to learn it. Its learning curve can be hard.
I would rate it an eight out of 10.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Head of Technology Operations at a financial services firm with 11-50 employees
Open-source with good community support but number of search queries is limited
Pros and Cons
- "The most valuable feature is the out of the box Kibana."
- "I would like to be able to do correlations between multiple indexes."
What is our primary use case?
I run the function to review the usage for the team and for the organization itself.
We use this product internally and then some of our business relationships with the other businesses that we have, they get their data from our data. It's more for collaborative data reporting that we have with them.
What is most valuable?
The most valuable feature is the out of the box Kibana. You plug it in and start the basic analysis on the data out of the box. This also gives a quick way to check the data and the models to figure out what fits the needs.
What needs improvement?
There are a few things that did not work for us.
When doing a search in a bigger setup, with a huge amount of data where there are several things coming in, it has to be on top of the index that we search.
There could be a way to do a more distributed kind of search. For example, if I have multiple indexes across my applications and if I want to do a correlation between the searches, it is very difficult. From a usage perspective, this is the primary challenge.
I would like to be able to do correlations between multiple indexes. There is a limit on the number of indexes that I can query or do. I can do an all-index search, but it's not theoretically okay on practical terms we cannot do that.
In the next release, I would like to have a correlation between multiple indexes and to be able to save the memory to the disk once we have built the index and it's running.
Once the system is up, it will start building that in memory.
We need to be able to distribute it across or save it to have a faster load time.
We don't make many changes to the data that we are creating, but we would like archived reports and to be able to retrieve those reports to see what is going on. That would be helpful.
Also, if you provide a customer with a report or some archived queries, that the customer is looking at when they are creating, at first it will be slow while putting up their data or subsequently doing it. I want it to be up and running efficiently.
If the memory could be saved and put back into memory as it is, then starts working it would reduce the load time then it will be more efficient from a cost perspective and it will optimize resource usage.
For how long have I used the solution?
I have been familiar with this product for approximately four years.
What do I think about the stability of the solution?
ELK Elasticsearch is stable.
What do I think about the scalability of the solution?
It's scalable, but there are some limitations.
If you are scaling a bit too quickly, you tend to break the applications into different indexes.
The limitations come in when getting the correlation between the applications or the logs.
It is difficult to get the correlations once the indexes have been split.
How are customer service and technical support?
We are using the open-source version, that is installed on-premises.
We have not worried about technical support, but the community is good.
Which solution did I use previously and why did I switch?
Before ELK, we used another solution for internal usage, and also, we used Splunk for different use cases in a different organization altogether.
It wasn't a switch per se, it was a different organization with a different use case.
How was the initial setup?
The initial setup is simple, not too difficult.
Getting the index, doing your models, and putting the data in, correctly, is done more on a trial and error basis. You have to start early and plan it well to get it right.
What's my experience with pricing, setup cost, and licensing?
We are using the open-source version.
We are not looking into the subscription because it's on-premises in-house.
What other advice do I have?
For anyone who is looking into implementing this solution, the only tip is to get your models for the type of actual use that you are looking at upfront in order to have a good run.
I would rate ELK Elasticsearch a seven out of ten.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
System Administrator and DevOps Engineer at a tech services company with 10,001+ employees
Has a good UI with good performance although deployment requires multiple applications
Pros and Cons
- "The UI is very nice, and performance wise it's quite good too."
- "The different applications need to be individually deployed."
What is our primary use case?
Our primary use case of this solution is for monitoring our logs and infrastructure. We are customers of ELK and I'm a system administrator.
What is most valuable?
A positive feature of ELK is that it directly interacts with Elasticsearch. The UI is very nice, and performance wise it's quite good too. A key feature is that this is a reasonably priced monitoring solution.
What needs improvement?
We run this solution on multiple servers. ELK has three lanes which comprise a single package made up of Elasticsearch, Logstash, and Kibana. To my mind, this is not efficient because we have to individually deploy the different applications. In contrast, we're able to deploy Splunk with a singe application. Implementing the dashboards is also quite difficult. With Splunk and Nagios it's much easier to directly interact with Elasticsearch. I'd like to see some additional features in the front end which currently make it a bit difficult to implement and it should be simplified.
For how long have I used the solution?
I've been using this solution for six months.
What do I think about the stability of the solution?
This solution is stable.
What do I think about the scalability of the solution?
This is a scalable solution, we have eight to 10 users. We had initially planned to expand use of ELK because of its cheap price and the services that are included, but given the difficulty with implementation we've decided to go with Nagios instead.
How are customer service and technical support?
The technical support people are very knowledgeable but the response time is quite slow which is not very good.
How was the initial setup?
The initial setup of ELK is more difficult than the setup of other monitoring applications. I was able to carry out the deployment alone.
What other advice do I have?
For anyone looking to implement a monitoring product with almost no cost or at a cheaper price, I would suggest the ELK stack. However, it does require a high skill set because of the difficulty with implementation.
I would rate this solution a six out of 10.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
IT Secuirty Architect at a insurance company with 10,001+ employees
Valuable detection and correlation features
Pros and Cons
- "The most valuable features are the detection and correlation features."
- "Something that could be improved is better integrations with Cortex and QRadar, for example."
What is our primary use case?
We are internal integrators. We are in the bigger group as of now, but other groups, our clients, are affiliates from our group. They are our internal clients.
The solution is currently on-premises.
I was mostly responsible for the SOC team, and I helped them create the detection rules for the production. I wanted to know how it could be implemented in different kinds of products, like Sentinel.
What is most valuable?
The most valuable features are the detection and correlation features.
What needs improvement?
Something that could be improved is better integrations with Cortex and QRadar, for example.
For how long have I used the solution?
I have been using this solution for no more than one year.
How are customer service and support?
Not really, because I'm not the engineer and so most problems appear during the installations or maintenance and I'm not in developing infrastructure operations.
What's my experience with pricing, setup cost, and licensing?
The price of Elasticsearch is fair. It is a more expensive solution, like QRadar. The price for Elasticsearch is not much more than other solutions we have.
Which other solutions did I evaluate?
I would say that Elasticsearch is better than all the other solutions. QRadar is getting better, but it is still behind Elasticsearch in my opinion.
What other advice do I have?
I would rate this solution 8 out of 10.
I would recommend Elasticsearch if you don't have bigger budget limitations to use other enterprise solutions or if you want to avoid the vendor lock-in.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
Download our free Elastic Search Report and get advice and tips from experienced pros
sharing their opinions.
Updated: January 2025
Popular Comparisons
Microsoft FAST
IBM Watson Discovery
Lucidworks
OpenText IDOL
Sinequa
Exalead
Attivio
Oracle Endeca
Buyer's Guide
Download our free Elastic Search Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- What are the advantages of ELK over Splunk?
- Splunk vs. Elastic Stack
- How to install an Elasticsearch cluster (with security enabled) on OpenShift?
- What would you choose for observability: Grafana observability platform or ELK stack?
- Alternatives to Google Search Appliance?
- When evaluating Indexing, what aspect do you think is the most important to look for?
Elasticsearch is a distributed, RESTful search and analytics engine capable of solving a growing number of use cases, such as security events.