AWS Security Hub vs Devo comparison

The compared Amazon Web Services (AWS) and Devo solutions aren't in the same category. Amazon Web Services (AWS) is ranked #11 in CSPM , with an average rating of 7.7, and holds a 2.6% mindshare in the category. Devo is ranked #26 in Log Management , with an average rating of 8.0, and holds a 1.3% mindshare. Additionally, 89% of Amazon Web Services (AWS) users are willing to recommend the solution, compared to 95% of Devo users who would recommend it.

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Sep 18, 2024

Devo and AWS Security Hub are prominent players in the security information and event management (SIEM) market. AWS Security Hub seems to have the upper hand because of its robust cloud-native features and scalability.

Features: Devo is valued for its efficient data integration, real-time event correlation, and adaptability to various data sources. AWS Security Hub offers extensive cloud-native features, automated compliance checks, and seamless integration with other AWS services.

Room for Improvement: Devo could improve its user experience, offer more intuitive dashboards, and enhance ease-of-use. AWS Security Hub users desire enhanced customizability, better multi-account management, and more flexibility in configuration.

Ease of Deployment and Customer Service: Devo is highlighted for a straightforward deployment process and commendable customer support. AWS Security Hub has an easy deployment within the AWS ecosystem, but support responsiveness can vary.

Pricing and ROI: Devo is seen as offering good value for money with its transparent pricing model. AWS Security Hub's pricing is higher but justified by its extensive feature set and integration capabilities.

To learn more, read our detailed Cloud Security Posture Management (CSPM) Report (Updated: June 2026).

Buyer's Guide

Cloud Security Posture Management (CSPM)

June 2026

Download the complete report

Helped 899,204 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

Qualys TotalCloud

Mindshare comparison

Cloud Security Posture Management (CSPM) Mindshare Distribution
Product	Mindshare (%)
AWS Security Hub	2.6%
Wiz	10.7%
Prisma Cloud by Palo Alto Networks	8.0%
Other	78.7%

Cloud Security Posture Management (CSPM)

Log Management Mindshare Distribution
Product	Mindshare (%)
Devo	1.3%
Splunk Enterprise Security	6.8%
Wazuh	4.8%
Other	87.1%

Log Management

Featured Reviews

Robert Orłowski

IT Security Expert at Alior Bank S.A.

Unified risk scoring has improved our cloud visibility and simplifies remediation priorities

Qualys TotalCloud provides unified vulnerability and threat assessment across both IAS and SaaS. This solution provides a single prioritized view of risk, which helps reduce the work I would have to do. We are no longer based on CVSS; we are based on Qualys risk scoring, which is based on CVSS plus internal findings made by Qualys, and then assigns its own score. The TruRisk insight feature has found a small number of assets with high vulnerability scores, though I am cautious since some information is classified. Qualys TotalCloud has positively impacted our bank's performance, and we have definitely seen benefits after implementing this solution.

Read full review

Karthik Ekambaram

Director at Scybers

Has helped identify misconfigurations and prioritize risks but lacks multi-cloud support and deeper integration features

AWS Security Hub cannot scale up to multiple different cloud environments; it only works for AWS. There are other products in the market for CSPM that can give you multi-cloud environment misconfigurations, even Microsoft for that matter. Regarding the integration of AWS Security Hub with third-party tools, I am not certain whether we can integrate them, but there is no need to do so. However, AWS Security Hub cannot integrate with other cloud providers, so it only supports the AWS environment. The compliance checks within AWS Security Hub are good, but we don't use them much. We utilize compliance frameworks such as CIS compliance frameworks and ISO 27017 framework, which are beneficial, but it can improve in other areas too, such as including NIST and other frameworks beyond just ISO and CIS. Improvements can be applicable for scalability, particularly on integration with multi-cloud environments, and compliance frameworks can be added for more variety as well. The unified dashboard in AWS Security Hub is adequate; I cannot say it is exceptional, but the content available in the dashboards is satisfactory for now.

Read full review

Francisco JavierRomo

Strategic Account Executive at a computer software company with 51-200 employees

Has improved investigative workflows with interactive dashboards and simplified data correlation

The data analytics cloud component focuses on real-time analytics, which is very impressive. The SIEM collects and correlates logs data from different sources and can integrate with ServiceNow, hardware asset management, and software asset management. The security orchestration, automation, and response (SOAR) is another valuable feature. The security data platform serves as the foundation of Devo. Regarding advanced query capabilities, Devo offers several models including query logs, visual query builder, language integrated query, and SQL, with SQL being the most frequently used querying data capability. The single pane of glass that Devo offers is the SOC. The tools in Devo's active ports are for investigating, not just viewing data. They are more interactive than other market solutions. The drill-down reports capabilities allow analysts to click on any element in a widget. When they see a spike in a line chart for a failed login, which could be a true or false attempt, they can click that spike, and a table widget on the same active board instantly populates with raw logs of data for those specific failed logins. This is particularly important for enterprise companies with numerous endpoints and users. The dynamic filtering of inputs significantly reduces the time cybersecurity analysts spend trying to figure out failed logins and identifying false positives.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"I like the web API security and IoT scanning features the most. The user-friendly design of TotalCloud's interface enables customers to navigate it and use its full potential easily"

"While automatic inventory detection upon connection is a helpful feature, a truly valuable capability would be assessing an environment's security posture against Azure and CIS best practices."

"Vulnerability and threat detection and assessment of the criticality of the vulnerabilities exposed are most valuable."

"One of the most valuable features of Qualys TotalCloud is FlexScan, which is specifically for internet-facing VMs. We found this feature to be very useful. It was a key differentiator for us."

"TruRisk Insights is the most important innovation they've released this year."

"I appreciate Qualys TotalCloud's ability to onboard any type of device with ease, including containers."

"I appreciate TotalCloud's real-time protection and remediation features. The remediation options include automated one-click remedies and custom changes that help manage vulnerabilities efficiently."

"The vulnerability management feature is the one I like the most because it provides a clear picture of all vulnerabilities."

More Qualys TotalCloud pros

"I like that AWS Security Hub currently has several good features, around four or five. The technical support for AWS Security Hub is also responsive."

"It's a security posture management tool from AWS. Basically, it identifies misconfigurations, similar to Trusted Advisor but on a larger scale."

"The solution is very good at detection and providing real-time alerts."

"AWS Security Hub's unified dashboard does help streamline my process of identifying vulnerabilities, but we don't use Inspector."

"AWS Security Hub can check your infrastructure against multiple compliance frameworks. You can turn on or off specific frameworks based on your needs."

"The most valuable feature of the solution stems from the fact that it is easy to manage...It is a scalable solution."

"I rate Security Hub ten out of ten for stability."

"The platform has valuable features for security."

More AWS Security Hub pros

"Devo provides good value and, given the quality of the product, I would expect to pay more."

"It centralizes security management within a business, functioning as a core system for a SOC."

"The ROI has been great as we could launch it in a few months instead of a couple of years, and when you put all the costs together, it is less to have done it than with the open source approach."

"The most valuable feature is definitely the ability that Devo has to ingest data. From the previous SIEM that I came from and helped my company administer, it really was the type of system where data was parsed on ingest. This meant that if you didn't build the parser efficiently or correctly, sometimes that would bring the system to its knees. You'd have a backlog of processing the logs as it was ingesting them."

"Devo provides a multi-tenant, cloud-native architecture. This is critical for managed service provider environments or multinational organizations who may have subsidiaries globally. It gives organizations a way to consolidate their data in a single accessible location, yet keep the data separate. This allows for global views and/or isolated views restricted by access controls by company or business unit."

"The drill-down reports capabilities allow analysts to click on any element in a widget. When they see a spike in a line chart for a failed login, which could be a true or false attempt, they can click that spike, and a table widget on the same active board instantly populates with raw logs of data for those specific failed logins."

"When we show the people who are in charge of getting funding that we saved this number of man-hours, which correlates to this number of dollars, they're more willing to fight to get that funding for the next fiscal year."

"The strength of Devo is not only in that it is pretty intuitive, but it gives you the flexibility and creativity to merge feeds. The prime examples would be using the synthesis or union tables that give you phenomenal capabilities... The ability to use a synthesis or union table to combine all those feeds and make heads or tails of what's going on, and link it to go down a thread, is functionality that I hadn't seen before."

More Devo pros

Cons

"Qualys TotalCloud needs to enhance its scanning capabilities in the IP domain, as it currently lacks the functionality to resolve IPs to their corresponding domain names."

"I would appreciate additional integration options to connect Qualys TotalCloud with our other vulnerability management tools."

"Qualys' customer service provides quality answers, but the response time is long, even though it is within the SLA."

"Some major banks and insurance companies require an on-premises solution for comprehensive vulnerability management, which TotalCloud does not offer."

"The support process is inefficient due to the excessive number of replies required when submitting tickets."

"I think Qualys TotalCloud needs to improve its handling of zero-day vulnerabilities and supply chain management because modern ransomware attacks not only target prime critical infrastructures but also the supply chain system."

"The cost of Qualys TotalCloud is high and could be more competitive."

"The vulnerability part is good, but the policy compliance module needs improvement because it involves a lot of manual work. Specifically, the remediation part of the controls requires enhancements."

More Qualys TotalCloud cons

"AWS Security Hub's configuration and integration are areas where it lacks and needs to improve."

"From an improvement perspective, there is a need to add more compliance since, right now, AWS Security Hub only provides four to five compliances to control the tool."

"The solution should be easier to learn and use"

"I would like a more fine-grained capability for creating custom rules and a more user-friendly experience programmatically in writing queries and configuring custom security rules, making it quicker and easier."

"The support must be quicker."

"Although AWS Security Hub does a periodic scan of your overall infrastructure, it doesn't do it in real time."

"Whenever my team gets some alarms from the central team, my team needs to initiate whether it's a real or false trigger. The central team needs to keep adjusting to the parameters or at least the concerned IPs, whether it's really from the company's pool of IPs, so the trigger process can be improved. In the next release of AWS Security Hub, I'd like a better dashboard that could result in better alert visibility."

"One aspect that could be improved in the solution is its adaptability to different markets and geopolitical restrictions. In certain regions like Thailand, specific services from certain countries or providers, such as AWS or Azure, might be limited or blocked. It also needs improvement in would require configuring the solution more adaptable to AWS infrastructure and function."

More AWS Security Hub cons

"Their documentation could be better. They are growing quickly and need to have someone focused on tech writing to ensure that all the different updates, how to use them, and all the new features and functionality are properly documented."

"The price is one problem with Devo."

"There are some issues from an availability and functionality standpoint, meaning the tool is somewhat slow. There were some slow response periods over the past six to nine months, though it has yet to impact us terribly as we are a relatively small shop. We've noticed it, however, so Devo could improve the responsiveness."

"The biggest area with room for improvement in Devo is the Security Operations module that just isn't there yet."

"One major area for improvement for Devo... is to provide more capabilities around pre-built monitoring."

"There's room for improvement within the GUI. There is also some room for improvement within the native parsers they support. But I can say that about pretty much any solution in this space."

"One major area for improvement for Devo... is to provide more capabilities around pre-built monitoring. They're working on integrations with different types of systems, but that integration needs to go beyond just onboarding to the platform. It needs to include applications, out-of-the-box, that immediately help people to start monitoring their systems. Such applications would include dashboards and alerts, and then people could customize them for their own needs so that they aren't starting from a blank slate."

"One improvement area for Devo could be simplifying some configuration and improving the onboarding for new analysts because it is quite complex for fresher or new analysts who are handling Devo."

More Devo cons

Pricing and Cost Advice

"I am not sure about the pricing. From what I understand, it is a bit on the higher side, but I do not have the exact numbers."

"Qualys TotalCloud offers cost-effective licensing flexibility."

"TotalCloud's price is about right where I would expect it to be."

"Qualys TotalCloud is expensive, but it offers a premier solution with no headaches."

"Qualys TotalCloud offers competitive pricing given its comprehensive suite of features, including integration, assessment, remediation, and detection capabilities, all within a single platform."

"The cost is high, but it meets our organizational needs."

"It isn't cheap, but it's reasonable. It helps us to manage things with very few resources."

"While Qualys TotalCloud's pricing is currently acceptable, it is becoming increasingly expensive and may soon be considered overpriced."

More Qualys TotalCloud pricing and cost advice

"The cost is based on the number of compliances, core checks, and services required, and for more than 10,000 recommendations, the charge is just one dollar."

"Security Hub is not an expensive solution."

"AWS Security Hub is not an expensive tool. I would consider it to be a cheap solution. AWS Security Hub follows the PAYG pricing model, meaning you will have to pay for whatever you use."

"AWS Security Hub's pricing is pretty reasonable."

"There are multiple subscription models, like yearly, monthly, and packaged."

"The pricing is fine. It is not an expensive tool."

"The price of AWS Security Hub is average compared to other solutions."

"The price of the solution is not very competitive but it is reasonable."

"I'm not involved in the financial aspect, but I think the licensing costs are similar to other solutions. If all the solutions have a similar cost, Devo provides more for the money."

"[Devo was] in the ballpark with at least a couple of the other front-runners that we were looking at. Devo is a good value and, given the quality of the product, I would expect to pay more."

"Our licensing fees are billed annually and per terabyte."

"It's a per gigabyte cost for ingestion of data. For every gigabyte that you ingest, it's whatever you negotiated your price for. Compared to other contracts that we've had for cloud providers, it's significantly less."

"I rate the pricing a four on a scale of one to ten, where one is cheap, and ten is expensive."

"It's very competitive. That was also a primary draw for us. Some of the licensing models with solutions like Splunk and Sentinel were attractive upfront, but there were so many micro-charges and services we would've had to add on to make them what we wanted. We had to include things like SOAR and extended capabilities, whereas all those capabilities are completely included with the Devo platform. I haven't seen any additional fee."

"The way Devo prices things is based on the amount of data, and I wish the tiers had more granularity. Maybe at this point they do, but when we first negotiated with them, there were only three or four tiers."

"Devo is definitely cheaper than Splunk. There's no doubt about that. The value from Devo is good. It's definitely more valuable to me than QRadar or LogRhythm or any of the old, traditional SIEMs."

More Devo pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Security Posture Management (CSPM) solutions are best for your needs.

See recommendations

899,204 professionals have used our research since 2012.

Comparison Review

it_user186927

Director of Operations at a comms service provider with 10,001+ employees

Feb 16, 2015

Cybereason vs. Interset vs. SQRRL

Capture DB - they all use NoSQL db and hence solve the ad hoc query and 'go back in time' problem with current best of breed SIEM and DLP solutions that rely on real time analysis of incoming logs (and don't store them). This means deeper and quicker iterative threat analysis and assessment…

Read full review

Top Industries

By visitors reading reviews

Manufacturing Company

19%

Financial Services Firm

14%

Construction Company

Comms Service Provider

Financial Services Firm

12%

Manufacturing Company

11%

Computer Software Company

Comms Service Provider

Financial Services Firm

13%

Construction Company

10%

Computer Software Company

Manufacturing Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

By reviewers
Company Size	Count
Small Business	10
Midsize Enterprise	3
Large Enterprise	28

By reviewers
Company Size	Count
Small Business	9
Midsize Enterprise	5
Large Enterprise	14

By reviewers
Company Size	Count
Small Business	9
Midsize Enterprise	4
Large Enterprise	12

Questions from the Community

What is your experience regarding pricing and costs for Qualys TotalCloud?

The price is very expensive, actually.

See all answers

What needs improvement with Qualys TotalCloud?

Areas that need improvement in every solution include the remediation part. The remediation steps should be simple en...

See all answers

What is your primary use case for Qualys TotalCloud?

Our use case involves the assets that we have under cloud, the assets exposed to the internet, and the internal appli...

See all answers

Which is better - Azure Sentinel or AWS Security Hub?

We like that Azure Sentinel does not require as much maintenance as legacy SIEMs that are on-premises. Azure Sentinel...

See all answers

What needs improvement with AWS Security Hub?

I do not see any areas for improvement in AWS Security Hub itself, but the cost factor is something that is the main ...

See all answers

What is your primary use case for AWS Security Hub?

AWS Security Hub is something I have used daily as it is a part of my job for cloud security purposes. If you are dea...

See all answers

What is your experience regarding pricing and costs for Devo?

Pricing generally depends on the scale, data ingestion requirements, and integrations for what the enterprise monitor...

See all answers

What needs improvement with Devo?

One improvement area for Devo could be simplifying some configuration and improving the onboarding for new analysts b...

See all answers

What is your primary use case for Devo?

Devo serves as our centralized log monitoring, threat investigation, alert monitoring, and security analytics platfor...

See all answers

Comparisons

Wiz vs Qualys TotalCloud

Compared 12% of the time

Microsoft Defender for Cloud vs Qualys TotalCloud

Compared 9% of the time

Prisma Cloud by Palo Alto Networks vs Qualys TotalCloud

Compared 6% of the time

JupiterOne vs Qualys TotalCloud

Compared 5% of the time

Varonis Platform vs Qualys TotalCloud

Compared 3% of the time

More Qualys TotalCloud Competitors

Microsoft Sentinel vs AWS Security Hub

Compared 33% of the time

Prisma Cloud by Palo Alto Networks vs AWS Security Hub

Compared 6% of the time

Wiz vs AWS Security Hub

Compared 4% of the time

Microsoft Defender for Cloud vs AWS Security Hub

Compared 4% of the time

JupiterOne vs AWS Security Hub

Compared 2% of the time

More AWS Security Hub Competitors

LogRhythm SIEM vs Devo

Compared 8% of the time

Splunk Enterprise Security vs Devo

Compared 7% of the time

New Relic vs Devo

Compared 4% of the time

IBM Security QRadar vs Devo

Compared 3% of the time

Microsoft Sentinel vs Devo

Compared 3% of the time

More Devo Competitors

Product Reports

Buyer's Guide

Qualys TotalCloud

May 2026

Download Qualys TotalCloud product report

Buyer's Guide

AWS Security Hub

June 2026

Download AWS Security Hub product report

Buyer's Guide

Devo

June 2026

Download Devo product report

Also Known As

Qualys TotalCloud with FlexScan

SQRRL

No data available

Overview

Qualys TotalCloud enhances security posture across cloud environments with continuous monitoring, vulnerability management, and risk visualization, ensuring efficient threat assessment and automated remediation for improved cyber risk reduction.

Qualys TotalCloud offers a robust suite of security tools essential for organizations managing multi-cloud infrastructures. By integrating cloud accounts and automating workflows, it supports AWS, Azure, and GCP, offering comprehensive vulnerability management and zero-day detection. The platform's user-friendly design, combined with its extensive risk management and unified threat assessment capabilities, enables organizations to prioritize and remediate vulnerabilities effectively. TruRisk Insights provides clear insights on cyber risks, while the automation options streamline patch management and scanning processes. API integration across IaaS and SaaS environments further enhances resource allocation efficiency and saves time, addressing misconfigurations across cloud environments.

What are the most important features of Qualys TotalCloud?

Accurate Vulnerability Reports: Delivers precise and actionable insights for risk mitigation.
Zero-Day Detection: Identifies and addresses zero-day vulnerabilities proactively.
Unified Threat Assessment: Offers comprehensive evaluation of threats across the environment.
Extensive Risk Management: Manages risks effectively with advanced insights and prioritization.
Continuous Monitoring: Provides non-stop surveillance for vulnerabilities and threats.
Cloud-Native Automation: Streamlines processes and reduces manual efforts using automation.
FlexScan for Internet-Facing VMs: Scans external VMs efficiently to detect vulnerabilities.
Dashboard Risk Visualization: Clear visualization helps prioritize vulnerabilities.

What benefits and ROI should users look for?

Improved Security Posture: Enhances threat detection and response across clouds.
Time Savings: Automation reduces time spent on manual vulnerability management.
Resource Efficiency: Better allocation of resources through streamlined workflows.
Enhanced Risk Prioritization: Focus on critical vulnerabilities for effective mitigation.
Integrated Cloud Accounts: Facilitates seamless cloud management and security.

Qualys TotalCloud is deployed in sectors needing rigorous vulnerability management, such as finance and healthcare. Companies utilize it to secure multi-cloud environments like AWS, Azure, and GCP, focus on compliance, and integrate security into CI/CD pipelines to detect and remedy threats pre-deployment.

Qualys

AWS Security Hub provides multi-account management and compliance checks alongside integrations with AWS services and third-party tools. It centralizes vulnerability tracking and risk prioritization, delivering real-time alerts for proactive security management.

AWS Security Hub enhances cloud security management through a centralized dashboard that monitors infrastructure resources and compliance scores, ensuring adherence to AWS standards. With integrations for vulnerability detection and security posture management, users can streamline security operations. While the platform offers notable benefits, areas for improvement include customization options for findings suppression and integration with multi-cloud environments.

What are the key features of AWS Security Hub?

Multi-Account Management: Seamlessly manage security across numerous accounts.
Compliance Checks: Stay aligned with standards such as PCI through automated reviews.
AWS Integrations: Connect effortlessly with AWS and third-party services to enhance security posture.
Real-Time Alerts: Quickly respond to potential threats with immediate notifications.
Risk Prioritization: Focus on critical vulnerabilities to enhance resource allocation.

What benefits should users expect from using AWS Security Hub?

Proactive Security: Early threat detection enables quicker mitigation strategies.
Cloud-Native Functionality: Utilize tools tailored for cloud environments.
Compliance Insights: Simplified compliance management provides transparency.
Ease of Use: Streamlined interface facilitates efficient security management.

Industries implementing AWS Security Hub leverage its capabilities for comprehensive security across multiple accounts and regions. Health, finance, and retail sectors benefit by automating compliance checks and monitoring security infrastructures. This service aids in identifying misconfigurations, tracking alerts, and ensuring infrastructure integrity during cyber incidents.

Amazon Web Services (AWS)

Devo offers powerful visual analytics, real-time data querying, and log integration capabilities within a cloud-native, multi-tenant architecture, supporting extended data retention ideal for long-term analysis and compliance.

Devo is recognized for its Activeboards, which facilitate visual analytics. High-speed search capabilities and real-time analytics enable efficient data manipulation and querying. Its multi-tenant architecture supports effective data segregation and customization tailored to distinct business needs, enhancing its value for handling complex log integrations. With extended data retention of 400 days and a cloud-native architecture, Devo is a robust platform for long-term analysis and compliance requirements. Though opportunities exist to improve browser stability on large searches, SOAR integrations, and its parser capabilities, Devo remains essential for incident response and security monitoring, offering centralized data storage and analysis.

What are Devo's most important features?

Activeboards: Facilitate visual analytics and data exploration.
High-Speed Search: Enables fast data querying and manipulation.
Real-Time Analytics: Supports instant insights and decision-making.
Multi-Tenant Architecture: Allows effective data segregation and customization.
Extended Data Retention: Offers 400-day log retention for compliance and analysis.
Complex Log Integration: Handles intricate data sources effortlessly.

What benefits and ROI should organizations look for in reviews?

Visual Insights: Enhance understanding through interactive dashboards.
Performance Efficiency: Saves time with high-speed data search and real-time results.
Customization Flexibility: Fits specific business requirements with multi-tenant architecture.
Long-Term Compliance: Ensures alignment with extended data retention needs.
Centralized Monitoring: Enables comprehensive incident response and security monitoring.

Devo is extensively used in industries focused on incident response and digital forensics, centralizing data for security monitoring across hybrid environments. Organizations benefit from its ability to store and analyze aggregated logs, creating alerts and dashboards to enhance visibility for network and endpoint activities in multi-domain settings.

Devo

Sample Customers

Information Not Available

Edmunds, Frame.io, GoDaddy, Realtor.com

United States Air Force, Rubrik, SentinelOne, Critical Start, NHL, Panda Security, Telefonica, CaixaBank, OpenText, IGT, OneMain Financial, SurveyMonkey, FanDuel, H&R Block, Ulta Beauty, Manulife, Moneylion, Chime Bank, Magna International, American Express Global Business Travel

Buyer's Guide

Cloud Security Posture Management (CSPM)

June 2026

Download Free Report

Find out what your peers are saying about Wiz, Palo Alto Networks, SentinelOne and others in Cloud Security Posture Management (CSPM). Updated: June 2026.

DOWNLOAD NOW

899,204 professionals have used our research since 2012.

We monitor all Cloud Security Posture Management (CSPM) reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.