Try our new research platform with insights from 80,000+ expert users

Amazon Bedrock vs NVIDIA DGX Platform comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Amazon Bedrock
Ranking in AI Infrastructure
4th
Average Rating
8.4
Reviews Sentiment
7.2
Number of Reviews
9
Ranking in other categories
Infrastructure as a Service Clouds (IaaS) (14th)
NVIDIA DGX Platform
Ranking in AI Infrastructure
3rd
Average Rating
9.0
Number of Reviews
1
Ranking in other categories
No ranking in other categories
 

Featured Reviews

Charles Powell - PeerSpot reviewer
Very good security features for strengthened data protection
I am not going to speak to their roadmap. Amazon operates Bedrock as an ecosystem supporting third-party models. I am speculating here, but I am sure those third-party models will always be present. However, one must consider that Amazon native models could proliferate Bedrock in the future. We would welcome Amazon native models to Bedrock, since, if they are natively built by Amazon, they are tuned to SageMaker and other Amazon service layers. They have done this somewhat for generative AI, however, in AgenTek AI business, the only foundation models we can rely on for scaling now are the Cloud 3.5 models like Haiku and SONNET, designed for low latency and complex AI business use cases.
reviewer2309676 - PeerSpot reviewer
Versatile, well-built, and powerful
The initial setup of the DGX server was quite straightforward. We treated it like any other server during deployment. It went to the data center, where they set it up, placed it in the rack, and enabled it. The deployment process was familiar, using our standard tools like Foreman and Ansible. Since the operating system is supported, we didn't encounter any specific challenges. For deploying the DGX server, we typically need two people for software tasks and sometimes vendor assistance for hardware setup. The process takes about four hours, with NVIDIA firmware updates taking the most time (around two hours), and the rest dedicated to OS and Ansible deployment. Maintaining the DGX server is pretty straightforward. We treat it like any other server, with around 10% downtime, while the rest of the cluster remains up.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Bedrock proved beneficial for generating SQL queries, which helped in delivering precise information from the database."
"Amazon Bedrock is easy to use and practical, allowing for quick development."
"Data encryption while in transit and at rest is managed through Bedrock account."
"Overall, I rate Amazon Bedrock ten out of ten."
"The no-code application of the service is beneficial since it allows creating solutions without extensive coding knowledge."
"The integration with pre-trained AI models has been very beneficial, allowing me to quickly access powerful machine learning models without the need to build them from scratch."
"Bedrock offers various foundational models in one place."
"It is the best solution in this category and is rated a nine out of ten."
"The most valuable thing about DGX Systems is their super-fast connection."
 

Cons

"It would be beneficial if Bedrock were optimized for hyperscale use to avoid needing a mixed approach with SageMaker."
"The user interface of Amazon Bedrock on the management console needs improvements."
"Amazon native models could proliferate Bedrock in the future. We would welcome Amazon native models to Bedrock since, if they are natively built by Amazon, they are tuned to SageMaker and other Amazon service layers."
"Bedrock could be improved by having an API that allows for easy integration with services outside of Bedrock."
"The user interface of Amazon Bedrock on the management console needs improvements. It's very bland at the moment."
"The advantage of Bedrock is not as an amazing enabler of AI platforms, yet we utilize it to deploy application services and microservices within Bedrock ecosystem and leverage prequalified foundation models like Claude and others."
"One area for improvement is in cost—it tends to be a bit on the higher side, especially for enterprise versions."
"It would be beneficial if Amazon Bedrock could provide multiple responses to a query, allowing users to choose the best option."
"One thing that could be better in DGX Systems is their power consumption."
 

Pricing and Cost Advice

"One customer paid around $100 to $200 per month, which was significant given their overall infrastructure costs."
"The cost of using Amazon Bedrock is quite high, as I incurred unexpected charges amounting to $130 USD within two weeks without actually deploying the model."
Information not available
report
Use our free recommendation engine to learn which AI Infrastructure solutions are best for your needs.
841,004 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Manufacturing Company
16%
Computer Software Company
15%
Transportation Company
11%
Financial Services Firm
10%
Manufacturing Company
17%
Computer Software Company
12%
University
12%
Educational Organization
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What is your experience regarding pricing and costs for Amazon Bedrock?
The solution is based on utilization and follows a consumption model. If no load is put into Bedrock, there would be no cost. Processing large volumes of data by the hour incurs high costs. You are...
What needs improvement with Amazon Bedrock?
I am not going to speak to their roadmap. Amazon operates Bedrock as an ecosystem supporting third-party models. I am speculating here, but I am sure those third-party models will always be present...
What is your primary use case for Amazon Bedrock?
We have a fairly extensive use case library that includes everything from document and report generation on the simpler side to full project management on either the hardware or software side. We b...
What do you like most about NVIDIA DGX Systems?
The most valuable thing about DGX Systems is their super-fast connection.
What is your experience regarding pricing and costs for NVIDIA DGX Systems?
The prices for DGX are pretty high, and not everyone can afford them. We only have a few out of our total servers because of the cost. It would be great if the prices could come down in the future ...
What needs improvement with NVIDIA DGX Systems?
One thing that could be better in DGX systems is their power consumption. They have been making improvements, but finding the right balance between performance and using less power is a challenge. ...
 

Also Known As

No data available
NVIDIA DGX-1
 

Overview

 

Sample Customers

Information Not Available
Open AI, UC Berkley, New York University, Massachusetts General Hospital