Overview

3GEN GPU Server for AI/ML/DL

3Gen GPU Servers addresses these key Enterprise level AI Workloads

1. Risk

Pulling together an end-to-end AI solution from disparate products, and integrating them with existing infrastructure, is difficult.

2. Performance

Fast deploy and high performance are critical for AI, ML, and data analytics workloads.

3. Scaling

Going from proof of concept to enterprise deployment requires effective scaling—through efficient use of resources—to ensure manageability, availability, and infrastructure cost management.

3GEN AI Enterprise GPU Software suite is an end-to-end, cloud-native suite of AI and data analytics software, optimized to enable organizations to use AI, and certified to deploy anywhere. The operating system of the 3GEN AI platform is powered by NVIDIA, 3Gen AI Enterprise GPU Server is essential for production and support of applications built with the extensive NVIDIA library of frameworks such as Riva for speech AI, Merlin for recommendation engines, Morpheus for cybersecurity, and more. Organizations can get started more quickly with 3GEN AI solution workflows included with 3Gen AI Enterprise powered by NVIDIA. These packaged solutions can help teams get a jump start in building AI solutions for various use cases including contact center intelligent virtual assistants, audio transcription, and cybersecurity digital fingerprinting to detect anomalies.

Unleashing AI for Every Enterprise

Artificial intelligence is transforming every industry, whether it’s by improving customer relationships in financial services, streamlining manufacturer supply chains, or helping doctors deliver better outcomes for patients. IDC projects that, by 2024, 60 percent of the G2000 will expand the use of AI and machine learning (ML) across all business-critical horizontal functions, such as marketing, legal, HR, procurement, and supply chain logistics.

While most organizations understand the potential of AI to transform their business and keep them competitive, the technology is still fairly unfamiliar to many IT and line-of-business stakeholders.

Discover the Platform for Building Production AI

Organizations like yours are realizing that AI can infuse core business functions with innovation and solve a wide spectrum of challenges resulting in improved efficiencies, cost savings, and growth.

AI-Ready Platform to Drive Business Value: Software Features

Business will be able to face your most critical challenges and meet your AI goals with 3GEN AI Enterprise. This software platform offers the following benefits:

  • Optimized for AI deployments: AI frameworks and containers for performance optimized DL/ML tools to simplify building and deploying AI. Every step of the AI workflow is streamlined - from data preparation, to training, to inference and deployment.
  • Production-ready AI: support for applications built with the extensive library of frameworks from NVIDIA, including NVIDIA RIVA, NVIDIA Merlin, NVIDIA Clara.
  • Certified for the multi and hybrid-cloud environments: certification to deploy on popular enterprise platforms, compatible with data center platforms and AI workflows that are portable
  • Ongoing access to support and expertise: full enterprise grade support for every deployment option including bare metal, virtualized, containerized, GPU and CPU, and multi cloud; support from NVIDIA AI experts during local business hours and priority notifications

Enterprise-Grade Software Platform

3Gen AI Enterprise is the operating system powered by NVIDIA so that you can have direct support from NVIDIA. As explained in the previous section, it is part of an integrated solution to streamline AI development and deployment. Some of the unique features include our broad ecosystem, quick time to production, and enterprise-grade services. Services will be detailed later in our proposal.

Optimize Workflows

3Gen AI Enterprise supports all phases of AI training and deployment: data prep with NVIDIA RAPIDS™, training at scale with NVIDIA TAO Toolkit, PyTorch and TensorFlow, optimized for inference with TensorRT®, and deployed at scale with NVIDIA Triton™ Inference Server.

AI-Enabled Applications

3GEN AI Software powered by NVIDIA AI.

Customer will have access to the extensive library of NVIDIA AI application frameworks, NVIDIA pre-trained models, and all other NVIDIA AI software available in NVIDIA NGC, which are supported with an 3GEN AI Enterprise license. 

This gives enterprises deploying business critical AI, the assurance of business continuity with NVIDIA Enterprise Support and access to NVIDIA AI experts.

AI Solution Workflows

Customer will be able to rapidly build AI-enabled applications with NVIDIA AI solution workflows including contact center intelligent virtual assistants, audio transcription, cybersecurity digital fingerprinting to detect anomalies and more.  These packaged AI workflow examples include NVIDIA AI frameworks and pre-trained models, as well as resources such as Helm Charts, Jupyter Notebooks, and documentation to help customers more easily get started in building AI-based solutions. Examples of these AI solution workflows can be seen in the graphic below:

Pretrained Models

3GEN AI Enterprise Software includes pretrained models without encryption for healthcare and vision AI tasks such as people detection, vehicle detection, federated learning model, image registration and more. By accessing these pretrained models, customers can view the weights and biases of the model which can help in model explainability and understand model bias.

Partner Ecosystem

A broad ecosystem of certified partner integrations reduces deployment risk the customer,  

  • MLOps solution providers for collaboration and productivity
  • VMware vSphere, VMware Cloud Foundation, and VMware Cloud Director to scale in virtualized environments
  • Red Hat OpenShift certification
  • HPE Ezmeral
  • Oracle Cloud Infrastructure

Develop Once, Run Anywhere

3GEN AI Enterprise delivers the same GPU-accelerated experience from anywhere, whether on-premises, in a colocation, or cloud. Customers will have the flexibility to AI workloads across different environments.

Enterprise Services

3GEN GPU Server delivers and scales services that accelerate customer success. Our services are designed around customer needs and are focused on easing any challenges that arise.

Support Services for 3GEN GPU Server

Customers will benefit from the transparency of open source with the assurance of full enterprise support and platform certification with an AI Enterprise license. While we can download the components of our NVIDIA AI stack from GitHub, for example, at no charge, support for that offering is through the community and best effort. Additionally, NVAIE support is available for every deployment option, including bare metal, virtualized, containerized, GPU and CPU, and public cloud.

Support benefits for AI applications:

  • Guaranteed SLAs and support level options for flexibility. This is a tailored offering for enterprises who want to build mission-critical applications on top of our platform and need enterprise support for their business
  • Guidance on configuration and performance, including access to engineering from NVIDIA AI experts during local business hours
  • Software upgrades on a quarterly basis which offer {{CONTACT_ACCOUNT}} with a consistent schedule for moving to the latest version of any software on NGC. This enables reliability and consistency for teams to plan around.
  • Priority notifications related to the latest security fixes and upcoming maintenance releases
  • Support upgrade options: a designated technical account manager (TAM) and/or Business Critical support for 24x7 live agent access and one hour response time for catastrophic (severity 1) issues.

Professional Services

Organizations can receive personalized support and instruction as you begin your work with 3GEN AI Enterprise. Our AI Workload Onboarding service offer is an option available to you that is designed to kickstart your NVIDIA AI Journey and get your first AI workload up and running as quickly as possible.

Education Services

Education Services provides training on NVIDIA’s enterprise-wide solutions and adjacent topics. 24+ courses are available. Training services offer the following benefits:

  • Increase ROI and shorten time-to-value for your investment into 3GEN AI Enterprise
  • De-risk your software and AI development projects by upskilling and certifying developers
  • Increase satisfaction of your developer and IT talent working with 3GEN AI Enterprise

Licensing

3GEN AI Enterprise software is available at 3GEN GPU Server on a per-CPU socket model. It can be purchased through our NVIDIA Partner Network resellers as either a perpetual license or as a subscription.

  • Perpetual licenses: purchased in conjunction with one-year, three-year, or five-year support services. The perpetual license provides the right to use the Enterprise software indefinitely, with no expiration.
  • Annual enterprise subscription: active for a fixed period as defined by the terms of the subscription license. The subscription license includes the software license and production level support services for the duration of the license subscription period. The subscription offerings are an affordable option to allow IT departments to better manage the flexibility of license volumes.

Hardware Specifications:

3Gen GPU servers have multiple options like 2xH100/H200 with Single CPU or Dual CPU , 4xH100/H200 with Dual CPU, 8xH100/H200 with Dual CPU. We support NLSAS/SAS SSD/SATA SSD/NVMe all kind of drives in 3GEN GPU Servers.

Order SKU options: -

1.       A9280-160

2.       A9480PRO-320

3.       A9480PRO- 640

4.       A9480PRO-PCI-H100

5.       A9480PRO-HGX-H200