Nutanix has announced a GPT-in-a-Box solution for those looking to jump-start their artificial intelligence (AI) and machine learning (ML) innovation, while maintaining control over their data. The new offering is a full-stack software-defined AI-ready platform, along with services to help organisations size and configure hardware and software infrastructure suitable to deploy a curated set of large language models (LLMs) using the leading open source AI and MLOps frameworks on the Nutanix Cloud Platform.

It allows customers to easily procure AI-ready infrastructure to fine-tune and run generative pre-trained transformers (GPT), including LLMs at the edge or in their data centre.

Many enterprises are grappling with how to quickly, efficiently and securely take advantage of the power of generative AI and AI/ML applications, especially for use cases that cannot be run in the public cloud because of data sovereignty, governance and privacy concerns. New use cases emerge every day as organisations look to leverage generative AI to improve customer service, developer productivity, operational efficiency and more.

From automated transcription of internal documents, to high speed search of multimedia contents, and automated analysis, many organisations see the opportunity with AI but are struggling with growing concerns regarding intellectual property leakage, compliance and privacy.

Additionally, organisations looking to build an AI-ready stack often struggle with how to best support ML administrators and data scientists, while the prospect of large AI investment costs has enterprises stalled in their AI and ML strategy.

The Nutanix GPT-in-a-Box solution includes:

• The Nutanix Cloud Infrastructure platform, with the Nutanix Files Storage and Objects Storage solutions, the Nutanix AHV hypervisor and Kubernetes, along with NVIDIA GPU acceleration, which can be sized for large to small scale.
• Nutanix services to help customers size their cluster and deploy an opinionated stack with the leading open source deep learning and MLOps frameworks, inference server, and a curated set of large language models such as Llama2, Falcon and MPT.
• Ability for data scientists and ML administrators to immediately consume these models with their choice of applications, enhanced terminal UI, or standard CLI.
• The platform can also be leveraged to run other GPT models, as well as fine tune these models leveraging internal data, hosted on included Nutanix Files or Objects Storage services.

https://www.nutanix.com/blog/nutanix-simplifies-your-ai-innovation-learning-curve