Red Hat Expands Enterprise AI Capabilities with Enhanced Red Hat AI Platform

Red Hat, Inc., the world’s leading provider of open-source solutions, has announced the latest updates to Red Hat AI, its suite of products and services designed to accelerate AI solution development and deployment across hybrid cloud environments. The updated platform enhances efficiency, simplifies AI experiences, and offers deployment flexibility.

Addressing Enterprise AI Challenges

Businesses face growing challenges in deploying large language models (LLMs) at scale while integrating them with proprietary data across diverse environments, including data centers, public clouds, and edge computing. Red Hat AI tackles these issues by providing an enterprise AI platform optimized for model training and inference, ensuring cost-effectiveness and seamless integration.

Key Components of Red Hat AI

Red Hat OpenShift AI

Red Hat OpenShift AI offers a comprehensive AI platform for managing predictive and generative AI lifecycles across hybrid cloud environments. With built-in machine learning operations (MLOps) and large language model operations (LLMOps), OpenShift AI simplifies AI model management.

The latest release, Red Hat OpenShift AI 2.18, introduces several enhancements:

  • Distributed Serving: The vLLM inference server enables IT teams to split model serving across multiple GPUs, improving efficiency and reducing costs.
  • End-to-End Model Tuning: Leveraging InstructLab and OpenShift AI data science pipelines, this feature simplifies fine-tuning LLMs for large-scale environments.
  • AI Guardrails: A technology preview feature that enhances accuracy and security by monitoring AI-generated outputs for potential risks.
  • Model Evaluation: The lm-eval component benchmarks AI model performance across various reasoning tasks to refine and optimize results.

Red Hat Enterprise Linux AI (RHEL AI)

RHEL AI offers a foundation model platform designed for developing, testing, and running LLMs efficiently across enterprise applications. It features:

  • Granite 3.1 8B Model Support: A new addition to the open-source Granite model family, enhancing multilingual capabilities and improving AI inference.
  • Graphical User Interface for Model Contributions: A preview feature simplifying data ingestion and AI customization.
  • Document Knowledge-Bench (DK-bench): A benchmarking tool for comparing AI models fine-tuned with enterprise-specific data.

Red Hat AI InstructLab on IBM Cloud

Designed for enterprises prioritizing AI accuracy and security, Red Hat AI InstructLab on IBM Cloud enables organizations to build efficient AI models while retaining full control of their data.

No-Cost AI Foundations Training

To support AI adoption, Red Hat offers free AI Foundations training courses. These courses provide senior leaders and AI novices with insights into leveraging AI for business transformation and innovation.

Availability

Red Hat OpenShift AI 2.18 and RHEL AI 1.4 are now generally available. Red Hat AI InstructLab on IBM Cloud will launch soon. For more details, visit Red Hat AI.