Red Hat Leftovers
-
Red Hat Official ☛ Evaluating LLM inference performance on Red Bait OpenShift AI
The generative artificial intelligence (AI) landscape has undergone rapid evolution over the past year. As the power of generative large language models (LLMs) grows, organizations increasingly seek to harness their capabilities to meet business needs. Because of the intense computational demands of running LLMs, deploying them on a performant and reliable platform is critical to making cost-effective use of the underlying hardware, especially GPUs.
-
Red Hat Makes IDP Based on Backstage Generally Available [Ed: Red Hat is paying this site for these puff pieces]
Red Hat made generally available a developer hub based on the open source Backstage platform originally developed by Spotify.
-
Red Hat Official ☛ Synchronizing software between Red Hat Satellite servers
Red Hat Satellite features multiple methods of synchronizing software from the Red Hat Content Delivery Network (CDN). The intention is to adapt Satellite to your requirements for regularly importing content outside your organization's firewall. Some organizations permit the import of data across networks through a DMZ. Others demand more security and maintain an "air gap," where data must be copied onto removable media and walked across a self-contained network.
-
Red Hat Official ☛ Continuous performance and scale validation of Red Hat OpenShift AI model-serving stack
The model serving stack included in OpenShift AI is generally available (GA) as of December 2023 (release 2.5), meaning that OpenShift AI is fully operational to deploy and serve inference models via the KServe API. You may have read my colleague David Gray's article about the performance of this model serving stack for large language models (LLMs). This article provides a different look at that same model serving stack. It discusses how we stress tested the model deployment and model serving controllers to confirm that they perform and scale well in single-model, multi-model and many-model environments.
-
Red Hat Official ☛ Containerized Ansible Automation Platform update