IBM/Red Hat Leftovers


-
Automating ingest data processing with data pipelines
With the amount of data today growing ever faster—from sources ranging from device edge to offsite facilities and public and private clouds—organizations must somehow keep pace with that growth as they complete their digital-transformation journeys.
One challenge is having the right quantity and quality of data—and at the right time. With fresh, relevant data, businesses can learn quickly and adapt to changing customer behavior. However, managing vast amounts of data ingest and preparing that data to make it ready as fast as possible—preferably in real time—for analytics and AI/ML, is extremely challenging for today’s data engineers.
[...]
To achieve goals like these, Red Hat uses a combination of automated S3 object bucket notifications, a feature of the Ceph RADOS gateway (RGW) in OpenShift Data Foundation and Red Hat Ceph Storage, data-streaming services available in Red Hat AMQ, and serverless capabilities in Red Hat OpenShift.
As soon as data is ingested, the RGW sends a bucket notification to Red Hat AMQ, which creates an Apache Kafka topic that in turn delivers the notification to OpenShift Serverless. Next, OpenShift Serverless invokes the assigned function to process and apply any transformation on the incoming data.
This process can be scaled to operate on multiple incoming data streams, with each stream invoking a different serverless function. Once the data is processed, it’s stored in a data lake where data engineers and data scientists can access it.
-
IBM Clarifies Stance On Developers Working On Open-Source Projects In Off-Hours
Earlier this week was a surprising Linux kernel networking commit that removed an IBM engineer as one of the driver maintainers for the IBM Power SR-IOV Virtual NIC driver. Seemingly at issue with this VNIC driver work was the developer using his personal email address in working on the driver in his off-hours. IBM has now clarified their stance on such work.
The VNIC maintainer updating patch yielded much attention for carrying the following quoted message, "As an IBM employee, you are not allowed to use your gmail account to work in any way on VNIC. You are not allowed to use your personal email account as a "hobby". You are an IBM employee 100% of the time. Please remove yourself completely from the maintainers file. I grant you a 1 time exception on contributions to VNIC to make this change."
-
AIOps, what and why
In the past, IT operations (ITOps) teams were run by independent departments. With the advent of DevSecOps (Development, Security, Operations), integration of development and ITOps has made it easier for teams to work across departments. The growing popularity of hybrid cloud environments accelerated the growth of applications and rapid agile deployments. The increase of hybrid cloud environments in an enterprise generates significant sources of diverse data, including version control systems, code commits, CI/CD operations, automatic scans, policies, test automation systems, change requests, infrastructure and inventory, application logs, among others. In complex IT operations settings, failures are guaranteed to occur unexpectedly, making it difficult for teams to identify the root cause.
One would expect these diverse data sources to provide insight into ITOps from multiple angles. The reality is that the data from varied sources is not necessarily organized, correlated, or centralized, which makes incident resolution challenging. Site reliability engineers (SRE) who are responsible for IT operations deal with analyzing crowded dashboards populated by disparate monitoring tools and diverse data sources without a correlated and centralized source of truth. Despite having a well architected monitoring framework, it can be a herculean task to detect issues that eventually contribute to customer-impacting incidents.
-
Evolving ITOps with AIOps with no-code AI training
Gartner’s definition of AIOps: AIOps combines big data and machine learning to automate IT operations (ITOps) processes, including event correlation, anomaly detection, and causality determination.
ITOps teams are beginning to explore how automation can improve business outcomes through scalable artificial intelligence (AI). Gartner found that 10 times more business leaders will rely on AIOps platforms for automated insights in the next three years. Without it, IT organizations can experience a lack of observability, become overwhelmed from manually managing data, and end up focusing on infrastructure rather than an application-centric approach. The ITOps teams of tomorrow will experience full visualization and observability of their IT environments with insights derived from various tools that focus on critical applications to support business performance.
-

- Login or register to post comments
Printer-friendly version- 4577 reads
PDF version
More in Tux Machines
- Highlights
- Front Page
- Latest Headlines
- Archive
- Recent comments
- All-Time Popular Stories
- Hot Topics
- New Members
digiKam 7.7.0 is released
After three months of active maintenance and another bug triage, the digiKam team is proud to present version 7.7.0 of its open source digital photo manager. See below the list of most important features coming with this release.
|
Dilution and Misuse of the "Linux" Brand
|
Samsung, Red Hat to Work on Linux Drivers for Future Tech
The metaverse is expected to uproot system design as we know it, and Samsung is one of many hardware vendors re-imagining data center infrastructure in preparation for a parallel 3D world.
Samsung is working on new memory technologies that provide faster bandwidth inside hardware for data to travel between CPUs, storage and other computing resources. The company also announced it was partnering with Red Hat to ensure these technologies have Linux compatibility.
|
today's howtos
|








.svg_.png)
Content (where original) is available under CC-BY-SA, copyrighted by original author/s.

IBM reaffirms support for open-source devs after internal Linux
IBM reaffirms support for open-source devs after internal Linux kernel maintainer argument goes public