Adaptive Data Reliability Engineering For AI-Driven Cloud Ecosystems

Authors

  • Dillep Kumar Pentyala Sr. Data Reliability Engineer, Farmers Insurance, 6303 Owensmouth Ave, Woodland Hills, CA 91367, UNITED STATES

Keywords:

Adaptive Data Reliability, Data Engineering, Fault Tolerance,, Anomaly Detection, AI-Driven Cloud Ecosystems

Abstract

But even in the age of AI-driven cloud ecosystems, we continue to grapple with how to maintain data reliability when workloads are constantly shifting, data comes from many places, and the real-time expectation is often acute. Data reliability methods that are used in traditional approaches do not fully address the issues that arise with data in these environments. This research outlines an adaptive data reliability engineering model to AI cloud platforms specially designed for such environments. That is why, by using anomaly detection in real time, errors detecting and redundancy control algorithms, the framework is very flexible in dealing with changing data and provides an extreme reliability. Declarative concepts of consistency, availability, and tolerance to faults are clearly described and instrumented based on a set of benchmark test applications and realistic workloads. The studies also show better results regarding data to noise ratios and guarantee these improvements compared to conventional practices with the framework pointing to the prospect of improving efficacy and robustness of AI applications hosted on the cloud. But besides it being relevant, this study also fills gaps in current knowledge and creates the groundwork for future innovations in adaptive reliability engineering for industries that depend on sound data systems.

Downloads

Published

2022-12-31