ENSEMBLE BASED CLUSTER TUNING AND FRAMEWORK FALLBACK FOR AI ACCELERATORS USING TELEMETRY, COMPUTE, AND TEMPERATURE METRICS

Systems, apparatuses and methods may provide for technology that identifies telemetry data associated with an execution of a cluster of artificial intelligence (AI) operations on an accelerated backend system, wherein the telemetry data includes one or more of temperature classifier data, compute classifier data or failure data, and determines whether to send a current instance of the cluster of AI operations to the accelerated backend system or a default backend system based on the telemetry data.