India, Aug. 21 -- Cloudera has announced native GPU acceleration for Apache Spark 4.1 in Cloudera Data Engineering, enabled by the NVIDIA CUDA-X library, cuDF. The NVIDIA cuDF plug-in for Apache Spark will support the just-announced Cloudera Anywhere Cloud, which is designed to enable organizations to accelerate Spark workloads without rewriting PySpark or SQL code. This helps data teams prepare AI-ready data faster while reducing cloud infrastructure costs across hybrid environments.

As organizations expand AI initiatives, the speed of data preparation has become a critical challenge. Large-scale Spark workloads often take hours to complete, delaying analytics and AI applications while driving up cloud compute costs. By embedding GPU a...