반도체 AI 보안 인더스트리 4.0 SDV 스마트 IoT 컴퓨터 통신 특수 가스 소재 및 장비 유통 e4ds plus

​Arm, CSS, Kleidi Software Announced...Mobile AI Optimization

기사입력2024.05.30 14:06



"AI Transition, Concentrated into AI Smartphones and AI PCs"
Arm CPU/GPU, AI Mobile Computing Implementation
Kleidi Launches, Supporting AI Framework Developers


Arm, which provides total support for AI-based computing solutions from hardware to software, recently launched AI-optimized infrastructure and solutions suitable for mobile and Android.

Arm held an online media briefing on the 30th and announced Arm Kleidi along with the Arm Compute Subsystem (CSS) for clients.

Arm CSS for clients provides the fundamental compute elements for flagship mobile systems-on-chips (SoCs). Featuring the latest Armv9 CPUs, Immortalis GPUs, physical implementations for CPUs and GPUs capable of being manufactured at 3nm, and the latest Corelink system memory management unit (SMMU).

Arm Kleidi includes KleidiAI for AI workloads and KleidiCV for computer vision applications.

“The recent AI transition is centered around AI smartphones and AI PCs,” said Hwang Sun-wook, president of Arm Korea. “We have recently discovered new AI use cases and form factors, and AI is redefining the smartness of smartphones.”

“Arm is the foundation for next-generation compute performance demands and provides a comprehensive, developer-friendly instruction set for a massive compute ecosystem,” said Huang. “Market demands are culminating in an energy-efficient Arm architecture.”

■ Implementing AI mobile computing with Arm CPU and GPU

Arm CSS for client delivers 59% improved AI inference performance for AI, machine learning, and computer vision (CV) workloads, with 30% improved compute and graphics performance.

At the heart of CSS for clients is Arm’s multi-purpose CPU cluster, designed to maximize performance and power efficiency. The newly launched Arm Cortex-X925 delivers the biggest year-over-year performance increase in Cortex-X history. Leveraging the cutting-edge 3nm process node with a clock speed of 3.8GHz and maximum cache size, this could yield a whopping 36% improvement in single-threaded performance compared to a 2023 smartphone flagship 4nm SoC.

For AI, Cortex-X925 delivers a 41% performance boost, improving the responsiveness of on-device generated AI such as large-scale language models (LLMs).

Arm’s new Cortex-A725 CPU combines cutting-edge efficiency to deliver up to 35% performance improvement for AI and mobile gaming use cases. This is supported by the Arm Cortex-A520 CPU and the updated DSU-120 for consumer devices adopting the latest Armv9 CPU clusters.

Arm’s new Immortalis-G925 GPU, with its high performance and efficiency, delivers up to 37 percent higher performance across a wide range of leading mobile gaming applications, and up to 34 percent higher performance when measured across multiple AI and machine learning networks.

While the Immortalis-G925 is targeted at the flagship smartphone market, the new, highly scalable GPU family, the Arm Mali-G725 and Mali-G625 GPUs, target a broad range of consumer device markets, from premium mobile handsets to smartwatches and XR wearables.

■ Arm Kleidi Launch, Support for AI Framework Developers

Arm is ready to support developers around the world with the performance, tools, and software libraries they need to create the next generation of AI-enabled applications.

Arm launched Arm Kleidi, which includes KleidiAI for AI workloads and KleidiCV for computer vision applications. KleidiAI is a set of compute kernels for AI framework developers that support key Arm architecture features such as NEON, SVE2, and SME2, enabling them to seamlessly leverage the highest performance possible on Arm CPUs across a wide range of devices.

KleidiAI integrates with popular AI frameworks such as PyTorch, TensorFlow, MediaPipe, and Metarama 3, and is backwards compatible with additional technologies that Arm releases in the future.