ATOM™

5nm Versatile Inference SoC

Versatile yet Energy Efficient
AI System-on-Chip

Description

World’s Best Inference Performance
for Edge and Cloud Computing

Competing against state-of-the-art AI accelerators, ATOM™ delivers uncompromised inference performance across different types of ML tasks, computer vision, natural language processing and recommendation models. ATOM™ utilizes the silicon-proven neural core, ION™, as a compute granule that scales up with perfect linearity for large- scale inference operations required in edge computers and datacenters.

Bridging Latency-Critical ML Tasks
and Hyper-Scale ML Services

ATOM™ combines ML specialized dataflow architecture and many-core SoC architecture to bring the best inference performance with SR-IOV based user-level parallelization.
In order to minimize the latency overhead for data communication and synchronization in inter-/intra- chip orchestrations, ATOM™ adopts our proprietary multi-level dependency control mechanisms and interrupt protocol that enhance overall system utilization by up to 40% of total end-to-end inference latency.
ATOM™ processor is a key enabler for enterprise/ personal server-level AI services, perfecting the customers’ AI-as-a-Service (AIaaS) stack.

Advanced Manufacturing

ATOM™ is built with Samsung Electronics’ most advanced EUV process node, delivering the best performance and energy efficiency.
Geared with PCIe Gen5 and GDDR6 high-speed IO technologies, the ATOM™ processor can serve different markets, spanning from edge computer to datacenters.

Performance

MLperf™

Inference v3.0 (Latest), Single Stream Latency

ATOM™ readily supports the most advanced Al networks, including state-of-the-art GPT language models. Built with the most advanced silicon technology, ATOM™ delivers the best-in-class performance and energy efficiency.

Vision : ResNet50

  • Rebellions ATOM™
    1.0x 0.239ms
  • Qualcomm Cloud AI100
    1.4x 0.336ms
  • NVIDIA A2 (Ampere)
    3.0x 0.713ms
  • NVIDIA T4 (Turing)
    3.4x 0.818ms

* Shorter the faster

Language : BERT-Large

  • Rebellions ATOM™
    1.0x 4.297ms
  • Qualcomm Cloud AI100
    1.8x 7.547ms
  • NVIDIA A2 (Ampere)
    2.0x 8.506ms
  • NVIDIA T4 (Turing)
    1.4x 6.093ms

* Shorter the faster

Key features

ION™ Core
Architecture

Rebellions’ silicon-proven AI core delivers outstanding performance owing to its highly utilized dataflow and efficient hardware implementation.
The AI core can readily handle networks with different depths and complexities from tiny applications to datacenter-level services.
Energy efficiency is maximized by implementing a low-power design methodology and using tidy core structures.

System-on-chip
Architecture

With ION™ Core tightly orchestrated with an internal command processor, ATOM™ accelerates both large and small networks with outstanding efficiency. The overhead of extra communication is neatly hidden by the on-chip level control and data dependency handling.

Supporting
Networks

ATOM™ can accelerate different types of neural networks efficiently, including convolutional neural networks (CNNs), long short-term memory (LSTM), bidirectional encoder representations from transformers (BERT) and recent transformer networks (e.g. T5, GPTs, etc.).

Multi-Instance
NPU (MIN)

ATOM™ can be partitioned to support up to 16 jobs simultaneously, isolated at different HW/SW levels.
This feature provides a clear competitive advantage to service providers by boosting the user capacity and the effective usage of computing farms.

System specs

Single Chip
FP16
32 TFLOPS
INT8
128 TOPS
On-chip SRAM
64 MB
Max Thermal Design Power (TDP)
30 - 130W (Configurable)
Memory
16 GB, GDDR6 (ECC enabled), 256 GB/s
Host / Chip-to-Chip Interface
PCIe Gen5, 64 GB/s
Multi-Instance NPU
HW isolation up to 16 independent tasks

See also...

markets-ion

ION™

Elevating HFT Market Performance

At ION™, we firmly believe that the High-Frequency Trading (HFT) market can truly make a difference with just 1 microsecond of improved performance. Fueled by this conviction, our dedicated team embarked on a journey that led to the creation and launch of our groundbreaking product, ION™, specifically tailored for the finance industry. Within just one year of our team's inception, we introduced this powerful solution to the market, marking a significant milestone in our pursuit of technological excellence.
Explore ION™