Compiler Operations for Tensor Streaming Processor

Patent №

US 11,645,226

Granted

2023-05-09

Filed 2022

Owner

GROQ, INC.

Lab

AI components

1

hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17697201

Embodiments are directed to a processor having a functional slice architecture. The processor is divided into tiles (or functional units) organized into a plurality of functional slices. The functional slices are configured to perform specific operations within the processor, which includes memory slices for storing operand data and arithmetic logic slices for performing operations on received operand data (e.g., vector processing, matrix manipulation). The processor includes a plurality of functional slices of a module type, each functional slice having a plurality of tiles. The processor further includes a plurality of data transport lanes for transporting data in a direction indicated in a corresponding instruction. The processor also includes a plurality of instruction queues, each instruction queue associated with a corresponding functional slice of the plurality of functional slices, wherein the instructions in the instruction queues comprise a functional slice specific operation code.

AI hardwareG06F 15/825G06N 3/063G06F 9/3001G06F 9/3851G06N 20/00

AI classification

AI hardware1.00
Vision0.00
Natural language0.00
Evolutionary computation0.00
Knowledge representation0.00
Machine learning0.00
Planning0.00
Speech0.00

Ownership

GROQ, INC.

assignment · 624960764

Assignors

ABTS, DENNIS CHARLES, ROSS, JONATHAN ALEXANDER, THOMPSON, JOHN, THORSON, GREGORY MICHAEL

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC