A typical runtime consists of the following parts:
The Compiled class is responsible for initializing and managing a device.
::: tinygrad.device.Compiled options: members: [ "synchronize" ] show_source: false
The Allocator class manages memory on the device and caches allocated buffers for reuse.
::: tinygrad.device.Allocator options: members: true show_source: false
The Program class is created for each loaded program. It is responsible for executing the program on the device. As an example, here is a CPUProgram implementation which loads program and runs it.
::: tinygrad.runtime.ops_cpu.CPUProgram options: members: true
The Compiler class compiles the output from the Renderer and produces it in a device-specific format.
::: tinygrad.device.Compiler options: members: true