threads, fibers and GPU kernels

[John Colvin via Digitalmars-d]

On Monday, 7 August 2017 at 08:57:35 UTC, Nicholas Wilson wrote:
> On Monday, 7 August 2017 at 07:38:34 UTC, Suliman wrote:
>> Modern GPU have thousands of GPU kernels, it's far from CPU 
>> kernels, but it's interesting for me is there any chance that 
>> in future they be used in same maner as CPU kernels?
>
> Do you mean threads? Not really, they are more like SIMD lanes 
> that together are more analogous to a CPU thread. See John 
> Colvin's 2015/2016 DConf talks.
>

As deadalnix reminded me after my 2016 talk, the wider picture of 
the GPU is SIMT, not SIMD, but from a computation point of view I 
find I don't need to conceptually separate the two so much. In my 
experience, most things that work well on GPU end up working very 
like SIMD on an OoO CPU when you do them right, even if they 
don't look like it in the code.