Pandas like features

Russel Winder russel at winder.org.uk
Fri Oct 30 12:15:58 UTC 2020


On Fri, 2020-10-30 at 10:12 +0000, jmh530 via Digitalmars-d wrote:
> 
[…]
> I think the point on multi-threaded Python came away as a big 
> complaint there. Lots of mentions of the GIL or people being 
> CPU-bound. Pandas was mentioned in this context as well.

<< I haven't properly read the blog entry as yet. Sorry. >>

Guido saw (cf. he and I had a long "discussion" at EuroPython 2010, there were
many witnesses) GIL as absolutely fine for CPython in perpetuity, that if Pypy
came up with a GIL-free VM then that would be fine. His mindset was (and I
suspect may still be) that Python code was/is not about being CPU bound code,
it was/is about sequential and concurrent, not parallel for performance, code.
As long as there is NumPy and other PVM extensions, or use of message passing
between processes, that allow for GIL-free parallel, CPU bound processing, it
is hard to say Guido was/is wrong. (And in 2010 it was even harder :-) )

Having thought about it on and off for a decade, I am happy with the status
quo around Python. Python code is (or should be) highly maintainable code
designed for execution on a single threaded VM, easily understood and amended.
Anyone trying to do CPU bound code using Python is "doing it wrong". Whether D
is the right alternative, or a language such as Chapel is better, is a moot
point.

Pandas is build on NumPy and so has the same parallelism properties as any
other NumPy realised package.

-- 
Russel.
===========================================
Dr Russel Winder      t: +44 20 7585 2200
41 Buckmaster Road    m: +44 7770 465 077
London SW11 1EN, UK   w: www.russel.org.uk

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: This is a digitally signed message part
URL: <http://lists.puremagic.com/pipermail/digitalmars-d/attachments/20201030/31987111/attachment.sig>


More information about the Digitalmars-d mailing list