mir-stat

[Andre Pany]

On Thursday, 8 October 2020 at 18:17:30 UTC, jmh530 wrote:
> On Thursday, 8 October 2020 at 17:53:53 UTC, Andre Pany wrote:
>> [snip]
>>
>> Thanks for this great piece of software. Does Mir provides 
>> s.th. similar like Pandas DataFrame, especially the feature to 
>> give columns a name and marking as inde x columns?
>>
>> Kind regards
>> Andre
>
> Magpie [1] was an initial effort as a summer of code project. 
> The last commit was September 2019.
>
> There is also some basic support in mir (example at [2]). Ilya 
> can speak more about long-term plans for enhancing that.
>
> One limitation in mir is that Slice's only allow for the same 
> type throughout. For instance, a Slice!(double*, 1u) is a 
> 1-dimensional slice of doubles. Data frames in R or Pandas 
> DataFrames allow for columns with different types, so for 
> instance you can calculate some summary statistic based on some 
> category (like color). So to really get the same functionality, 
> you need to support slices with heterogeneous types.
>
> [1] https://github.com/Kriyszig/magpie
> [2] 
> https://github.com/libmir/mir-algorithm/blob/f30ccd9f7abc63166c9179e04b2817bf656764bd/source/mir/ndslice/allocation.d#L330

Thanks for these info. Magpie looks huge and really useful. I 
will give it a try.

I am also highly interested in the long term plans of Mir, as you 
explained the current limitations. Still in my scenario it is 
always the same type. A 2d array of doubles, read from parquet 
files, transformed and written into a new parquet file.

Kind regards
Andre