[Issue 7689] splitter() on ivalid UTF-8 sequences

[d-bugmail at puremagic.com]

http://d.puremagic.com/issues/show_bug.cgi?id=7689


monarchdodra at gmail.com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |ASSIGNED
                 CC|                            |monarchdodra at gmail.com
         AssignedTo|nobody at puremagic.com        |monarchdodra at gmail.com


--- Comment #1 from monarchdodra at gmail.com 2012-10-22 23:06:22 PDT ---
(In reply to comment #0)
> Is this difference/inconsistency between split() and splitter() desired and
> good?
> 
> 
> import std.string, std.array, std.algorithm, std.range;
> void main() {
>     char[] s = cast(char[])[131, 64, 32, 251, 22];
>     assert(std.string.split(s).length == 2); // no error
>     assert(walkLength(std.array.splitter(s)) == 2); // Invalid UTF-8 sequence
>     assert(walkLength(std.algorithm.splitter(s)) == 2); // Invalid UTF-8
> sequence
> }
> 
> 
> Output, DMD 2.059head:
> 
> std.utf.UTFException at std\utf.d(645): Invalid UTF-8 sequence (at index 1)
> ----------------
> ...\dmd2\src\phobos\std\array.d(469): dchar
> std.array.front!(char[]).front(char[])
> ...\dmd2\src\phobos\std\algorithm.d(2110): D3std9algorithm47__T8splitterS28...
> ...\dmd2\src\phobos\std\range.d(971): D3std5range97__...
> ----------------

This is a bug in string.split (which is actually a public import of
array.split).

Currently array.split only supports ascii white, and is oblivious to longer utf
whites (but it does work on unicode).

-- 
Configure issuemail: http://d.puremagic.com/issues/userprefs.cgi?tab=email
------- You are receiving this mail because: -------