[Issue 20971] New: When parsing identifiers, unicode LS and PS are considered an error

[d-bugmail at puremagic.com]

https://issues.dlang.org/show_bug.cgi?id=20971

          Issue ID: 20971
           Summary: When parsing identifiers, unicode LS and PS are
                    considered an error
           Product: D
           Version: D2
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: P1
         Component: dmd
          Assignee: nobody at puremagic.com
          Reporter: stanislav.blinov at gmail.com

According to grammar, LS and PS (0x2028 and 0x2029) are EndOfLine. But, if
encountered while parsing an identifier, they're rejected as 'not allowed in
identifier':

// ASCII end of line parses fine
int ascii
;
int ls
; // char 0x2028 not allowed in identifier
int ps
; // char 0x2029 not allowed in identifier

--