phobos src level stats

[Bruce Carneal]

On Wednesday, 23 September 2020 at 00:48:16 UTC, Bruce Carneal 
wrote:
> On Tuesday, 22 September 2020 at 23:22:42 UTC, DlangUser38 
> wrote:
>> On Tuesday, 22 September 2020 at 21:01:17 UTC, Bruce Carneal 
>> wrote:
>>> [...]
>>
>> you can count empty lines using a sliding window of two token 
>> over the token range.
>> The difference between the two token position give empty line. 
>> string literal and comments require a special processing but 
>> otherwise this is quite straightforward to implement.
>
> So, a way to stay in "token space" then.  Don't see a problem 
> with the above but will note for future apps that I need not 
> drop back to raw text.

Ah, the problem would be empty lines within docs or comments that 
are counted when they've already been accounted for in the 'docs' 
and 'comments' sections.  I'll revise the code.