[tokenization] Adding url, email, US/international phone numbers, a separate type for ideographic numbers, more general quotes, paren types

Browse Source

...

This commit is contained in:

Al

2015-03-24 16:43:53 -04:00

parent 50187f28ce

commit 2d1c24a6e9

4 changed files with 298633 additions and 262454 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

560979

src/scanner.c

File diff suppressed because it is too large Load Diff