Al 0689f936c9 [tokenization] scanner/tokenizer (generated with re2c)

2015-03-03 12:35:22 -05:00

..

klib

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

sds

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

utf8proc

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

file_utils.c

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

file_utils.h

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

scanner.c

[tokenization] scanner/tokenizer (generated with re2c)

2015-03-03 12:35:22 -05:00

scanner.h

[tokenization] scanner/tokenizer (generated with re2c)

2015-03-03 12:35:22 -05:00

scanner.re

[tokenization] scanner/tokenizer (generated with re2c)

2015-03-03 12:35:22 -05:00

string_utils.c

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

string_utils.h

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

token_types.h

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

tokens.c

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00

tokens.h

[utils] string utils, file utils, contiguous arrays of strings used for storing tokenized strings, klib for generic hashtables and vectors, antirez's sds for certain types of string building, utf8proc for iterating over utf-8 strings and unicode normalization

2015-03-03 12:33:13 -05:00