51 Commits

Author	SHA1	Message	Date
Al	3939dd0ca6	[fix] cstring_array_split calls	2016-12-12 11:37:27 -05:00
Al	b1816e9b70	[utils] Adding cstring_array_split_ignore_consecutive	2016-12-12 11:37:27 -05:00
Al	98c395d34c	[numex] Concatenating a string of numeric expressions with no intervening tokens like Seventeen Eighty or Ten Oh Four	2016-02-10 09:21:31 -05:00
Al	7b300639f1	[fix] Trie prefix search tail comparison	2016-01-17 20:56:37 -05:00
Al	0d5cf0d6d7	[utils] char_array_cat_printf was forcing a doubling of the size of the buffer, which is bad if calling many times. Now only initiates a realloc if the char_array is almost full. Also adding cstring_array_from_strings which takes a list of char *s	2016-01-06 22:56:01 -05:00
Al	d0aaff1482	[utils] string_equals with NULL check	2015-12-01 13:12:08 -05:00
Al	40918812e2	[normalize] Adding hyphen elimination as a string option (changes tokenization)	2015-10-27 13:32:47 -04:00
Al	6428c0ae20	[utils] cstring_array_cat	2015-10-03 16:00:13 -04:00
Al	3fab0f984f	[fix] fixing some compiler warnings, using type-specific abs functions for vector_math	2015-09-19 16:11:09 -04:00
Al	35b9122a1a	[utils] inlining a few functions	2015-09-10 16:33:54 -07:00
Al	0ddf50cb5f	[utils] add to feature array with printf syntax	2015-09-10 10:24:51 -07:00
Al	b3f89a207a	[utils] Version of string_split for single character delimiters which modifies the input string directly rather than creating (essentially) a copy	2015-09-09 18:07:31 -07:00
Al	9d2ca08fc2	[utils] Adding _copy and _new_copy methods to vectors (the former copies data to a pre-allocated vector, the latter allocates a new vector)	2015-09-06 21:01:26 -07:00
Al	a13e5117b5	[utils] string_tree_num_strings method	2015-08-10 17:46:37 -04:00
Al	064b6b5898	[utils] char_array_append_reversed for adding reversed strings without a malloc	2015-08-10 16:10:05 -04:00
Al	9b69d1f67a	[fix] Removing C++ checks from all but the main API functions	2015-08-07 17:15:39 -04:00
Al	3178eda501	[utils] string_contains_hyphen method	2015-08-02 14:35:18 -06:00
Al	7aee159c0c	[utils] string_tree_num_tokens	2015-07-27 12:36:34 -04:00
Al	b94526a27b	[utils] Making string_trim handle all kinds of UTF-8 whitespace/separators	2015-07-27 01:55:46 -04:00
Al	93042761ac	[fix] warnings in string_utils.c	2015-07-26 23:36:03 -04:00
Al	a67ec44a08	[utils] cstring_array_terminate, moving msgpack_utils to separate file	2015-07-25 18:41:02 -04:00
Al	2adaf475c2	[utils] cstring_array (contiguous) to array of malloc'd strings	2015-07-25 12:14:01 -04:00
Al	f713c53993	[utils] Adding an option to char_array_add_joined to strip separators for path manipulation	2015-07-16 03:49:00 -04:00
Al	d7f73e62f1	[utils] Adding cstring_array_clear method	2015-07-06 12:48:26 -04:00
Al	b58877ec6c	[utils] string_is_lower/string_is_upper method	2015-07-01 14:49:22 -04:00
Al	a5dacf3d2b	[utils] Adding method to get a particular token alternative from a string tree	2015-06-28 15:15:29 -04:00
Al	82e85732c4	[fix] Setting codepoint in utf8proc_iterate_reversed	2015-06-25 17:20:55 -04:00
Al	bcee9832b3	[utils] cstring_array_get_token=>cstring_array_get_string	2015-06-25 10:05:35 -04:00
Al	7dd772de0f	[fix] implementation of cstring_array_split	2015-06-23 02:11:24 -05:00
Al	8520df96c8	[utils] utf8 comparison can handle a non-valid UTF-8 sequence e.g. for trie suffix comparison where we may be in the middle of a multi-byte character. Adding a standard utf8_common_prefix method	2015-06-12 16:11:40 -04:00
Al	3442b9ad92	[utils] require at least one non-space/non-hyphen match in utf8_common_prefix_len_ignore_separators	2015-06-12 11:19:37 -04:00
Al	ab5ea6d791	[utils] Common prefix-style return value instead of a utf8 strcmp	2015-06-11 10:59:51 -04:00
Al	aad5f3edd3	[utils] UTF-8 lowercasing and string comparison, including a version which ignores dashes/spaces	2015-06-10 18:27:14 -04:00
Al	81be8e771e	[numex] regen data file. utf8_is_hyphen requires a character, all other methods use category	2015-06-08 21:32:38 -04:00
Al	06835d5c37	[utils] string_utils category functions take a category instead of a codepoint	2015-06-06 20:41:07 -04:00
Al	114b728f96	[fix] var	2015-06-04 17:18:05 -04:00
Al	528dd05983	[numex] Adding utf8_is_number_or_letter	2015-06-04 14:49:12 -04:00
Al	ca746304e3	[utils] Adding a few methods to string_utils for finding utf8proc category groups	2015-06-04 13:20:14 -04:00
Al	8ac8f83b7f	[utils] changing signature of utf8proc_iterate_reversed so it takes the same arguments as utf8proc_iterate for function pointer purposes	2015-05-25 15:35:28 -04:00
Al	bfb9aa21a1	[fix] unused var	2015-05-19 18:04:06 -04:00
Al	58571f70cc	[utils] adding a boolean flag on string tree iterators for single path trees	2015-05-18 13:57:11 -04:00
Al	e8fdd4564d	[utils] adding string_tree for listing sets of token alternatives and string_tree_iterator to generate permutations over the strings, needed for transliteration and ambiguous address elements/place names	2015-05-16 23:16:10 -04:00
Al	e21873635c	[utils] Using token offsets to calculate lengths for contiguous string arrays, inlining a few functions	2015-04-15 20:17:03 -04:00
Al	0234754c20	[fix] warnings in string_utils	2015-04-12 12:16:32 -04:00
Al	4729dfe178	[utils] string_[rl]strip => string_[rl]trim, removing warning about allocation	2015-04-06 02:19:19 -04:00
Al	198e51b8a3	[utils] more/better char_array methods	2015-04-05 22:01:46 -04:00
Al	5f3d74de18	[fix] contiguous string array	2015-04-03 11:22:50 -04:00
Al	c81aa72254	[utils] a few changes to contiguous string arrays	2015-04-01 19:02:11 -04:00
Al	1ac4438e39	[utils] More consistent naming in string_utils	2015-03-27 21:12:08 -04:00
Al	70195fffd5	[utils] new methods on string_utils for better dynamic strings which retains the benefits of sds without having to worry about the pointer changing, renaming contiguous string array methods to something more succinct	2015-03-27 20:55:36 -04:00