tokenizer_words_and_emoticons

tokenizer_words_and_emoticons(text)

Convert text to lowercase words and emoticons.

Examples

>>> tokenizer_words_and_emoticons('</a>This :) is :( a test :-)!')

['this', 'is', 'a', 'test', ':)', ':(', ':-)']

For more usage examples, please see http://rasbt.github.io/mlxtend/user_guide/text/tokenizer_words_and_emoticons/