SegmentAnt is a freeware Japanese and Chinese segmenter (segmentation/tokenizing tool). SegmentAnt takes either an input text or an input list of text fi les (UTF-8 encoded) and splits the texts into 'tokens" separated by either half, width or full, width spaces .
