[help] How to get the total number of tokens of a tagged spoken corpus?

walterzhao · 2006-09-04

Thanks to help from www.corpus4u.org, i have the corpus of SBCSAE, but how can I count the total token number of it since it's annotated?

xujiajin · 2006-09-05

回复: [help] How to get the total number of tokens of a tagged spoken corpus?

Strip off the tags and calculate it via WordSmith.

walterzhao · 2006-09-06

回复: [help] How to get the total number of tokens of a tagged spoken corpus?

Thanks, is there any convenient way to strip off tags?