LOCNESS corpus: US-UK students" writing
- 主题发起人 xiaoz
- 时间
回复：LOCNESS corpus
LOCNESS 4-8-gram lists (zipped, for WST3)
http://www.corpus4u.org/upload/forum/2005070901052455.zip
LOCNESS 4-8-gram lists (zipped, for WST3)
http://www.corpus4u.org/upload/forum/2005070901052455.zip
Lexical bundles, also called lexical chains or multiword units, are closely associated with collocations and have been an important topic in lexical studies (e.g. Stubbs 2002). More recently, Biber found that lexical bundles are also a reliable indicator of register variation (e.g. Biber and Conrad 1999; Biber 2003). Biber and Conrad (1999), for example, showed that the structural types of lexical bundles in conversation are markedly different from those in academic prose. Biber’s (2003) comparative study of the distribution of 15 major types of 4-word lexical bundles (technically known as 4-grams) in the registers of conversation, classroom teaching, textbooks and academic prose indicates that lexical bundles are significantly more frequent in the two spoken registers. The distribution of lexical bundles in different registers also varies across structural types. In conversation, nearly 90% of lexical bundles are declarative or interrogative clause segments. In contrast, the lexical bundles in academic prose are basically phrasal rather than clausal. Of the four registers in Biber’s study, lexical bundles are considerably more frequent in classroom teaching because this register uses the types of lexical bundles associated with both conversation and academic prose.
References:
Stubbs, M. 2002. ‘Two quantitative methods of studying phraseology in English’. International Journal of Corpus Linguistics 7/2: 215-244.
Biber, D. and Conrad, S. 1999. ‘Lexical bundles in conversation and academic prose’ in H. Hasselgard and S. Oksefjell (eds.) Out of Corpora: Studies in Honour of Stig. Johansson, pp. 181-189. Amsterdam: Rodopi.
Biber, D. 2003. ‘Lexical bundles in academic speech and writing’ in B. Lewandowska-Tomaszczyk (ed.) Practical Applications in Language and Computers, pp. 165-178. Frankfurt: Peter Lang.
References:
Stubbs, M. 2002. ‘Two quantitative methods of studying phraseology in English’. International Journal of Corpus Linguistics 7/2: 215-244.
Biber, D. and Conrad, S. 1999. ‘Lexical bundles in conversation and academic prose’ in H. Hasselgard and S. Oksefjell (eds.) Out of Corpora: Studies in Honour of Stig. Johansson, pp. 181-189. Amsterdam: Rodopi.
Biber, D. 2003. ‘Lexical bundles in academic speech and writing’ in B. Lewandowska-Tomaszczyk (ed.) Practical Applications in Language and Computers, pp. 165-178. Frankfurt: Peter Lang.
two questions
First, how to sum up the selected column with wordsmith 3? The way I know is too complicated and inconvenient: copy it into a .txt file, then copy the list to an excel file, and finally sum up the column.
Secondly, how to set a threshhold frequency when doing n-gram search with wordsmith 3?
First, how to sum up the selected column with wordsmith 3? The way I know is too complicated and inconvenient: copy it into a .txt file, then copy the list to an excel file, and finally sum up the column.
Secondly, how to set a threshhold frequency when doing n-gram search with wordsmith 3?
回复：LOCNESS corpus
1) You can select "File - statistics" in the menu, or click on the sigma icon on the toolbar to find out statistics about your wordlist, bigram/trigram etc list. What you want in your posting is shown as Token. the number of items is shown as Type.
2) The threshold value (minimum frequency) can be set before you make a wordlist/bigram etc (Settings - Adjust settings - Wordlist)
Or you can re-sort the list in terms of frequency to cut off all items below a value.
1) You can select "File - statistics" in the menu, or click on the sigma icon on the toolbar to find out statistics about your wordlist, bigram/trigram etc list. What you want in your posting is shown as Token. the number of items is shown as Type.
2) The threshold value (minimum frequency) can be set before you make a wordlist/bigram etc (Settings - Adjust settings - Wordlist)
Or you can re-sort the list in terms of frequency to cut off all items below a value.
回复：LOCNESS corpus
I know how to set the threshhold frequency for clusters now. Thank you.
But it seems that the "tokens" row on n-gram list window on my wordsmith 3 is always the total tokens of single words of all the text in the subcorpus. What is wrong with my wordsmith or with my setting?
The following is the statistics window of 8-gram list. The "types" row shows the right figure, but the number of "tokens" is the total of tokens of single words in the subcorpus.
The following is the statistics window for 7-gram list. The same thing has happened.
I know how to set the threshhold frequency for clusters now. Thank you.
But it seems that the "tokens" row on n-gram list window on my wordsmith 3 is always the total tokens of single words of all the text in the subcorpus. What is wrong with my wordsmith or with my setting?
The following is the statistics window of 8-gram list. The "types" row shows the right figure, but the number of "tokens" is the total of tokens of single words in the subcorpus.
The following is the statistics window for 7-gram list. The same thing has happened.
[本贴已被 作者 于 2005年07月10日 22时40分07秒 编辑过]
[本贴已被 作者 于 2005年07月10日 22时45分57秒 编辑过]
回复：LOCNESS corpus
I know how to set the threshhold frequency for clusters now. Thank you.
But it seems that the "tokens" row on n-gram list window on my wordsmith 3 is always the total tokens of single words of all the text in the subcorpus. What is wrong with my wordsmith or with my setting?
The following is the statistics window of 8-gram list. The "types" row shows the right figure, but the number of "tokens" is the total of tokens of single words in the subcorpus.
The following is the statistics window for 7-gram list. The same thing has happened.
I know how to set the threshhold frequency for clusters now. Thank you.
But it seems that the "tokens" row on n-gram list window on my wordsmith 3 is always the total tokens of single words of all the text in the subcorpus. What is wrong with my wordsmith or with my setting?
The following is the statistics window of 8-gram list. The "types" row shows the right figure, but the number of "tokens" is the total of tokens of single words in the subcorpus.
The following is the statistics window for 7-gram list. The same thing has happened.
[本贴已被 作者 于 2005年07月10日 22时46分51秒 编辑过]
[本贴已被 作者 于 2005年07月10日 22时47分45秒 编辑过]
The corpora I extracted for comparison with LOCNESS in terms of n-grams amount to 117,600 tokens each, but the total tokens of LOCNESS is 324,203. Then how to standardize the values of n-grams from LOCNESS so as to make them comparable with those from the previous corpora?
And the "tokens" row in your screen dump at No. 32 also shows the total of tokens in locness corpus rather than those of the 2-grams in locness corpus.
And the "tokens" row in your screen dump at No. 32 also shows the total of tokens in locness corpus rather than those of the 2-grams in locness corpus.