untitled

Transcription

1 FAST FAST Free Assistant of Structural Tests ,2 {g936727, g936339, g936704}@oz.nthu.edu.tw jschang@cs.nthu.edu.tw 1 2 論 年來 理領 裡異 漏 讀 量 論 路 句 讀 行 句 句 句 了 FAST (Free Assessment of Structural Test) FAST 來 句 FAST 數 力 Key Words Computer Assisted Language Learning CALL 1950 年 年來 Computer Assisted Item Generation CAIG 領 量 力 度 度 力 adaptive testing 度不 漏 讀 Non-native speaker NNS 利 Larsen-Freeman 1997 form meaning use 句 力 力 讀 力 力 力 兩 不 念 力 量 度 句 了 不 易 句 來 易 力 理 度 度 若 句 不 不 類

2 力 不 數 了 力 句 力 若 利 率 量 multiple-choice test 句 立 context-independent 句 念 stem 念 distractor 例 1 例 1 Reading is to the mind exercise is to the body. (A) so (B) that (C) as (D) what 理 句 來 不 了 來 句 例 利 路 Wikipedia 路 不 句 句 領 reduced clause 句 易 了 見 易 句 句 例 2 2 There are six subspecies of the fox, each unique to the island it inhabits, its evolutionary history. (A) to reflect (B) and reflect (C) reflecting (D) that reflect reflect 不 to reflect and reflect reflecting 利 句 例 3 不 例 2 3 CLAUSE, * ADJ *, X/VBG *. CAUSE, * ADJ *, *. (A) (A) X/INFINITIVE (B) and X (C) X/VBG (D) that X 了 句 不 句 行 句 不 連 例 4 句 it 不 4 It is the smallest fox species in the United States.

3 The Island Fox is a small fox that is native to six of the eight Channel Islands of California. It is the smallest fox species in the United States. There are six subspecies of the fox, each unique to the island it inhabits, reflecting its evolutionary history. Introduced diseases or parasites can decimate Island Fox populations. Because Island Foxes are isolated they have no immunity to parasites and diseases brought in from the mainland and are especially vulnerable to those domestic dogs may carry. A canine distemper outbreak in 1998 killed approximately 90% of Santa Catalina Island's fox population. In addition, Golden Eagle predation and human activities decimated fox numbers on several of the Channel Islands in the 1990s. Four Island Fox subspecies were federally protected as an endangered species in 2004, and efforts to rebuild fox populations and restore the ecosystems of the Channel Islands are being undertaken. 不 2005 年 7 10 island fox 來 了 量 Test of English as a Foreign Language TOEFL 參 句 句 了 行 了 FAST Free Assessment of Structural Test 來 落 路 Web as corpus 念 路 利 理 立 Wikipedia 2,000 2,000 FAST 路 念 力 度 來 FAST FAST 來 論 Warschauer (1996) 30 年來 狀 年 參 Wichmann, Fligelstone, McEnery Knowles 論 利 料 Wilson (1997) 利 料 來 練 練 例 句 startled startling Milton 1998 WordPilot WordPilot 老 數 易 WordPilot 例 5 練 5 Title: Sulfur and Nitrogen Emission Trends for the U.S. Introduction INTRODUCT ( ) the substance metabolized by industrial activities, fossil fuels are most significant, both in quantity and by the variety of chemical that are mobilized. Industrial consumers take fuels as inputs a WordPilot

4 WordPilot WordPilot 數 不 (i) WordPilot 料 例 5 WordPilot 不 句 度 不 度 (ii) WordPilot 亂數 不 useless distractor 易度 item facility 度 item discrimination (iii) 不 15 2 降 Mitkov Ha 2003 利 理 句 WordNet 立 讀 Mitkov Ha 利 理論 度 度 劉 麟 2004 理 selectional preference collocation 念 漏 Liu, Wang, Gao Huang 2005 Sumita, Sugaya, Yamamoto 2005 Item Response Theory IRT 來 力 路 力 不 略 理 句 度 數量 了 FAST 了 FAST 度 年來 1998 年 ~ 2002 年 料 數 FAST 料 % 例 % 例 7 FAST 6 Most doctors of the Colonial period believed was caused by an imbalance of humors in

5 the body. (A) in disease (B) that disease (C) of disease (D) about disease 7 During the Harlem Resaissance the 1920's, much African American (A) writers, artists, and musicians came to Harlem in New York City, (B) creating a cultural center there. (C) (D) 不 立 類 learned genre 例 例 6 例 7 不 理 利 類 句 來 例 Wikipedia 度 度 7 34 FAST 理 略 路 句 句 FAST 流 句 3.1 路 句 類 不 來 念 了 若 來 類 亂 不 理 更 了 參 了 Pamela J. Sharpe How to Prepare for the TOEFL 理 類 類 句

6 類 句 說 句 Sharpe 類 Tagger 便 類 略 句 類 力 了 句 句 句 類句 類 例來說 例 8 句 例 9 句 have come hv vbn have to bring to vb 句 不 來 句 兩 不 念 句 理 (surface pattern) 類 類 論 句 類 不 句 說 句 念 8 I have come to bring you good news. 9 ppps hv vbn to vb ppps jj nn 3.2 路 來 Wikipedia 羅 更 Today's featured article 來 Today's featured article 連 見 連 連 連 連 見 連 連 連 便 連 連 連 連 連 連 句 句 行 句 來 句 句 For other definitions of fantasy, see fantasy (psychology). 連 連 理 句 理 料 句 Wikipedia 句 1373 句 Wikipedia 料

7 3.3 Wikipedia 了 句 料 來 來 句 3.4 理 不 不 易 不 不 說 不 例 I have come to bring you good news. 句 have 易 便 例 10 不 例 11 例 10 I to bring you good news. (A) have came (B) come (C) have coming (D) have come 11 I have come you good news. (A) at bring (B) to brought (C) to bring (D) for bring FAST FAST 連 易 列 類 例

8 易度 度 行 略 度 了 路 了 % FAST 了 1171 更 25% 來 念 了 FAST Wikipedia 來 句 裡 71% 略 論 來 FAST 論 來 句 句 來 FAST 略 立 來若 更 略 度 不 不 更 略 省 省力 FAST 離 offline 立 度更 料 更 來 FAST 易度 更 來 更 不 老 兩 易度 論 理 FAST 說 裡 FAST 行 來 易 行 量 行 類 來說 FAST 練 來說 FAST 省

9 參 1. Brown, James Dean. (1997). Computers in Language Testing: Present Research and Some Future Directions. Language Learning & Technology, Vol. 1, No. 1, pp Coniam, David. (1997) A Preliminary Inquiry Into Using Corpus Word Frequency Data in the Automatic Generation of English Cloze Tests. CALICO Journal, No 2-4, pp Deane, K. Sheehan, Automatic item generation via frame semantics, Education Testing Service (2003): 4. Dunkel, P. (Ed.). (1991). Computer-assisted language learning and testing: Research issues and practice. New York, NY: Newbury House. 5. Gao, Zhao-Ming. (2000) AWETS: An Automatic Web-Based English Testing System. In Proceedings of the 8 th Conference on Computers in Education/International Conference on Computer-Assisted Instruction ICCE/ICCAI, 2000, Vol. 1, pp Jun, Da. (2000) Online Language Testing System Larsen-Freeman, Diane. Grammar and its teaching: challenging the myths. (1997) 8. Liu, Chao-Lin, Wang, Chun-Hung, Gao, Zhao-Ming, and Huang, Shang-Ming. Applications of Lexical Information for Algorithmically Composing Multiple-Choice Cloze Items, In Proceedings of the Second Workshop on Building Educational Applications Using NLP, pp. 1-8, Ann Arbor, Michigan, McCormack, Colin, and Jones, David. (1998). Building a Web-Based Education System. John Wiley. 10. Milton J. (1998) WORDPILOT: enabling learners to navigate lexical universes. In S. Granger & J. Hung (eds.) Proceedings of the International Symposium on Computer Learner Corpora, Second Language Acquisition and Foreign Language Teaching December The Chinese University of Hong Kong, Ruslan Mitkov, Le An Ha, Computer-Aided Generation of Multiple-Choice Tests. (2003) 12. A. Oranje, Automatic item generation applied to the national assessment of educational progress: Exploring a multilevel structural equation model for categorized variables, Education Testing Service (2003): Roever, Carsten. (2001). Web-Based Language Testing. Language Learning & Technology, Vol.5, No.2, pp Schank, R. C., & Cleary, C. (1995). Engines for education. Hillsdale, NJ: Lawrence Erlbaum Associates. 15. Pamela J. Sharpe, "How to Prepare for the TOEFL" 11th ed., Barron s Educational Series, Inc. (2004) 16. Eiichiro SUMITA, Fumiaki SUGAYA, Seiichi Yamamoto. Measuring Non-native Speakers' Proficiency of English by Using a Test with Automatically-Generated Fill-in-the-Blank Questions. In Proceedings of the Second Workshop on Building Educational Applications Using NLP, pp , Ann Arbor, Michigan, Warschauer, Mark Computer-assisted language learning: An introduction. In S. Fotos (ed.), Multimedia language teaching. Tokyo: Logos International, pp Also available online. Also available at Anne Wichmann, Steven Fligelstone, Tony McEnery and Gerry Knowles (eds.). Teaching and Language Corpora. Applied Linguistics and Language Study. London and New York: Longman Wilson, Eve. (1997) The Automatic Generation of CALL Exercises form General Corpora. In Wichmann et al. (eds.) Teaching and Language Corpora, pp Longman. 20. 劉 麟 利 理 漏 劉 麟 Toward Computer Assisted Item Generation for English Vocabulary Tests Wikipedia: 料 :