General

  • Balogh, J., Barbier, I., Bernstein, J., Suzuki, M., & Harada, Y. (2005). A Common Framework for Developing Automated Spoken Language Tests in Multiple Languages. JART Journal, 1(1), 67-79.
  • Balogh, J. & Bernstein, J. (2006). Workable models of standard performance in English and Spanish. In Y. Matsumoto, D.Y. Oshima, O.R. Robinson, & P. Sells (Eds.), Diversity in language: Perspective and implications (pp. 20-41). Stanford, CA: Center for the Study of Language and Information Publications.
  • Bernstein, J. (2002). Constructs Broad and Narrow. In Y.N. Leung et al. (Eds.), Selected Papers from the Eleventh International Symposium on English Teaching/Fourth Pan Asia Conference (pp. 26-33). Taipei, ROC: The Crane Publishing.
  • Bernstein, J. (2001). Conciliation of psycholinguistic and communicative methods in spoken language testing. In Y.N. Leung et al. (Eds.), Selected Papers from the Tenth International Symposium on English Teaching (pp. 8-14). Taipei, ROC: The Crane Publishing.
  • Bernstein, J., Balogh, J., & Suzuki, M. (2005). Speech processing technology and spoken language tests. Proceedings of 2005 Acoustical Society of Japan Annual Conference, pp.863-866.
  • Bernstein, J. & Cheng, J. (2007). Logic and validation of fully automatic spoken English test. In M. Holland & F.P. Fisher (Eds.), The path of speech technologies in computer assisted language learning: From research toward practice (pp. 174-194). Florence, KY: Routledge.
  • Bernstein, J. & De Jong, J. H.A.L. (2001). An experiment in predicting proficiency within the Common Europe Framework Level Descriptors. In Y.N. Leung et al. (Eds.), Selected Papers from the Tenth International Symposium on English Teaching (pp. 8-14). Taipei, ROC: The Crane Publishing.
  • Bernstein, J., De Jong, J., Pisoni, D., & Townshend, B. (2000). Two experiments on automatic scoring of spoken language proficiency. In P. Delcloque (Ed.), Proceedings in InSTIL2000 (pp. 57-61). Dundee, Scotland: University of Abertay.
  • Bernstein, J., Todic, O., Townshend, B., & Wareen, E. (2000). Computer estimation of spoken language skills. In A. Ikeya & M. Kawamori (Eds.), PACLIC 14: 14th Pacific Asia Conference on Language, Information and Computation Proceedings (pp. 35-46). Chiba, Japan: PACLIC 14 Organizing Committee.
  • Bernstein, J., Van Moere, A. & Cheng, J. (2010). Validating automated speaking tests. Language Testing, 27(3), 355-377.
  • Blake, R., Wilson, N.L., Pardo-Ballestar, C., & Cetto, M. (2008). Measuring oral proficiency in distance, face-to-face, and blended classrooms. Language Learning and Technology, 12(3), pp.114-127.
  • Cheng, J. & Shen, J. (2011). Off-topic detection in automated speech assessment applications. Proceedings of Interspeech 2011,1597-1600.
  • Harada, Y. & Suzuki, M. (2005). A common framework for measuring spoken language skills of non-native speakers. In L. Anthony, S. Fujita & Y. Harada (Eds.), Proceedings of IWLeL 2004: An interactive workshop on language e-learning.
  • Nair, Anish. (2005). Item difficulty estimation using linguistic and acoustic predictors. Thought and Language Special Interest Group IEICE Tokyo: Technical Report of IEICE, 37-42.
  • Rosenfeld, E., Massaro, D., & Bernstein, J. (2003). Automatic analysis of vocal manifestations of apparent mood or affect. Proceedings of the 3rd international workshop on models and analysis of vocal emissions for biomedical applications (MAVEBA). Firenze, Italy.
  • Yokokawa, H., Yabuuchi, S., Suzuki, M., & Morishita, M. (2006). Vocabulary and response latencies in the spontaneous speech of Japanese EFL learners: An analysis of data from a short-term overseas study tour. Technical Report of IEICE.

Chinese Tests

  • Xu, X., Suzuki, M. & Cheng, J. (2012). An automated assessment of spoken Chinese: Technical definition of Hanyu standards for content and scoring development. Proceedings of the 7th Technology and Chinese Language Teaching Conference, 66-72.

Dutch Tests

  • De Jong, J. H.A.L., Lennig, M., Kerkhoff, A., & Poelmans, P. (2009). Development of a test of spoken Dutch for prospective immigrants. Language Assessment Quarterly, 6 (1), 41-60.

English Tests

  • Bernstein, J., Cheng, J., & Suzuki, M. (2011). Fluency Changes with General Progress in L2 Proficiency. Proceedings of Interspeech 2011, 31-50.
  • Bernstein, J., Cheng, J., & Suzuki, M. (2010). Fluency and structural complexity as predictors of L2 oral proficiency. Proceedings of Interspeech 2010, 1241-1244.
  • Barbier, I., & Bernstein, J. (2000/01). Design and development parameters for a rapid automatic screening tests for prospective simultaneous interpreters. Interpreting, 5(2), 221-238.
  • De Jong, J. & Bernstein, J. (2001). Relating PhonePass™ overall scores to the Council of Europe Framework level descriptors. In L. Mak, S. Chang, P. Foo, J. Hunter, M Keung, J. Lee, W. Mok, & N. Noakes (Eds.), Proceedings of the Conference of Technology in Language Education: Meeting the Challenges of Research and Practice (pp. 51-58). Hong Kong: Hong Kong University Press.
  • Downey, R., Farhady, H., Present-Thomas, R., Suzuki, M., & Van Moere, A. (2008). Evaluation of the usefulness of the Versant for English test: A response. Language Assessment Quarterly, 5, 160-167.
  • Todic, O. (2003). Automated spoken English tests using information technology and speech recognition. Technical Report of IEICE.

Aviation English Tests

  • Downey, R., Suzuki, M., & Van Moere, A. (2010). High-stakes English language assessments for aviation professionals: Justifying the use of a fully automated test of spoken language proficiency. IEEE Transactions on Professional Communication: Special Issue on Assessment in Professional Communication, 53 (1), 18-32.
  • Van Moere, A., Suzuki, M., Downey, R., & Cheng, J. (2009). Implementing ICAO Language Proficiency Requirements in the Versant Aviation English Test. Australian Review of Applied Linguistics, 32 (3), 27.1-27.17.

Arabic Tests

  • Cheng, J., Bernstein, J., Pado, U., & Suzuki, M. (2009) Automatic assessment of spoken Modern Standard Arabic. Proceedings of the Fourth Workshop on Innovative Use of NLP for Building Educational Applications. Warwickshire, England, 1-9.

Oral Reading Fluency Tests

  • Balogh, J., Bernstein, J., Cheng, J., Van Moere, A., Townshend, B., & Suzuki, M. (2012). Validation of automated scoring of oral reading. Educational and Psychological Measurement, 72 (3), 435-452.
  • Cheng, J. & Shen, J. (2010). Towards accurate recognition for children's oral reading fluency. Proceedings of the IEEE Workshop on Spoken Language Technology, 103-108.
  • Downey, R., Rubin, D., Cheng, J., & Bernstein, J. (2011). Performance of automated scoring for children's oral reading. Proceedings of the Sixth Workshop on Innovative Use of NLP for Building Educational Applications, 46-55.

Spanish Tests

  • Barbier, I. (2004). Design, development and evaluation of an automatically scored Spoken Spanish Test. Proceedings of CALL 2004 Conference.
  • Barbier, I, Rosenfeld, E., Bernstein, J. & De Jong, J. (2004). The development of the Spoken Spanish Test (SST). Language Testing Update (LTU), 34, 57-62.

Japanese Tests

  • Harada, Y., Suzuki, M., & Bernstein, J. (2004) Developing an Automated Test of Spoken Japanese. In H. Masuichi, T. Ohkuma, K. Ishikawa, Y. Harada, & K. Yoshimoto (Eds.), Proceedings of PACLIC 18: The 18th Pacific Asia Conference on Language, Information and Computation (pp. 291-298). Tokyo, Japan: PACLIC 18 Organizing Committee and PACLIC Steering Committee.
  • Harada, Y. & Suzuki, M. (2004). Developing an automated spoken Japanese test. Language Testing Update (LTU), 36, 80-84.
  • Harada, Y., Suzuki, M. & Bernstein, J. (2004). Developing an automated test of spoken Japanese. IEICE Technical Report, 104(503), 23-28.
  • Harada, Y., Suzuki, M., & Tomono, T. (2005). Development of a completely automated spoken Japanese test (title translated from Japanese). Proceedings of Forum of Information Technology 2005. Tokyo, Japan.
  • Suzuki, M. & Harada, Y. (2005). Using speech recognition for an automated test of spoken Japanese. Proceedings of PACLIC 19: The 19th Pacific Asia Conference of Language, Information and Computation (pp. 317-323). Taipei: Academia Sinica.