Καλωσηρθατε ... Welcome ... Bienvenue ...

 

about

I am working as a research associate at ISSCO/TIM/FTI, a multidisciplinary group at the University of Geneva since February 2007. I have more than 10 years of experience in automatic speech recognition and dictation systems, voice user interfaces, multimodal interaction, distributed and mobile systems.

 

 

 

work experience

Before joining TIM/ISSCO I worked as a software engineer developing telephone-based speech recognition applications at Dialogos Communications. I had the opportunity to work on real world projects for major vendors, including the Hellenic Telecommunications Organization, the mobile operator Cosmote, the internet provider OTENet, and others. I also worked as a researcher on relevant technologies including automatic speech recognition and dictation systems, voice user interfaces and multimodal interaction at the Telecommunication Systems Institute.

 

education

I hold a BEng (5 years degree) in Electronics & Computer Engineering, an MEng in Computer Engineering, an MEng in Engineering Management from TU Crete. and a PhD in Traitement Informatique Multilingue from the University of Geneva. Both my diploma and master's thesis in computer engineering were under the supervision of Prof. Vassilis Digalakis, my master's thesis in management under the supervision of Prof. Nikolaos Matsatsinis and my doctorate thesis under the supervision of Prof. Pierrette Bouillon in collaboration with Dr. Manny Rayner.

 

University of Geneva

Technical University of Crete

Dialogos Communications

Telecommunications Institute

European Commission

                     

research statement

As a professional Software Engineer for more than a decade, holding a 5-years degree in Electronics and Computer Engineering, two master degrees and a PhD, I seek a career in the fields of software design and development. My personal penchant for software engineering stems largely from my previous involvement in real-world applications in the industry and academia, designing and developing different services and applications.

 

Furthermore, having completed a PhD in multimodal interaction on mobile devices, with more than 40 peer-reviewed publications, I am capable of addressing diverse factors that influence the success and failure of human-machine interfaces. My previous work experience has provided me the opportunity to become better acquainted with designing, building and evaluating systems targeted to end-users, and also solving problems from the back-end until the front-end of an application.

 

I am interested in projects that allow the integration of software components with different systems, instruments and platforms. Enjoying the benefits of a solid background in engineering in addition to my previous experience in different integrations, provided me the necessary technical competencies to perform similar tasks seamlessly.

 

Finally, I am attracted by projects that are multidisciplinary in nature. In particular, I am interested in combining my expertise with the specialty of others and their fusion into massive undertakings. Collaborating with people of diverse academic orientation for solving common problems has always fascinated me.

 

areas

 

My academic and professional interests include the following areas:

 

Voice Interfaces – Multimodal Interaction

Automatic Speech Recognition Systems

Telecommunication Systems – Integration Services – Communication Protocols

Evaluation – Mobile Platforms – Distributed Systems

academic projects 1/1

"Web-Based Deployment of Speech-Enabled Applications for Medicine and Education". This work offers the necessary infrastructure to support spoken language applications in a web browser. Funded by the Ernest Boninchi Foundation.

 

"A Generic Platform for Call Assisted Language Learning Based on Speech Translation (CALLSLT)". The project leverages the work already implemented in our group on speech recognition and translation, to develop a generic CALL platform centered on the 'spoken translation game' idea. Funded by the Swiss National Science Foundation.

 

"Medical Spoken Language Translator (MedSLT)", which is a multilingual spoken language translation system tailored for medical domains. Funded by the Swiss National Science Foundation.

 

"A Swiss Platform for Controlled Spoken Dialog Applications". The project proposes to extend and stabilize the Regulus platform so as to make it suitable for adoption as a general Swiss platform for spoken language system construction in academia and industry. Funded by the Swiss National Science Foundation.

 

"Interactive Multimodal Information Management (IM2)", aimed at the development of prototypes in the field of multimodal information management and man-machine interaction. Funded by the Swiss National Science Foundation.

 

"Beware", aimed at achieving the goal of sustainable management of water reserves in Crete, through the application of an integrated method that will be used for providing water consumers with information that can help minimize water misuse. Funded by the Water Resources Management Department, Region of Crete - Greece.

academic projects 2/2

"Logotypografia", aimed at the creation of a Speech Dictation System for the Greek language. The system was intended for workflow improvement in the field of journalism. Funded by the Greek General Secretariat of Research and Technology.

 

"Spoken Language Translator (SLT)", which was a prototype system capable of fairly credible translation of continuous spoken language between English and Swedish in either direction, using the domain of airline travel planning queries (ATIS). Funded by Telia Research.

selected publications

PhD thesis:

 

This is the manuscript of my PhD thesis entitled: "Development & Evaluation of Multilingual Multimodal Dialogue Systems on Mobile Devices", which is also availbale in book version from here. The presentation of my thesis defense created with HTML5 is available here and can be downloaded from github or with this zip file. However, there are various issues when using different browsers and this is how it looks with Firefox.

 

Journal publications:

 

"Using Hand Gestures to Control Mobile Spoken Dialogue Systems", N. Tsourakis, Springer International Journal on Universal Access in the Information Society (UAIS) – Special issue on Mobile Accessibility, vol. 13:3, pp. 257-275, 2014.

 

"CALL-SLT: A Spoken CALL System Based on Grammar and Speech Recognition", M. Rayner, N. Tsourakis, C. Baur, P. Bouillon and J. Gerlach, CSLI Journal of Linguistic Issues in Language Technology, Vol. 10:2, 2014.

 

"Evaluating the Quality of Mobile Medical Speech Translators based on ISO/IEC 9126 series: Definition, Weighted Quality Model and Metrics", N. Tsourakis and P. Estella. IGI International Journal on Reliable and Quality e-Healthcare (IJEQEH), vol. 2:2, pp. 1-20, 2013.

 

 

publications 1/7

"Formative Feedback in an Interactive Spoken CALL System", N. Tsourakis, M. Rayner and C. Baur. Proceedings of the Interspeech Workshop on Child, Computer and Interaction (WOCCI), Singapore, 2014.

"CALL-SLT Lite: A Minimal Framework for Building Interactive Speech-Enabled CALL Applications", M. Rayner, C. Baur and N. Tsourakis. Proceedings of the Interspeech Workshop on Child, Computer and Interaction (WOCCI), Singapore, 2014.

"Using a Serious Game to Collect a Child Learner Speech Corpus", M. Rayner, C. Baur and N. Tsourakis. Proceedings of the Ninth ELRA International Conference on Language Resources and Evaluation (LREC), 2014, Reykjavik, Island.

"Crafting Interesting Dialogues in an Interactive Spoken CALL System", C. Baur, M. Rayner and N. Tsourakis. Proceedings of Sixth International Conference on Education and New Learning Technologies (EDULEARN), Barcelona, Spain, 2014.

publications 2/7

"A Textbook-based Serious Game for Practising Spoken Language", C. Baur, M. Rayner, N. Tsourakis. Proceedings of the 6th International Conference of Education, Research and Innovation (ICERI), 2013, Seville, Spain.

"Methodological Issues in Evaluating a Spoken CALL Game: Can Crowdsourcing Help Us Perform Controlled Experiments?", M. Rayner and N. Tsourakis. Proceedings of the Interspeech Workshop on Speech and Language Technology in Education (SLaTE), 2013, Grenoble, France.

"A Web-Deployed Swedish Spoken CALL System Based on a Large Shared English/Swedish Feature Grammar", M. Rayner, J. Gerlach, M. Starlander, N. Tsourakis, A. Kruckenberg, R. Eklund, A. Jönsson, A. McAllister and C. Chua. Proceedings of the SLTC-2012 Workshop on NLP for Computer-Assisted Language Learning, 2012, Lund, Sweden.

"A Game on Pronunciation Feedback in Facebook", N. Tsourakis. Proceedings of the International Symposium on Automatic Detection of Errors in Pronunciation Training (IS ADEPT), 2012, Stockholm, Sweden.

"A Corpus for Gesture-Controlled Mobile Spoken Dialogue Systems", N. Tsourakis and M. Rayner. Proceedings of the Eighth ELRA International Conference on Language Resources and Evaluation (LREC), 2012, Istanbul, Turkey.

publications 3/7

"A Scalable Architecture for Web Deployment of Spoken Dialogue Systems", M. Fuchs, N. Tsourakis and M. Rayner. Proceedings of the Eighth ELRA International Conference on Language Resources and Evaluation (LREC), 2012, Istanbul, Turkey.

"An ISO-based Quality Model for Evaluating Mobile Medical Speech Translators", N. Tsourakis and P. Estrella. Proceedings of the Second International ICST Conference on Wireless Mobile Communication and Healthcare (MobiHealth), 2011, Kos, Greece.

"Speech Recognition For Online Language Learning: Connecting CALL-SLT and DALIA", P. Bouillon, C. Cervini, A. Mandich, M. Rayner and N. Tsourakis. Proceedings of the International Conference on ICT for Language Learning, 2011, Florence, Italy.

"A Gesture-Controlled Internet-Based Spoken Conversion Partner On A Mobile Device", N. Tsourakis, M. Rayner and M. Fuchs. Proceedings of the INTERACT Workshop on Mobile Accessibility (MOBACC), 2011, Lisbon, Portugal.

"Evaluation of a Mobile Language Learning System Using Language-Neutral Prompts", N. Tsourakis, M. Rayner and P. Bouillon. Proceedings of the Interspeech Workshop on Speech and Language Technology in Education (SLaTE), 2011, Venice, Italy.

publications 4/7

"For a Fistful of Dollars: Using Crowd-Sourcing to Evaluate a Spoken Language CALL Application", M. Rayner, I. Frank, C. Chua, N. Tsourakis and P. Bouillon. Proceedings of the Interspeech Workshop on Speech and Language Technology in Education (SLaTE), 2011, Venice, Italy.

"A Student-Centered Evaluation of a Web-Based Spoken Translation Game", P. Bouillon, M. Rayner, N. Tsourakis and Q. Zhang. Proceedings of the Interspeech Workshop on Speech and Language Technology in Education (SLaTE), 2011, Venice, Italy.

"Evaluating A Web-Based Spoken Language Translation Game for Learning Domain Language", P. Bouillon, S. Halimi, M. Rayner and N. Tsourakis. Proceedings of the International Technology, Education and Development Conference, (INTED), 2011, Valencia, Spain.

"A Multilingual Platform for Building Speech-Enabled Language Courses", M. Rayner, P. Bouillon, N. Tsourakis, J. Gerlach, C. Baur, M. Georgescul and Y. Nakao. Proceedings of the Interspeech Workshop on Second Language Studies: Acquisition, Learning, Education and Technology (L2WS), 2010, Tokyo, Japan.

"Examining the Effects of Rephrasing User Input on Two Mobile Spoken Language Systems", N. Tsourakis, A. Lisowska, M. Rayner and P. Bouillon. Proceedings of the Seventh ELRA International\ Conference on Language Resources and Evaluation (LREC), 2010, Valletta, Malta.

publications 5/7

"A Multilingual CALL Game Based on Speech Translation", M. Rayner, P. Bouillon, N. Tsourakis, J. Gerlach, M. Georgescul, and Y. Nakao. Proceedings of the Seventh ELRA International Conference on Language Resources and Evaluation (LREC), 2010, Valletta, Malta.

"Design Issues for a Bidirectional Mobile Medical Speech Translator", N. Tsourakis, P. Bouillon and M. Rayner. Proceedings of the Fourth ACM MobileHCI Workshop on Speech in Mobile and Pervasive Environments (SiMPE), 2009, Bonn, Germany.

"Discriminative Learning Using Linguistic Features To Rescore N-Best Speech Hypotheses", M. Georgescul, M. Rayner, P. Bouillon and N. Tsourakis. Proceedings of the IEEE/ACL 2008 Workshop on Spoken Language Technology, 2008, Goa, India, pp. 97-100.

"Many-to-Many Multilingual Medical Speech Translation on a PDA", P. Bouillon, G. Flores, M. Georgescul, S. Halimi, B. A. Hockey, H. Isahara, K. Kanzaki, Y. Nakao, M. Rayner, M. Santaholma, M. Starlander and N. Tsourakis. Proceedings of the Eighth Conference of the Association for Machine Translation in the Americas (AMTA), 2008, Waikiki, Hawai'i, pp.314-323.

"Comparing Two Different Bidirectional Versions of Limited-domain Medical Spoken Language Translator MedSLT", M. Starlander, P. Bouillon, G. Flores, M. Rayner and N. Tsourakis. Proceedings of the Twelfth European Machine Translation Conference (EAMT), 2008, Hamburg, Germany, pp. 174-179.

publications 6/7

"From Desktop to Mobile: Adapting a Successful Voice Interaction Platform for Use in Mobile Devices", N. Tsourakis, A. Lisowska, P. Bouillon and M. Rayner. Proceedings of the Third ACM MobileHCI Workshop on Speech in Mobile and Pervasive Environments (SiMPE), 2008, Amsterdam, the Netherlands.

"The 2008 MedSLT System", M. Rayner, P. Bouillon, J. Brotanek, G. Flores, S. Halimi, B. A. Hockey, H. Isahara, K. Kanzaki, E. Kron, Y. Nakao, M. Santaholma, M. Starlander and N. Tsourakis. Proceedings of the Coling Workshop on Speech Processing for Safety Critical Translation and Pervasive Applications (SLT4MED), 2008, Manchester, UK, pp. 32-35.

"Building Mobile Spoken Dialogue Applications Using Regulus", N. Tsourakis, M. Georgescul, P. Bouillon and M. Rayner. Proceedings of the Sixth ELRA International Conference on Language Resources and Evaluation (LREC), 2008, Marrakech, Morocco.

"Developing Non-European Translation Pairs in a Medium-Vocabulary Medical Speech Translation System", P. Bouillon, S. Halimi, Y. Nakao, K. Kanzaki, H. Isahara, N. Tsourakis, M. Starlander, B. A. Hockey and M. Rayner. Proceedings the Sixth ELRA International Conference on Language Resources and Evaluation (LREC), 2008, Marrakech, Morocco.

"Degradation of Speech Recognition Performance over Lossy Data Networks", D. Pratsolis, N. Tsourakis and V. Digalakis. Proceedings of the Third ACM Workshop on Wireless Multimedia Networking and Performance Modeling (WMuNeP), 2007, Chania, Greece, pp. 88-91.

publications 7/7

"A Generic Methodology of Converting Transliterated Text To Phonetic Strings. Case Study: Greeklish", N. Tsourakis and V. Digalakis. Proceedings of the ISCA International Conference Interspeech/Eurospeech, 2007, Antwerp, Belgium, pp. 1785-1788.

"A Bidirectional Grammar-Based Medical Speech Translator", P. Bouillon, G. Flores, M. Starlander, N. Chatzichrisafis, M. Santaholma, N. Tsourakis, M. Rayner and B. A. Hockey. Proceedings of the ACL Workshop on Grammar-Based Approaches to Spoken Language Processing (SPEECHGRAM), 2007, Prague, Czech Republic, pp. 41-48

"Web-Based Decision Support System for the Quantitative Analysis of the Customers' Behavior", N. Tsourakis, D. Pratsolis, and N. Matsatsinis. Proceedings of the 64th Meeting of the European Working Group on "Multiple Criteria Decision Aiding", 2006, Larissa, Greece.

"An Architecture for Multimodal Applications over Wireless Data Networks", N. Tsourakis, D. Pratsolis, C. Harizakis and V. Digalakis. Proceedings of the Second IET International Conference on Intelligent Environments, 2006, Athens, Greece, Vol. I, pp. 221-227.

"Large Vocabulary Continuous Speech Recognition in Greek: Corpus and an Automatic Dictation System", V. Digalakis, D. Oikonomidis, D. Pratsolis, N. Tsourakis, C. Vosnidis, N. Chatzichrisafis and V. Diakoloukas. Proceedings of the ISCA International Conference Interspeech/Eurospeech, 2003, Geneva, Switzerland, pp. 1565 - 1568.

demos

   
   

I am always open to discuss innovative ideas that combine my expertise with the specialty of others. In general you can contact me in the following email address:

Logotypografos Greek Dictation Mobile Calendar MedSLT Unidirectional Medical Speech Translator MedSLT Bidirectional Medical Speech Translator Computer Assisted Language Learning