Evaluation of Artificial Intelligence Frameworks

Authors

Crystal Todd, Southern Methodist UniversityFollow
Ruby Vazquez Pena, Southern Methodist UniversityFollow
Raghuram Srinivas, Southern Methodist UniversityFollow

Abstract

In this paper, we present a comparative evaluation of three artificial intelligence frameworks, IBM Watson, Amazon Lex, and Microsoft Azure. The comparisons in this paper are in functionality, reliability, usability, efficiency, maintainability, and accessibility of each artificial intelligence frameworks. By comparing and evaluating each framework we have set standardized metrics that help others assess the frameworks for their respective purpose. Data has been gathered to create a virtual admissions assistant for the Southern Methodist University (SMU) Masters in Data Science program. The same data has been used to train three chatbots using IBM Watson, Amazon Lex, and Microsoft Azure. Using the six comparisons, we have set metrics that evaluate each artificial intelligence framework.

Recommended Citation

Todd, Crystal; Vazquez Pena, Ruby; and Srinivas, Raghuram (2018) "Evaluation of Artificial Intelligence Frameworks," SMU Data Science Review: Vol. 1: No. 1, Article 10.
Available at: https://scholar.smu.edu/datasciencereview/vol1/iss1/10

Creative Commons License

This work is licensed under a Creative Commons Attribution-Noncommercial 4.0 License