In this paper, we present a comparative evaluation of three artificial intelligence frameworks, IBM Watson, Amazon Lex, and Microsoft Azure. The comparisons in this paper are in functionality, reliability, usability, efficiency, maintainability, and accessibility of each artificial intelligence frameworks. By comparing and evaluating each framework we have set standardized metrics that help others assess the frameworks for their respective purpose. Data has been gathered to create a virtual admissions assistant for the Southern Methodist University (SMU) Masters in Data Science program. The same data has been used to train three chatbots using IBM Watson, Amazon Lex, and Microsoft Azure. Using the six comparisons, we have set metrics that evaluate each artificial intelligence framework.
Todd, Crystal; Vazquez Pena, Ruby; and Srinivas, Raghuram
"Evaluation of Artificial Intelligence Frameworks,"
SMU Data Science Review: Vol. 1
, Article 10.
Available at: https://scholar.smu.edu/datasciencereview/vol1/iss1/10
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial 4.0 License