Loup Ventures asked each of the three main virtual assistants – Google Assistant, Alexa, and Siri – a total of 800 questions. The assistants understood almost every question, even if not all of the responses were correct/sufficient.

In terms of understanding the questions, these are the results:

• Google Assistant – 100 percent
• Alexa – 99.9 percent
• Siri – 99.8 percent

Loup Ventures’ say their question set it designed to comprehensively test a virtual assistant’s ability and utility. Questions are broken down into five categories:

1. Local – Where is the nearest coffee shop?
2. Commerce – Order me more paper towels.
3. Navigation – How do I get to Uptown on the bus?
4. Information – Who do the Twins play tonight?
5. Command – Remind me to call Jerome at 2 pm today.

This is the percentage of questions each assistant answered correctly:

• Google Assistant – 92.9 percent
• Siri – 83.1 percent
• Alexa –  79.8 percent

The results are a huge improvement over Assistant, Alexa, and Siri’s results last year.

In 2018, Loup Ventures found Google Assistant answered the most questions with an 86 percent success rate. This was followed by Siri at 79 percent, while Alexa trailed behind at just 61 percent.

Alexa’s jump in answering the question correctly from 61 percent last year to almost 80 percent this year is the most commendable performance improvement, even if Amazon’s assistant is still in last place overall.

The researchers explained that they’ve stopped including Cortana in their tests due to a strategy change from Microsoft earlier this year.

Microsoft said in January that it’s no longer attempting to compete with Alexa or Google Assistant in areas like smart speakers, but instead is repositioning Cortana more like a skill that can be embedded in services where she can be of assistance.

The post Google Assistant wins IQ test, but Alexa and Siri are catching up appeared first on AI News.