Voice Enabled Interaction

Applied Cloud Computing
5 min readFeb 2, 2023

--

A Summary

Machine learning initiated an interactive voice command interface where the driver can perform specific tasks. Every Driver had a list of tasks he needed to complete in the entire day. While completing the task, if the driver faces issues like a breakdown or needs to check for fuel, he can ask why the trip assistant module we built was asked. Even for the breakdown, the driver can initiate a voice request for the same.

Furthermore, if he wants to mark his trip as complete, he can do so by saying it to the trip assistant. We can add more interaction in the future if needed.

Introduction

A journey that is well-planned is profitable. Additionally, it increases a driver’s level of comfort and lowers their overall daytime stress. It is essential to plan the driver’s rest break time, fuel stops, and if there are any situations like a breakdown. As in the previous module, the system and the driver’s interface were manual; in order to complete the operation, the driver had to press a button. He’ll have to manually declare his journey as finished if he wants to. So, to make the vehicle smarter there are new technologies which are used which allow us to find the information which is required by the driver and to perform specific tasks.

The Challenge

In the previous module, the interaction between the system and the driver was manual, where the driver must click a button to perform the task. If he wants to mark his trip as complete, he will have to do it manually.

Where in now in the existing module, we provided a voice-enabled interaction to perform his specific tasks. The driver found it easier to complete chores because of this voice-enabled connection. Due to the voice interaction, it was more convenient and easier to use it so that the driver could complete his task.

The Solution

We have designed this project specifically to test the voice-enabled interaction system on Tablets.

We provided voice-enabled interaction to the driver.

List of features:

1. Driver can ask the Trip assistant to report for breakdown. Then the driver will have to respond with the following two options

Driver: Yes, I want to report a breakdown.

Do you really want to report a breakdown?

Driver: Yes, report a breakdown

(Alternate narrative) Driver: No, I do not want to report a breakdown.

Are you sure you want to report a breakdown?

Driver: No, don’t report a breakdown

2. Driver can ask the Trip assistant to find the nearby petrol pump to add the fuel. In this 2nd feature trip assistant will ask the user:

Driver: Yes, I want to fuel up

Do you really want to add fuel?

Driver: Yes, I want to fuel up

(Alternate narrative) Driver: No, I do not want to add fuel.

Are you sure you want to add fuel?

Driver: No, I do not want to add fuel

3. At the end of the trip, the Trip assistant will ask the driver to mark the trip as complete. In this 3rd feature, the Trip assistant will ask the user:

Driver: Yes, I want to mark the trip as complete

Do you really want to mark the trip as complete?

Driver: Yes, I want to mark the trip as complete

(Alternate narrative) Driver: No, I do not want to mark the trip as complete

Are you sure you do not want to mark the trip as complete?

Driver: No, I do not want to mark the trip as complete

Note: If needed, one can add more interactions to the Trip assistant. Activities like finding a nearby restaurant can be added to this routine to make the experience extremely user-friendly and real. All of this is done keeping in mind the requirement of the user and hence is an ode to customization and uniqueness.

Services Used

These are the list of services we used from the amazon developer console.

1. Login with the Service provider (Mandatory to use the voice service): Login with the service provider is a service that allows members of that platform to sign into other online services. With the help of the login with a service provider, we can access the services of voice-enabled interaction.

2. AI trip assistant skills set (the custom skills were created for this project): An AI Trip assistant skill is a voice-driven feature on the driver’s device. A skill is added to AI Trip assistant enabled devices, to help the driver to get more out of both the device itself and the service provider’s voice assistant.

3. Service provider’s voice service: The Service provider allows device manufacturers to integrate AI Trip assistant voice capabilities into their own connected products by using the AI Trip assistant voice service, a cloud-based service that provides APIs (Application Programming Interface) to interface with AI Trip assistant.

Use Case

It can be used by the delivery agent when he would be delivering goods for the day. He can say, for instance, kindly mark product ID 123 as delivered. He may also report an issue regarding a particular product or delivery. Additionally, he can even request fuel resources nearby.

About ACC

Applied Cloud Computing (ACC) is a top-tier AWS consulting firm. ACC accelerates end-to-end cloud adoption with the best implementation services, software, and processes available with the best implementation services, software, and processes available, ACC accelerates end-to-end cloud adoption. ACC’s comprehensive cloud adoption framework and dedicated software development capabilities help clients achieve business results faster, regardless of where they are in their cloud transformation.

--

--

Applied Cloud Computing
Applied Cloud Computing

Written by Applied Cloud Computing

Applied Cloud Computing (ACC) is an IT Services & Consulting Company. It helps customer in Product Engineering, Digitalization, Big Data & Security Assessment.

No responses yet