Index:

Introduction

It's time to overcome the limitation of just exchanging text messages on your Smart Contact! With our extension, you can expand functionalities, transforming texts into audio and offering a unique listening experience to your users.

Ensure practicality and accessibility in your communication now!

This extension is paid for and developed by the company White Wall.

How does it work?

The extension features the following functionality:

Easy integration with Smart Contact - Simplified adding audio to conversations, hassle-free.
Text to audio conversion -Transformation of written Smart Contact messages into audio, offering an immersive listening experience for users.

Integration with other extensions - Synchronization with extensions such as ChatGPT, FAQGPT, Blip Autopilot, among others, to create even more immersive conversations.

Installation and configuration

First, log in to the Blip platform and access the Blip Store. Then, click on the three dots in the top right corner and select the “Text to Speech (TTS): OpenAI” extension. Then, enter your OpenAI key.

Select a voice model. Click the play icon (▶️) to test the voices.

You can change the example by clicking the pencil icon (✏️).

After choosing your favorite voice, click “Save”.

Attention! To be able to use the extension in Builder, you must also install the extension in Chrome. Click here and install it.

Configuring the Extension Text to Speech (TTS): OpenAI

Configuring the OpenAI Extension - Text to Speech (TTS)

With the extension installed, a new block must be added to the Builder.

Select “New Integration”.

When creating this block, select the "OpenAI Text to Speech" integration. In the bar below, enter the text that will be converted into audio.

In addition to being able to define a default text, you can integrate with other Blip extensions: ChatGPT, FAQGPT, Blip Autopilot and others.

Usage Examples

If your company is looking for agility, increased productivity and accessibility in chatbot support, this extension is ideal for you.

With it, your chatbots' texts can be converted into audio, providing your customers with a unique and personalized experience.

How can this benefit your company's day-to-day operations?

Imagine a situation: a person is driving and needs to remember a doctor appointment they had forgotten. She wants to know the doctor's name and appointment time. Naturally, you cannot use your cell phone to read or write messages while driving. With the activation of audio in the chatbot, this problem is easily solved through the extension, providing security and practicality.

For people with visual impairments, audio is an essential tool. In addition to listening to chatbot messages, they can also interact using voice commands. This eliminates communication barriers and facilitates inclusive problem-solving.

Additionally, while some people find audio annoying, for others, it creates a sense of connection and trust in service. Current technologies make system voices less robotic, promoting more humanized and pleasant interactions, which can improve customer satisfaction.

Reading textual messages in chatbots can also be difficult for some people. Incorporating audio is a way to expand reach and ensure that all customers feel welcomed.

With the evolution of multimodal technology, it is possible to transform challenges into solutions and offer more complete and accessible experiences to your customers.

To learn more about the topic, check out our mentorship with Blip on the use of Artificial Intelligence and ChatGPT at Blip on YouTube!

Enabling OpenAI - TTS for audio understanding in ChatGPT

After installing OpenAI, you can integrate it with the ChatGPT extension.

Attention! Don't forget to first install and configure the Open AI and ChatGPT extensions on your Blip. To see how to install and configure the ChatGPT extension, see herei or access this tutorial.

With the ChatGPT extension configured, customize the bot: define name, tone of voice, creativity and customer interaction guidelines.

Then click "Enable multimodal understanding". Multimodal mode allows the chatbot to understand and interact with different formats, such as images, audio and documents.

That's it, the OpenAI ChatGPT integration is now complete.

Sending audio from ChatGPT with OpenAI - TTS

Configure OpenAI in your Builder. Select the desired voice.

Then access your Builder. You will see the ChatGPT integration block and should add a new block for OpenAI.

Click the "➕" (Add) button in the left corner of the screen and select "New Integration".

Set the name of your block.

Delete the “User Input”.

Then click "Integration" and select "OpenAI Text to Speech" in the bar.

In the text field, enter the variable defined in the ChatGPT configuration. In this example, the variable is {{result}}, previously configured so that messages are converted into audio.

Then configure the exit conditions.

Ready! Your integration is complete.

Creating submission rules for OpenAI - TTS

To further personalize your chatbot communication, you can create sending rules. To do this, click on "Exit conditions". In this section, you can define whether the chatbot will send text or audio to the customer.

Attention! It is essential to have the form of communication previously defined. Therefore, review your knowledge base for better communication.

In the following example, we consider a customer who sent an audio and we want to respond using the same format.

In the OpenAI dashboard, located in the right corner of the screen, click on "Exit conditions".

Configure the "If" block and then define the condition.

In the "Variable Name" field, enter: input.content@type.

Enter the values "audio" and "voice".

Then set the "Go to" action to "Text to Speech."

Once the configuration is complete, click "Publish" in the bottom left corner of the screen.

Carry out a test.

That's it, your configuration is ready!

Support

If you have any questions or encounter any issues with the extension, please contact us by email support@whitewall.dev.

Also discover our channel on YouTube and discover our other extensions!

For more information, access the discussion on the subject at our community or the videos on our canal. 😃