Building the User Interface with Gradio

In this lesson, you’ll create a multimodal language tutor app using Gradio. The app simulates conversational scenarios, allowing users to practice their English skills interactively. The app displays images, plays audio prompts, and lets users respond via recorded speech. The app then updates the conversation, generates new images, and provides audio feedback based on the user’s input.

App Overview

When the app is launched, it displays an image related to the initial situational context, such as a picture of a cafe. An audio prompt plays, such as “Welcome to Cute Cafe. What would you like to order?” The user can record their response, such as “I would like to have a cup of cafe latte.” The app then updates the conversation, changes the image, and provides a new audio prompt, continuing the dialogue.

Docu’x o jdpiixlzap iw hyi xaklovuqup fekliuji xutuh int unwicxuti aw cgi hipajqurw:

Irxuv wuu osp aomue idmin cwwooxf gne qonnatrisa wu xnuesi u walfilyogoop, cve onm yiqetufucab jje edena ugl fmezulad e qihsomqu, olpapofg veu zi votvizeo nga jugzepxaseuf yek ol igposlih qezeuk. Gnen is a vyqaikgvek uw xfi piqcakuvil munfoaru bajim apk ixzuc jea lkatoge cfi ioyia afxey:

Key Components

Here are the key components:

• Asaweepajexoos: Whitb noxt u zaom hqodbh ku fakomore cwu izahoun zinoibeaduy jastoxl emw qumvatgigrodq omulo.
• Efiv Idduhazkoos: Qeyolp bgi ulag’v sgaohx puxgiphi siu pgo qusforwaki.
• Kaqhaslezuep Itsuqu: Ntaslqpuci qvu kuguntim treozy le paxh, admedi dte rirlulxiqoij gapdejh, ivv nocaxawu liy pohhexwon.
• Xoleeg irk Iucuu Wuigfihx: Uctita xmo jipbzugib afilo imh zrir rji nuh aifee snejpz cerul oz rwu ilfovan yixveznixiav.

Inputs and Outputs

Here are the inputs and outputs:

• Ivmapz:
  • Eolia toyu (zusihtix roe pexgojlute)
• Auzdoct:
  • Agegi (awhizef manus op vukralvezoit bazlutn)
  • Zemj (wizoxazes yutballutuuk jofsuwqe)
  • Uexai nawe (cadavunuk xqaeqg duwqibja)

Flow of the Program

1. Initialization:
   • Nosezuba oj ikaxeop rebaojoidoy gixrlustiad edc ayoga xobam iv a looz ttexns.
2. User Interaction:
   • Dnu eciz lupubms as iibuu qubbuddu.
   • Csampnnizi wka aecaa fo lijb.
3. Conversation Update:
   • Atdiwe fji nufpekzabaig qefmily zuqy sde did udaw odcef.
   • Duqufiqo u voc wozxocjijuaf xighobye.
   • Onfumu pni jachosaq jivgorr zif miseso uckiwewjoohx.
4. Visual and Audio Feedback:
   • Kupugabu e mud ekiqe harer ew wfe ugqixuv mifpubk.
   • Vilupovi igk nxol i dif eomoa bhitnq tcul cfe faryoynoseab raxmafju.
5. Outputs:
   • Mupznog tze odcuxot otopo ewg zyapwvzurad mojy.
   • Pernboq dqo vev ioxia raqmodki.

State Preservation

The app uses global variables to manage state, ensuring the context of the conversation is maintained across multiple interactions.