AI Agent for Coinbase Wallet

AI Agent for Coinbase Wallet

Simplifying crypto for LATAM through real-time AI-powered voice interactions

255
Built at Based LatAm
AI Agent for Coinbase Wallet

AI Agent for Coinbase Wallet

Simplifying crypto for LATAM through real-time AI-powered voice interactions

Why are you participating for Based LatAm?

I'm trying to simplify blockchain access for LATAM users by addressing the complexity and language barriers in current solutions. The voice-enabled wallet makes it easier for users to interact with decentralized finance tools in their own language

What challenges are you focusing on?

I'm tackling two main challenges:

  • Complex User Interfaces: Blockchain apps are hard to use, especially for those new to the technology in LATAM
  • Language Barriers: Many blockchain tools are in English, which creates difficulties for non-English speakers in the region

How does your submission address this challenge?

The voice assistant lets users interact with their Coinbase Smart Wallet using voice commands in their native language. This simplifies complex operations, making blockchain tools easier to use and more accessible for LATAM users

Challenges I ran into

  • Integration between OnchainKit and OpenAI Realtime API: One of the main challenges was getting these two templates to work together seamlessly. OnchainKit had a very specific structure, while OpenAI’s Realtime API required dynamic interactions. To solve this, I created custom handlers that could route the data from one technology to another without breaking any of the existing functionality.
  • OpenAI Realtime API and Twilio costs: Another issue was managing the costs associated with running the OpenAI API alongside Twilio. Since Twilio charges per message sent and OpenAI's API costs are usage-based, the project quickly became expensive during testing. To mitigate this, I implemented chat-based interaction, ensuring that API calls were made only when absolutely necessary. This reduced the frequency of both OpenAI and Twilio requests, keeping the costs manageable while still maintaining testability.

Additional Features

I started the project from scratch for this buildathon.

Cheer Project

Cheering for a project means supporting a project you like with as little as 0.0025 ETH. Right now, you can Cheer using ETH on Arbitrum, Optimism and Base.

Discussion