Bot Or Not: Turing Test

Bot Or Not: Turing Test

Financially incentivizing AI Agents to pass the Turing Test.

Created on 1st March 2025

Bot Or Not: Turing Test

Bot Or Not: Turing Test

Financially incentivizing AI Agents to pass the Turing Test.

The problem Bot Or Not: Turing Test solves

Firstly, Bot or Not creates a financial incentive for better prompt engineering, encouraging users to craft prompts that make AI responses more naturally human-like.
Secondly, the problem of AI Agents being hard to detect has become rampant in social media, where we're unsure if we're talking to real people or bots. By engaging in our app, users can become better equipped to identify AI Agents against real people.

It does this via a gameficition process with a similar playstyle to Among Us, where a randomly selected player has their AI Agent speak on behalf of them. It is the user's goal to create a prompt convincing enough to have their AI Agent fool all users in the game, such that the user takes away the entire prize pool.

User Interaction and Data Flow

  1. Users connect their wallet and contribute 10 USDC to a prize pool join a game.
  2. Upon joining, they submit their username and a prompt for the AI agent.
  3. After a 20-second countdown, the game begins with a randomly selected player having an AI agent (via CDP AgentKit) chat on their behalf.
  4. Players engage in a 1-minute chat session where they try to determine who is the AI.
  5. A 10-second voting period follows where players select who they think is the AI.
  6. Results are revealed, and winners (those who correctly identified the AI) split the prize pool, which is automatically distributed via smart contract. If the AI was not identified, the AI Agent operator receives the entire prize pool.

The AI-controlled player cannot send messages or vote, as they're played by the AI agent using the prompt they submitted

The project architecture and development process

The application follows a client-server architecture with three main components:

  1. Frontend: Next.js application with Tailwind CSS for styling and CDP OnchainKit for wallet integration, hosted on Vercel.
  • React components handle different game states (lobby, waiting room, chat room, voting, results)
  • Context providers manage game state and WebSocket connection
  1. Backend: Python WebSocket server hosted on Render
  • Manages game state, player connections, and game flow
  • Integrates with CDP AgentKit API to generate AI responses based on user prompts
  • Tracks voting and determines winners
  1. Blockchain: Solidity smart contract (using Foundry) deployed on Base
  • Handles payment collection (10 USDC per player)
  • Distributes prize pool to winners based on game results
  • Data flows from the frontend through WebSocket connections to the backend server, which orchestrates game states and AI responses. Smart contracts handle the financial transactions on the Base chain.

Product Integrations

  • CDP AgentKit: Provides the AI agent capabilities for natural conversation of the bot in the group chat. The bot’s personality is crafted according to the user’s prompt.
  • CDP OnchainKit: Handles wallet connection and blockchain integration
  • Base: Blockchain used for building this app.
  • USDC: Stablecoin used for placing bets.
  • WebSockets: Real-time communication between frontend and backend
  • Vercel and Render: For front and back-end hosting
  • Foundry: Development framework for the Solidity smart contracts to redistribute the prize pool among the winners

Key differentiators and uniqueness of the project

There is currently no product out there that pays you to identify AI Agents or create AI Agents that pass the Turing Test, making our solution the first.

Our product has multiple unique key features:

  • AI prompt engineering sandbox: Users can test and improve their prompt engineering skills in a gamified environment
  • Financial incentive structure: Unlike other social deduction games, Bot or Not creates a real monetary incentive for both detecting AI and crafting convincing AI prompts.
  • Educational value: Players improve their ability to detect AI-generated content through gameplay
  • Real-time competitive game: The time-limited nature creates urgency and excitement, and provides users with a feeling of skill involved when playing.
  • Blockchain integration: The use of smart contracts ensures transparent, trustless, and automatic prize distribution.

Current gamified implementations of the Turing test that we've tried out did not provide financial incentivizes meaning no real players used them. They were also too slow-paced to keep the user engaged. AI-bots are not very fun to chat with, so having a long time with them one-on-one in a chatroom is boring, and makes one quit the game early.

Our project fixes this by introducing financial incentives in a fast-paced group chat environment, so you’re not talking to just the bot, but rather a whole bunch of people at the same time.

Trade-offs and shortcuts while building

We did not figure out how to have custom labels on the buttons provided by Onchain Kit, so we used the default text and added our label above the button.
Initially we aimed to launch this on Mainnet before the submission deadline to show real product market fit, but we faced small bugs with the experience of using our app that made our product feel less polished to the users. As a result due to the limited time, we kept our deployment on testnet to focus on fixing the bugs.

We plan to launch this on Mainnet and market it on twitter to users who are looking to challenge their skills in prompt engineering and prompt detection.

Additional Features

We did not start our project before the Buidlathon.

Tracks Applied (7)

Build an AI-powered app on Base

We've built the next addicting app that will onboard the masses onto Base. Focused on giving users a fun gamified experi...Read More
Base

Base

Best Use of CDP SDK

Our app uses CDP's agentkit, onchainkit, and onramp to provide a onestop solution to prompt engineering an AI agent to h...Read More
Coinbase Developer Platform

Coinbase Developer Platform

Consumer Crypto Prize

The ability to identify if you're talking to an AI Agents or a real person is a big problem. Our consumer app helps user...Read More
Coinbase Developer Platform

Coinbase Developer Platform

CDP Regen Prize

Our project focuses on increasing transparency behind how AI Agents may attempt to trick users to blend in as a human.
Coinbase Developer Platform

Coinbase Developer Platform

Best Use of Coinbase Onramp & Stablecoins

We use USDC stablecoin for our prizepool, and allow users to fund their wallet with USDC directly from our app via CDP O...Read More
Coinbase Developer Platform

Coinbase Developer Platform

Best Developer Feedback

Throughout our development experience, we've taken notes on multiple areas of improvement that we've submitted to the de...Read More
Coinbase Developer Platform

Coinbase Developer Platform

DEFI, NFTS + GAMING

We built a game that is played similarly to Among Us, where multiple users join a groupchat and one of them is an AI Age...Read More

Cheer Project

Cheering for a project means supporting a project you like with as little as 0.0025 ETH. Right now, you can Cheer using ETH on Arbitrum, Optimism and Base.

Discussion

Builders also viewed

See more projects on Devfolio