FlowNet AI : Decentralized inferences for everyone

FlowNet AI : Decentralized inferences for everyone

Decentralized network of AI nodes managed by blockchain

The problem FlowNet AI : Decentralized inferences for everyone solves

FlowNet AI is generative AI marketplace of decentralized inference nodes where the requests from users and responses from decentralized AI nodes are managed by a smart contract and incentivized by a coin token

Motivation - Access, availability and incentive alignment for inference tasks

  1. Anonymity: AI Inferences is hard to get for layman anonymously - gatekeepers of models require you login to their systems
  2. Difficulty: AI Inferences is hard to get for layman easily - gatekeepers models are closed source/ open source models require you to interact with code
  3. Open dashboards at capacity: Open AI Inference dashboards run out of capacity - eg. ChatGPT being at capacity most of the time. Paid options require intensive data sharing.
  4. Developer incentive alignment: Independent AI Inference model developers have no incentive to host their nodes and pay for compute cost

Our solution - Fully on-chain logic and fully open source

The project has 3 components - UI for user, CLI for model developers and smart contract that acts as a task queue as well as a settlement layer and escrow

User (eg. wants an image from a prompt)

  1. Logs in with any wallet supported on Flow chain - Passwordless and gasless experience
  2. Earns FlowNet Tokens by rating past images
  3. Enters prompt and selects node to ask for inference at the cost of FlowNet Tokens

Node (earns FlowNet Tokens by fulfilling requests)

  1. Clones the Github FlowNet AI Node Repo Simple CLI commands to set up the node
  2. Produces output for for user to evaluate
  3. Earns FlowNet Tokens by fulfilling AI requests
  4. Gets rated by users building up to an on chain reputation score
  5. Prompt-Model-Parameters become an NFT for users to evaluate

Challenges I ran into

  1. Debugging: Was a little difficult due to the number of data types available and nullable types
  2. Python CLI: Coming up with a clean CLI for ease of development was a little challenging

Tracks Applied (3)

AI

The project decentralises access to state of the art models by incentivising users and nodes both with tokens and NFTs a...Read More

Everything else

The project is built on the ethos of Web3 - unalienable access to AI models for mainstream users. To the team, hitting p...Read More

Ecosystem Tooling and Infrastructure

The project has 3 parts, a user facing UI, smart contracts deployed on the Flow testnet, CLI for running a node on any m...Read More

Discussion