The problem FlowNet AI : Decentralized inferences for everyone solves
FlowNet AI is generative AI marketplace of decentralized inference nodes where the requests from users and responses from decentralized AI nodes are managed by a smart contract and incentivized by a coin token
Motivation - Access, availability and incentive alignment for inference tasks
- Anonymity: AI Inferences is hard to get for layman anonymously - gatekeepers of models require you login to their systems
- Difficulty: AI Inferences is hard to get for layman easily - gatekeepers models are closed source/ open source models require you to interact with code
- Open dashboards at capacity: Open AI Inference dashboards run out of capacity - eg. ChatGPT being at capacity most of the time. Paid options require intensive data sharing.
- Developer incentive alignment: Independent AI Inference model developers have no incentive to host their nodes and pay for compute cost
Our solution - Fully on-chain logic and fully open source
The project has 3 components - UI for user, CLI for model developers and smart contract that acts as a task queue as well as a settlement layer and escrow
User (eg. wants an image from a prompt)
- Logs in with any wallet supported on Flow chain - Passwordless and gasless experience
- Earns FlowNet Tokens by rating past images
- Enters prompt and selects node to ask for inference at the cost of FlowNet Tokens
Node (earns FlowNet Tokens by fulfilling requests)
- Clones the Github FlowNet AI Node Repo Simple CLI commands to set up the node
- Produces output for for user to evaluate
- Earns FlowNet Tokens by fulfilling AI requests
- Gets rated by users building up to an on chain reputation score
- Prompt-Model-Parameters become an NFT for users to evaluate
Challenges I ran into
- Debugging: Was a little difficult due to the number of data types available and nullable types
- Python CLI: Coming up with a clean CLI for ease of development was a little challenging