The future of AO - an infinitely scalable application consensus interactive system

Author: PermaDAO

The term "narrative" is very popular in the crypto industry. It originates from a sociological concept "Metanarrative" proposed by the French philosopher Jean-François Lyotard, which is used to describe stories that serve as universal ideals and have basic legitimacy in political propaganda.

However, the encryption industry is increasingly misled by the concept that it seems that the "narrative" determines the value of a project, rather than the increase in production efficiency or improvement in production relations that the project itself can provide. Since the announcement of Hyperparallel Computing Network AO on February 28, it has mostly been interpreted as a narrative upgrade for Arweave. It allows Arweave to evolve from pure decentralized storage to "Storage + Computing" and become a member of Ethereum's killer lineup.

It would be a deep regret if the understanding of AO only stayed at the "narrative" level. When you try to get closer to understanding AO, you will find that it has huge potential and has the opportunity to bring far-reaching changes to the encryption industry. Different from the blockchain network in our impression, AO seems to have no boundaries and no restrictions, and everything is possible. We have noticed that in less than a month, a series of exciting applications developed based on AO have emerged, including instant messaging software, social platforms, games, etc. Perhaps a few years from now, the entire encryption industry will realize that where we are now is not just a junction of some kind of narrative upgrade, but the beginning of a real paradigm shift!

In order to let developers, researchers and even investors in the encryption industry have a deeper understanding of AO, PermaDAO invited two founders of AO to conduct a discussion on the origin, evolution and future vision of AO. AO’s in-depth talk. They are Sam Williams, founder of Arweave and CEO of Forward Research, and Outprog, founder of EverVision, proposer of the SCP paradigm, and early AO concept designer.

The development history of AO

First, Sam recalled to us the development of AO in his memory. During the early COVID-19 lockdowns in 2020, the Arweave team discussed and developed a concept via Zoom meetings: creating a neutral decentralized computational logging system capable of inferring the state of any program. Based on this concept, they quickly developed a basicsmart contract system SmartWeave and released it as a proof of concept. SmartWeave quickly became a success, attracting many teams to join the Arweave ecosystem in the summer of 2020 to build SmartWeave-based projects, which became the core of the Arweave ecosystem. Subsequently, Outprog proposed the Storage Computing Paradigm (SCP), extending the concept of computational logs to all types of data logs, and wrote a series of articles that laid the foundation for understanding the core theory of AO.

AO's idea further proposes implementing SmartWeave inside bundled interactions, where these data items can have their own labels, not subject to scalability constraints, but with different data availability properties , heralding the possibility of an arbitrarily scalable computing system. The core design of AO is message passing, which abandons the interactive lock in traditional SmartWeave and uses a message log. These messages can come from users or other processes. This design began development in the summer of 2021 by the Forward Research team. By the end of 2022, AO’s architecture was proven to be feasible and able to scale horizontally. The internal testnet was launched in January 2023 and was quickly joined by 30 active developers. Subsequently, the testnet was publicly released at the end of February. In just three and a half weeks, approximately 3,000 developers were attracted to join and build the project, demonstrating the community's broad acceptance and interest in AO.

Outprog also described the birth history of AO based on his experience with Arweave. Since July 2020, he has joined the Arweave ecosystem and started researching it, attracted by its potential as a consensus data store, which he believes opens up endless possibilities for computing.

everVision Labs founded by Outprog is an active builder of the Arweave ecosystem, with the goal of promoting the large-scale adoption of Web3. everVision Labs developed everPay, the first multi-chain payment network on Arweave and a bridge between the Arweave ecosystem and other blockchains. The project received investment from Arweave in May 2023. everPay is completely 0 gas and requires no waiting. All data will be uploaded to Arweave to ensure verifiability. Permaswap, the decentralized trading platform built into everPay, provides an instant, zero-fee, and slippage-free trading experience for assets in everPay. This is the first and most mature DEX product in the Arweave ecosystem.

In the 2022 Singapore Token2049 event, EverVision held Arweave Day in Asia, so Sam came to Singapore. In the evening, at a dinner organized by the well-known organization SevenX, Outprog and Sam talked about the possibility of parallel computing based on consensus data. As the conversation progressed, the two gradually put down their bowls and chopsticks and picked up whiteboard pens. What was originally a sorority party turned into a technical seminar. In June 2023, at the Arweave ecological gathering in Berlin, Outprog was inspired by the communication with Sam, and designed a message protocol (Message Protocol) for trusted communication between SCP applications, which can be regarded as the predecessor of AO.

AO The Process of Design and Improvement

Sam mentioned that in the early stages of the project, the team envisioned AO was built as an extension layer on top of Warp, but they quickly realized that this approach would require fundamental changes to the SmartWeave architecture, which was impractical in practice. As the team continued to focus on the development of AO late last year, at the end of the year, they ushered in a breakthrough "almost discovery" moment, confirming that the designed architecture was not only reasonable and feasible, but also capable of horizontal scalability. When using AOS for the first time, the team experienced a completely new way of operating: they were able to log in and launch any number of processes inside the system, all running in an unbounded flat space. Users can easily log into processes, issue commands, and communicate seamlessly with other users' processes in a way that is not only highly composable but also highly scalable.

Why AO iscalledthe World Parallel Computer (global  parallel computer)

Sam said that AO provides asingle system image that enables users to work on a unified and single Computing environments experience the underlying structure that consists of many different computers. This system supports running an unlimited number of processes in parallel in a decentralized environment, achieving true parallel computing, as if creating a powerful decentralized supercomputer. Its design is inspired by the idea of ​​distributed operating systems, which aim to increase the capabilities of a home, office, or workplace by adding more computers, while making the user feel like they are logged in to a single computer. AO's test network runs on more than220,250 different nodes. Anyone can connect their own computing unit to this system, thereby increasing the overall computing power and making AO a A democratized supercomputerwhere users can log in and perform computing tasks from a variety of devices, such as laptops or mobile phones. This design not onlyfacilitates broad user participation but alsoincreases the accessibility of decentralized computing, whether by running a node or using a service for computing.

Outprog recalled that the original idea of ​​AO was an omnipotent state machine, which is similar to an all-purpose and reliable computing platform. The client, operating system and All running programs originate from Arweave. AO itself does not solve the problem of verifiability. With the SCP paradigm, verifiability is provided by the consensus data on Arweave.

The function of AO is actually to replace the traditional HTTP communication protocol with the Message Protocol and provide a decentralized messaging method for SCP applications. Thus facilitating communication between decentralized applications. According to the vision in July 2020, if both user requests and server responses are processed through AO, it will be possible to rebuild a truly decentralized Internet and migrate the entire Internet to Arweave. The value of AO goes beyond storage. It can also record current stories and distribute future value in a decentralized manner, turning Arweave's "Library of Alexandria" into a platform for recording and distributing value.

AO With traditional blockchainssuch as Ethereum, Solana, also< strong>There are also differences in the ICP of world computers

Sam

1. Comparison with Ethereum

Ethereum is described as a "world computer", but in fact it is more like a "world calculator". Although it enables Many innovative applications, but did not live up to the original vision of a global computer. AO adopts a different architecture. It does not optimize the global shared address or memory space, but allows each contract to have local private memory and interact through message responses. This is fundamentally different from the Ethereum model.

2. Comparison with other blockchains such as Solana

Solana and some other blockchains (such as Sui, Aptos) adopt widely different architecture, but the key differentiator of AO is its messaging approach. AO believes that optimization of global shared memory space should not be used in order to achieve scale, based on practical experience outside the world of distributed systems and traditional networks.

3. Comparison with ICP

ICP handles the calculation itself and the achievement of consensus through consensus, while AO useslazy evaluation ( lazy evaluation)Method of calculation. AO has a dedicated subnet, the computational unit, for performing these calculations. This approach differs from the way ICP handles computation and consensus reaching. The ICP community seems to have challenges in forming consensus on the fly, while AO, through its subnet of computing units and staking mechanism, is able to provide more reliable and economically guaranteed computational output.

4. The unique features of AO

The design of AO is inspired by the historical lessons of distributed operating systems, especially those learned in the 1980s and 1990s. The limitations of the shared memory approach in distributed operating systems are noted. AO takes the messaging approach that is the foundation upon which the Internet is built, delivering messages and computing across a wide network over TCP/IP. AO brings this concept to the blockchain, achieving the same good scalabilityon-chain as off-chain. AAO does not directly form a consensus on the results of the interaction (i.e., the computational output), but rather on the inputs to the interaction and the order of those inputs. This means that the AO is concerned with the order and availability of data rather than directly agreeing on the calculation results. Although AO's consensus does not directly target the calculation results, the output of the calculation is still trustworthy and verifiable. This is because AO has a dedicated subnet of computing units, and even on the testnet, there are a large number of computing nodes waiting to perform calculations and provide staked, verifiable responses. Since AO uses a deterministic virtual machine and there is consensus on the order of interactions, there is also consensus on the calculation results. This ensures that calculation results are consistent and predictable, if not instantaneous.

Outprog

1. AO is a new interaction layer

Traditional blockchains such as Bitcoin and Ethereum mainly solve The Byzantine Generals Problem, achieving consensus on a single event in a distributed network. AO and SCP (Storage Consensus Paradigm) no longer focus on the issues of blockchain and objective truth, because in blockchain systems, these issues have been passed through Proof of Work (PoW) or Proof of Stake (PoS)is well solved, and AO is a completely new interaction layer built on top of the original blockchain infrastructure.

2. Separation of consensus and calculation

SCP emphasizes that consensus occurs at the storage layer, using Arweave for immutable storage to ensure security and verifiability. . On Arweave, there are Merkle trees and consensus on the order of the data, rather than the state of the data computation. Essentially, AO does not solve the problem of verifiability, and the functions of AO and AR are completely separate.

3. AO’s calculation processing

AO is responsible for calculating and organizing data sequentially on Arweave to generate states. Since AO cannot change the order of data on Arweave, it cannot change the consensus. Ethereum, Bitcoin, Solana and ICP all use on-chain computing, which is obviously different from the design concept of SCP. SCP allows AO to perform computation on top of Arweave's storage layer by separating computation and storage, while the storage layer is responsible for maintaining the immutability and security of the data.

What use cases do developers have that were not possible in traditional blockchains but can be implemented in AO?

Sam is the developer Provides some reference directions

1. Decentralized computing infrastructure

AO provides a The new form of cyberspace has the potential to decentralize the world’s computing infrastructure, making the cost of running computations comparable to running on cloud services (such as Amazon EC2), while also providing the verifiability of smart contracts.

2. Large-scale computing as smart contracts

AO allows developers to build large-scale computing smart contracts, which is not possible in other This is impossible to achieve in existing smart contract systems. These smart contracts can perform financial interactions, such as automated algorithmic funds, which automatically adjust buy and sell orders based on market data and news.

3. Trust-minimized financial services

Developers can create trust-minimized financial services, such as decentralization With algorithmic funds, users can deposit tokens without trusting the fund manager, and all operations are automatically performed on the chain.

4. Decentralized data and information processing

By using Oracle services such as 0 rbit, developers can Process and verify large amounts of data from the Internet on AO without trusting a centralized Oracle provider. This service enables trust-minimized access and processing of HTTPS-encrypted data across the entire Internet.

5. Autonomous AI agents

On AO, in the long term, a network composed of autonomous AI agents can be imagined space, where these agents live and interact in their own virtual universe, unconstrained by the laws of real-world physics.

6. New financial system

AO allows developers to build a new financial system that includes autonomous finance Agents, which can make decisions autonomously based on market information and allow users to deposit or withdraw funds at any time.

What is the next development and roadmap of AO? When will the mainnet be launched?

Sam explains AO's future roadmap

Current development stage

Build The main network V1.0 version has been released and is currently running as a test network. The core data protocol has been completed and no major changes are expected. The data protocol itself does not provide security, but already forms the basis of AO.

The second phase goal

will A staking mechanism that operates using a set of nodes and three different subnets, each responsible for performing specific tasks, requires staking to ensure that these nodes and subnets operate as expected and enhance system security. The staking mechanism not only guarantees the normal operation of nodes, but also provides security guarantees for computing, message delivery, and process scheduling. Although related smart contract designs should be kept simple, they must be adequately tested to verify their reliability. Nodes will also assume the role of "gatekeepers", responsible for monitoring processes, child nodes, and conducting network voting when violations of security policies are detected. AO's core protocol infrastructure is composed of an overlay of underlying data protocols, off-chain implementations of nodes, and smart contract layers that allow for staking and penalties, thus building a decentralized and trustworthy computing environment.

Third Stage Objectives

AO The long-term development goal is to gradually realize strict security protocol execution of computing units, messaging units, and scheduling units by combining a hybrid authority proof system and a pledge proof mechanism. This process will involve creating software to enforce security rules and smoothly upgrade the system after a period of operation, allowing scheduling units to be staked and users to run schedulers autonomously. AO aims to gradually increase the degree of decentralization and eventually become a permissionless decentralized proof-of-stake system. The transition to mainnet previews and release candidates is expected through a series of testnet versions, which may take several years until the data protocol and smart contract layers reach 99.5% stability, at which point the system will officially become mainnet.

How will AO develop in the future

AO The team hopes to take an approach similar to Solana's "mainnet beta" early on until version 2.6 is reached. Over time, the team can get better at this. It is almost certain that a solid foundation is in place to provide the world with protocol-based assurance that the core architecture of the system will not undergo large-scale changes. Although it has taken about six and a half years to develop AO, it is hoped that future development processes will be shorter and more mature. The team ensured an architecture that was nearly optimal from a scalability perspective before starting to build AO, recognizing that it could do better with naming and versioning early on. I believe the team will adopt a more mature approach to AO to optimize the development process and timeline.

Continue EverVision  Whatskind ofactions are there? EverVision Whats are being produced in AOs State contributioncontributiontoandhow to participate in the construction of AO in the future?

Outprog

everVision is a laboratory with the goal ofExploring the Block Chain large-scale application. AO may be a best practice for the current large-scale application of blockchain. The team will reconstruct the work results of the past few years according to AO's specifications, which means that EverID can become a universal identity standard on AO, making it easier for ordinary users to use these applications. At the same time, everPay’s cross-chain capabilities will also be transformed into native cross-chain capabilities on AO. AO's "sub-ledger" can greatly solve the problem of payment expansion. These are the key points that we need to integrate technically.

Permaswap has launched AO test token CRED. Now you can establish liquidity for CRED/AR. You can also easily trade CRED on Permaswap or provide liquidity. sex to earn fees. Permaswap is a very mature DEX product and can be regarded as the Uniswap of the AO ecosystem. Next, Permaswap will also highly integrate AO. The tokens on AO will be able to easily create trading pairs on Permaswap and support multiple market making curves.

everPay will also deeply integrate AO and become a bridge connecting the AO ecosystem with other ecosystems. EverID is committed to becoming the universal identity layer of the AO ecosystem and is committed to solving the challenges that the high-threshold public and private key account system brings to users entering Web3.

Sam said that losses from protocol changes that occur on other blockchains will not AO Reenactment

Changes on Ethereum have caused damage to projects such as Aragon, and protocol changes may bring risks to users. People have concerns about building applications on AO, especially when the system is marked as a testnet. They are concerned about the stability and integrity of the system. Although this may pose communication challenges, the team chose to clearly communicate the current status of the system and possible future changes. When building the protocol, the team valued the importance of providing users with immutable and guaranteed rights that should not be controlled by any one person or organization. To better manage user expectations, the team uses terms like “mainnet preview” and “mainnet release candidate” to describe the current state of the system and anticipate possible future changes. When the system reaches an almost completely certain state, it will be called the mainnet and will have appropriate permissionless upgrade and fork capabilities, ensuring the long-term stability of the system and the protection of user rights.

How to understand the concept of AO neutron ledger (sub Ledger) and its Its function?

Sam

The sub-ledger provides a mechanism that allows the system to create new processes (i.e. sub-ledgers) when the single-threaded computing power of a single process reaches saturation. ledger) to add additional computing threads. This approach is similar to creating new tables or shards in a traditional database to spread the load and increase overall processing power. Subledgers allow computing power to be naturally dispersed across a decentralized network, meaning that computing power can be dynamically adjusted and scaled based on the computing resources available in the network.

The interaction and data transfer between sub-ledgers is designed to be flexible enough that users and application developers do not need to be aware of the complexity behind it. Users can seamlessly conduct transactions and interact between different sub-ledgers as if they were operating on a unified ledger. Tokens between sub-ledgers can be interoperable, that is, tokens on one sub-ledger can be seamlessly transferred to another sub-ledger, and the two can be merged into a unified balance. This design increases the liquidity of the token and simplifies the complexity of managing multiple accounts for users.

The concept of sub-ledgers makes it more feasible and efficient to build a payment network on AO. In theory, this could support the creation of a global payments system where users can easily pay in any currency, anywhere, via their mobile phones. Through the design of sub-ledgers, AO achieves unlimited scalability, which means that the system can expand infinitely as demand grows without encountering scalability bottlenecks common in traditional blockchain systems.

Summary

Through this in-depth dialogue about AO, we learned that SCP theory is one of the theoretical foundations of AO, and SCP application Has unlimited scalability, but lacks interoperability, while AO originated from an effort to solve interoperability between different SCP applications. Later, AO was designed as a single-image parallel computing network, achieving almost unlimited scalability through multi-threaded parallel computing. At the same time, AO used a single The system image hides the complexity behind it, so that users and developers still feel that they are interacting with a single network. In the future, AO will work steadily through iterations of different mainnet versions to find a balance between iteration speed and system stability.