Scale or Die: Building Real-Time Apps on Solana w/ Ephemeral Rollups

Solana developers, get ready for a game-changing innovation! Ephemeral rollups are set to revolutionize how we build real-time applications on the blockchain, offering ultra-low latency and unparalleled scalability. This groundbreaking technology could be the key to unlocking the full potential of on-chain gaming and financial applications.

Summary

Gabriele Picco from MagicBlock presents a cutting-edge solution to one of blockchain's most persistent challenges: building real-time applications with low latency. By leveraging the unique properties of Solana's SVM (Solana Virtual Machine), MagicBlock has developed ephemeral rollups - a technology that allows for the creation of temporary, high-performance environments for processing transactions.

This innovation enables developers to build applications with latencies as low as 30 milliseconds, a crucial factor for competitive gaming and responsive financial applications. Ephemeral rollups maintain the benefits of Solana's global state machine while providing the speed and responsiveness of off-chain solutions.

The technology works by temporarily delegating control of specific accounts to ephemeral SVM instances that can be spun up on-demand, close to the user. These instances process transactions with extremely low latency before committing the state back to the main Solana chain. This approach maintains composability with existing Solana smart contracts and allows for horizontal scalability.

Key Points:

The Challenge of Real-Time Blockchain Applications

Building real-time applications on blockchain has always been a significant challenge due to the inherent latency of decentralized networks. Traditional blockchain architectures struggle to provide the sub-60 millisecond response times required for many interactive applications, especially in gaming and finance. This limitation has been a major roadblock in the widespread adoption of blockchain technology for certain use cases.

MagicBlock recognized this challenge and set out to find a solution that could maintain the benefits of on-chain computation while drastically reducing latency. Their goal was to enable developers to create applications that could compete with centralized alternatives in terms of user experience and responsiveness.

How Ephemeral Rollups Work

Ephemeral rollups leverage several unique properties of the Solana Virtual Machine (SVM) to achieve their low-latency performance. These properties include the ability to clear upfront all state that will be read or written, parallel execution of non-competing transactions, and a clear separation between smart contract logic and state.

The process begins with deploying a smart contract and creating initial state on Solana as usual. Developers can then delegate specific accounts (either PDAs or on-curve accounts) to the ephemeral rollup system. This delegation allows the system to spin up SVM instances on-demand, often geographically close to users, to process transactions with extremely low latency.

These ephemeral instances can operate with end-to-end latencies below 50 milliseconds globally. Importantly, the smart contracts remain deployed on Solana, and the state originates from Solana, maintaining composability with the broader ecosystem. When needed, the state can be committed back to the main chain, and accounts can be "undelegated" to return to their normal, usable state on Solana.

Customization and Additional Features

One of the most powerful aspects of ephemeral rollups is their customizability. Since the SVM instances are spun up on-demand, developers can add plugins and extensions to suit their specific needs. For example, a high-precision clock combined with a built-in crank can enable a physics engine to run directly within the SVM, ideal for gaming applications.

Other potential additions include oracles for verifiable random functions or AI integration, allowing smart contracts to interact with machine learning models. Developers can also customize fee structures, potentially abstracting fees away from users or allowing payment in project-specific tokens.

Another crucial feature is the ability to ingest low-latency oracle data, such as price feeds. This capability is particularly valuable for building financial applications that require real-time, precise market data.

Challenges and Solutions

Implementing ephemeral rollups comes with its own set of challenges, which MagicBlock has addressed in their design. One key issue is maintaining synchronization between the ephemeral instances and the main Solana chain. This is handled through a system of monitored accounts and just-in-time cloning of state when transactions first reach an ephemeral rollup endpoint.

Another significant challenge is ensuring the integrity of state commits from ephemeral rollups back to the main chain. MagicBlock has implemented a sophisticated system involving temporary PDAs on Solana and a challenge mechanism. This system allows for disputes to be raised and resolved through a bisection game and, ultimately, verification in a zkSVM (zero-knowledge Solana Virtual Machine).

The team is also working on solutions for achieving low latency globally, which involves strategic placement of nodes and optimized networking protocols. Security is addressed through guard layers on the RPC endpoints and potential integration with trusted execution environments like Intel TDX.

Facts + Figures

• Hyper-competitive games require latency below 30 milliseconds to be playable
• Most games are playable with latencies between 30 and 60 milliseconds
• Ephemeral rollups can achieve end-to-end latencies below 50 milliseconds globally
• The technology maintains composability with existing Solana smart contracts
• Ephemeral rollup instances can be spun up on-demand and scaled horizontally
• MagicBlock plans to ship Phase 1 of ephemeral rollups at the end of Q2 2025
• A permissionless version allowing anyone to run nodes is planned for the end of 2025
• The technology was initially built for games but is now being used for perpetual exchanges, consumer apps, social platforms, and DeFi applications
• A paper called "dynamic fraud-proof" details the architecture for ensuring state integrity
• The system uses a version of fraud-proof mechanisms with dynamically adjustable challenge windows

Top quotes

• "How can we have real times with the benefit of staying on our loved global set machine? The answer? FMR rollups."
• "We can create these machines on the edge very close to the user, so below 50 milliseconds end-to-end globally."
• "It's scalable, you can spin up as many instances as you want, or horizontally, and it's also customizable."
• "Everything that will fill the user an actual experience, but no matter what, there is one limited factor, which is end-to-end latency."
• "We build the stack for games. It's now been used for creating perpetual exchange, so a consumer app, social fight, DP, and many more. We're just getting started, and it's time to accelerate."

Questions Answered

What are ephemeral rollups?

Ephemeral rollups are a technology developed by MagicBlock that allows for the creation of temporary, high-performance environments for processing transactions on Solana. They work by delegating control of specific accounts to on-demand SVM instances that can operate with very low latency, close to the user. This enables real-time applications with response times as low as 30 milliseconds while maintaining the benefits of on-chain computation.

How do ephemeral rollups improve gaming on Solana?

Ephemeral rollups dramatically reduce latency for on-chain games, allowing for response times below 50 milliseconds globally. This is crucial for competitive gaming, where even slight delays can impact gameplay. The technology also allows for the implementation of real-time physics engines and AI integrations directly within the SVM, opening up new possibilities for complex, interactive game mechanics that were previously challenging to implement on-chain.

Are ephemeral rollups only useful for gaming applications?

No, while initially developed for gaming, ephemeral rollups have proven valuable for a wide range of applications. They are being used to create high-frequency trading platforms, real-time financial applications, social platforms, and various DeFi protocols. Any application that requires low latency and high throughput while maintaining the benefits of blockchain technology can potentially benefit from ephemeral rollups.

How do ephemeral rollups maintain security and state integrity?

Ephemeral rollups use a sophisticated system to ensure state integrity when committing back to the main Solana chain. This includes temporary PDAs (Program Derived Addresses) on Solana and a challenge mechanism that allows disputes to be raised. Disputes are resolved through a bisection game and verification in a zkSVM. Additionally, the system employs guard layers on RPC endpoints and is exploring integration with trusted execution environments for enhanced security.

When will ephemeral rollups be available for developers to use?

MagicBlock plans to release Phase 1 of ephemeral rollups at the end of Q2 2025. In this phase, MagicBlock will run most of the nodes, but third parties will be allowed to run their own. By the end of 2025, they aim to launch a permissionless version where anyone can run nodes, contingent on the implementation of the full fraud-proof system.

How do ephemeral rollups interact with existing Solana smart contracts?

Ephemeral rollups maintain full composability with existing Solana smart contracts. The smart contracts remain deployed on the main Solana chain, and the state originates from Solana. The ephemeral rollup system temporarily delegates control of specific accounts to process transactions with low latency, but these accounts can be "undelegated" to return to their normal state on Solana at any time.

Can developers customize the behavior of ephemeral rollups?

Yes, one of the key features of ephemeral rollups is their customizability. Developers can add plugins and extensions to the on-demand SVM instances, such as high-precision clocks, AI oracles, or custom fee structures. This allows for tailoring the system to specific application needs, whether it's implementing a physics engine for a game or integrating real-time price feeds for a financial application.