Breakpoint 2024: Product Keynote: Filecoin (Juan Benet)

In a groundbreaking announcement at Breakpoint 2024, Juan Benet revealed a major collaboration between Filecoin and Solana, set to revolutionize data storage and accessibility in the Solana ecosystem. This partnership promises to address longstanding issues of data retrieval and management, potentially catalyzing a new era of scalability and efficiency for Solana-based applications.

Summary

Juan Benet, representing the Filecoin community, announced a significant partnership with Solana to store the entirety of Solana's data on the Filecoin network. This collaboration aims to provide full verifiability and random access to all of Solana's data, including the complete ledger, transactions, and state.

The integration leverages Filecoin's massive storage capacity, which currently handles about 2-3 petabytes of data daily, far exceeding Solana's current data generation. This partnership is set to solve existing problems in accessing and managing data within the Solana ecosystem.

Benet highlighted ongoing projects like Yellowstone and Old Faithful, which have already made significant progress in archiving and providing access to Solana's historical data. The future roadmap includes plans for indexing and providing random access to compressed data, automatic backup of NFT media and websites, and the development of native ways to create indices directly within the Solana Virtual Machine (SVM).

Key Points:

Filecoin's Storage Capacity

Filecoin, as described by Juan Benet, is the oldest and largest decentralized storage network. It has the capacity to store between two to three petabytes of data daily, which translates to exabytes in total storage. To put this into perspective, Benet mentioned that Filecoin stores about seven times the amount of Solana's daily data generation.

This massive storage capacity is a key factor in the partnership, as it ensures that Filecoin can easily handle the entirety of Solana's data, including the full ledger, all transactions, and the current state. This comprehensive storage solution promises to provide full verifiability and random access to all of Solana's data, addressing longstanding issues in data management and retrieval within the Solana ecosystem.

Current Integration and Use Cases

Benet highlighted that many applications in the Solana community are already utilizing IPFS (InterPlanetary File System) and Filecoin for storing and distributing data. This includes the use of IPFS storage and pinning services, as well as Filecoin on-ramps for storing various types of data.

One notable use case is the ability to store entire websites and associated media for Solana-based domain names (e.g., username.sol). This process involves publishing the website or media to IPFS, potentially backing it up in Filecoin, and then setting the CID (Content Identifier) in the Solana name records. Applications can then either request this data directly from the IPFS network or use a transparent proxy like 4sol.xyz, which has been built through collaboration between various teams in the IPFS and Solana communities.

Project Yellowstone and Old Faithful

Benet discussed two significant projects that have been crucial in advancing the integration between Filecoin and Solana: Project Yellowstone and Old Faithful. These initiatives, primarily driven by Triton One and other contributors, have made substantial progress over the past year and a half.

Old Faithful has already consumed and archived the vast majority of Solana's historical data in a fully decentralized setting. This means that as data is stored on the Solana chain, whether it remains in the state or is part of the ledger, it's being archived by Old Faithful and stored across multiple storage providers in the Filecoin network.

This archived data is now accessible through RPCs (Remote Procedure Calls) in Old Faithful, or directly through the CID by contacting storage providers or other nodes in the IPFS network. This development marks a significant step towards comprehensive data accessibility for the Solana ecosystem.

Future Developments and Roadmap

Looking ahead, Benet outlined several exciting developments in the pipeline. One of the key upcoming features is the ability to provide indices and random access to all compressed data, including CK (Concurrent KECCAK) compressed data. This will enable applications to store and retrieve information directly from various clients, whether they're backend servers, mobile devices, or browsers.

Another planned feature is the automatic backup of NFT media and websites as they enter the Solana chain. The goal is to ensure that as information is published on Solana, it gets automatically backed up, replicated, and made randomly accessible.

Benet also mentioned ongoing work to develop native ways of writing indices directly into code running in the Solana Virtual Machine (SVM). This would allow for automatic index production, further enhancing data accessibility and retrieval efficiency.

Lastly, Benet emphasized the role of IPFS gateways in making all this data accessible to any browser, potentially revolutionizing how users interact with data stored on the Solana blockchain.

Facts + Figures

• Filecoin stores 2-3 petabytes of data daily
• Filecoin's daily storage is approximately seven times all of Solana's data
• Filecoin's total storage is in exabytes
• Many Solana applications already use IPFS and Filecoin for data storage and distribution
• The integration allows for full verifiability and random access to all Solana data
• Project Yellowstone and Old Faithful have already archived the majority of Solana's historical data
• Future plans include providing indices and random access to all compressed data, including CK compressed data
• Automatic backup of NFT media and websites entering the Solana chain is planned
• Development of native ways to write indices directly into SVM code is underway
• IPFS gateways will make all stored data accessible to any browser

Top quotes

1. "Filecoin is the oldest largest decentralized storage network we store on the order of two to three petabytes a day, and it's exabytes in total."
2. "Every day, Filecoin stores about seven times all of Solana's data."
3. "We truly mean we're ready to help you scale to store everything and make it easily random access."
4. "Today, already a bunch of applications in the Solana community use IPFS and Filecoin to store and distribute their data."
5. "The thing that I'm most excited about is being able to back up the entire Solana ledger and then make it accessible in random access with all kinds of indices."
6. "Ideally as you publish information in Solana that should get backed up and replicated and made randomly accessible for you."
7. "The Filecoin network is here to help the Solana community scale, already storing a huge amount of data for the whole community."

Questions Answered

What is Filecoin's storage capacity?

Filecoin has an enormous storage capacity, handling 2-3 petabytes of data daily. This translates to exabytes in total storage, which is significantly more than Solana's current data generation. In fact, Filecoin's daily storage capacity is approximately seven times the amount of all of Solana's data, making it more than capable of storing and managing the entire Solana ledger and associated data.

How are Solana applications currently using Filecoin and IPFS?

Many applications in the Solana ecosystem are already leveraging IPFS and Filecoin for data storage and distribution. They use IPFS storage and pinning services, as well as Filecoin on-ramps, to store various types of data. This includes random objects needed in smart contracts, NFTs, metadata, and content for decentralized applications. Additionally, Solana-based domain names (e.g., username.sol) can have their entire website and associated media stored on IPFS and backed up on Filecoin.

What are Project Yellowstone and Old Faithful?

Project Yellowstone and Old Faithful are initiatives focused on archiving and providing access to Solana's historical data. Old Faithful, in particular, has already consumed and archived the vast majority of Solana's data in a fully decentralized setting. This archived data is now accessible through RPCs in Old Faithful or directly through content identifiers (CIDs) by contacting storage providers or other nodes in the IPFS network. These projects represent significant progress in integrating Filecoin's storage capabilities with the Solana ecosystem.

What future developments are planned for the Filecoin-Solana integration?

Several exciting developments are in the pipeline for the Filecoin-Solana integration. These include providing indices and random access to all compressed data, including CK (Concurrent KECCAK) compressed data. There are also plans for automatic backup of NFT media and websites as they enter the Solana chain. Additionally, work is underway to develop native ways of writing indices directly into code running in the Solana Virtual Machine (SVM), which would allow for automatic index production. These developments aim to enhance data accessibility and retrieval efficiency within the Solana ecosystem.

How will this integration benefit Solana users and developers?

This integration will provide numerous benefits to Solana users and developers. It will enable full verifiability and random access to all of Solana's data, including the complete ledger, transactions, and state. This means easier and more efficient data retrieval for applications. The automatic backup and replication of data published on Solana will enhance data security and availability. Furthermore, the ability to access all this data through IPFS gateways will make it readily available to any browser, potentially revolutionizing how users interact with data stored on the Solana blockchain. These improvements could lead to more scalable and efficient Solana-based applications.