Breakpoint 2024: Product Keynote: Clickhouse & Goldsky: CryptoHouse

Solana's ecosystem just got a powerful new tool for blockchain analytics. At Breakpoint 2024, Clickhouse and Goldsky unveiled CryptoHouse, a free service that promises to revolutionize how developers and analysts interact with Solana blockchain data.

Summary

In an exciting presentation at Breakpoint 2024, Derek Chia from Clickhouse introduced CryptoHouse, a groundbreaking free blockchain analytics service powered by Clickhouse and Goldsky. This new tool aims to provide real-time, high-performance analytics for the Solana blockchain, leveraging Clickhouse's robust database technology and Goldsky's data pipeline.

CryptoHouse offers a user-friendly interface where users can write SQL queries against various blockchain data tables, including blocks, transactions, and tokens. The service provides real-time results without any batching or delays, making it an invaluable resource for developers, researchers, and analysts working with Solana data.

The partnership between Clickhouse, an open-source analytical database with over 36,000 GitHub stars, and Goldsky, known for its real-time data pipeline called Mirror, brings together two powerful technologies to create a comprehensive blockchain analytics solution. This collaboration promises to deliver unparalleled performance and ease of use for those seeking to derive insights from Solana's vast trove of on-chain data.

Key Points:

Clickhouse Technology

Clickhouse is an open-source analytical database that has been in development since 2009. It boasts impressive features that make it ideal for blockchain analytics. The database is column-oriented, which allows for efficient aggregations and blazing-fast query processing. Users can deploy Clickhouse as a single binary or set it up in a distributed fashion with support for replication and sharding across regions.

One of Clickhouse's standout features is its ability to handle massive write loads, supporting several million writes per second per server. This capability far exceeds the current transaction rate of Solana, which sits at around 4,000 transactions per second, ensuring that CryptoHouse can easily keep up with the blockchain's growth.

CryptoHouse Features

CryptoHouse, accessible at crypto.clickhouse.com, provides a comprehensive set of tools for Solana blockchain analysis. Users can write SQL queries against various data tables, including blocks, transactions, and tokens. The service offers real-time computation of results, with no batching or waiting periods, allowing for immediate insights.

The platform includes a simple visualization tool to help users better understand and present their data. To ensure fair usage, quotas are implemented at the database level. CryptoHouse also encourages community involvement, welcoming users to contribute queries to their GitHub repository, fostering a collaborative environment for blockchain analytics.

Goldsky Integration

While Clickhouse provides the database technology, Goldsky plays a crucial role in CryptoHouse by supplying the data through its real-time data pipeline. Goldsky's core product, Mirror, is designed to be reliable, support multiple chains, and offer easy configuration. This partnership ensures that CryptoHouse has access to a continuous, up-to-date stream of Solana blockchain data.

Facts + Figures

• Clickhouse has over 36,000 GitHub stars
• Clickhouse can handle several million writes per second per server
• Solana's transaction rate is around 4,000 per second
• The largest known Clickhouse cluster consists of over 4,000 servers
• CryptoHouse stores over 300 billion rows of Solana blockchain data
• Clickhouse can scan and process billions of rows per second
• CryptoHouse can process queries involving over 1.2 billion rows in under 7 seconds
• Clickhouse offers over 20 times compression rate for uncompressed CSV data
• CoinHall, a Clickhouse user, reported 40 times cost savings compared to other databases

Top quotes

• "Clickhouse is the best database for you if you have any analytical use case."
• "Clickhouse is significantly outperformed other databases we tested and delivered 40 times cost savings."
• "Clickhouse runs blazing fast queries. We scan and process billions of rows per second."
• "CryptoHouse is not just about Clickhouse. We partnered with Goldsky that provides us the data through their real-time data pipeline."

Questions Answered

What is CryptoHouse?

CryptoHouse is a free blockchain analytics service powered by Clickhouse and Goldsky. It provides real-time analytics for the Solana blockchain, allowing users to write SQL queries against various data tables such as blocks, transactions, and tokens. CryptoHouse offers immediate results without batching, making it an invaluable tool for developers, researchers, and analysts working with Solana data.

How does CryptoHouse compare to other blockchain analytics tools?

CryptoHouse stands out due to its real-time processing capabilities and the powerful Clickhouse database technology it utilizes. Unlike some other tools that may rely on batched data or have slower query times, CryptoHouse can process billions of rows per second, providing almost instantaneous results. Additionally, being a free service makes it accessible to a wider range of users in the Solana ecosystem.

What kind of data can I analyze with CryptoHouse?

With CryptoHouse, you can analyze a wide range of Solana blockchain data. The service provides access to tables containing information on blocks, transactions, tokens, and more. Users can write custom SQL queries to extract specific insights, such as identifying the most active accounts within a given timeframe or analyzing transaction patterns. The platform also offers pre-made queries and visualization tools to help users get started quickly.

How does Clickhouse contribute to CryptoHouse's performance?

Clickhouse is the backbone of CryptoHouse's impressive performance. As a column-oriented analytical database, Clickhouse excels at aggregations and can handle massive write loads of several million writes per second per server. It can scan and process billions of rows per second, enabling real-time analytics on large datasets. Clickhouse's distributed architecture and support for replication and sharding also contribute to its scalability and reliability.

Is CryptoHouse difficult to use for those new to blockchain analytics?

CryptoHouse is designed to be accessible to users with varying levels of experience in blockchain analytics. While it does require some knowledge of SQL for writing custom queries, the platform offers a user-friendly interface and pre-made queries to help newcomers get started. The service also provides simple visualization tools to help users interpret their data more easily. Additionally, the CryptoHouse team welcomes community contributions, which may lead to a growing repository of example queries and resources for new users.