Sub-Second Queries on Billions of Rows: Real-Time Analytics with ClickHouse

2025-09-05
Sub-Second Queries on Billions of Rows: Real-Time Analytics with ClickHouse

This guide demonstrates building real-time analytics applications with ClickHouse, achieving sub-200-millisecond query responses on billions of weather records. It covers data ingestion, advanced techniques like statistical sampling and pre-aggregation, and showcases a complete workflow using Rill, ingesting NOAA weather data from S3 and visualizing it. ClickHouse's columnar storage, advanced compression, and vectorized query execution deliver blazing-fast performance, making it ideal for real-time analytics. The article explores the trade-off between data freshness and accuracy, detailing ClickHouse modeling strategies (denormalization, dictionaries, incremental materialized views). A practical example using ClickHouse, S3, and Rill for real-time weather data analysis is presented.

Read more
Development

From macOS to Arch Linux: A Developer's Journey

2025-08-23
From macOS to Arch Linux: A Developer's Journey

A developer traded his five-year-old MacBook Pro M1 Max for a budget Lenovo ThinkBook 14 G7 AMD laptop running Arch Linux (Omarchy). After a month, he found Linux, while lacking some macOS polish (e.g., screenshot tools and backups), offered unparalleled customization. By crafting custom shortcuts and configuring various tools, he achieved a workflow comparable to, or even exceeding, his macOS experience. He embraced the freedom to tailor his OS, happily accepting compromises in battery life and thermals. This transition highlighted the joy of a highly customizable system.

Read more
Development

Self-Hosting and Tech Independence: My Open Source Journey

2025-06-07
Self-Hosting and Tech Independence: My Open Source Journey

Inspired by PewDiePie's Arch Linux learning and DIY projects, I embarked on a journey of self-hosting and tech independence. This article shares my years of experience self-hosting my blog, building a home server, and using open-source tools. From setting up personal websites to building a homelab, I've gone from initial confusion to ultimate satisfaction. Open-source software and Markdown have become my core tools, and they've allowed me to experience the joy of tech independence and the value of knowledge sharing.

Read more
Development

From Zero to Hero: My Vim Journey and Why You Should Try It Too

2025-04-24
From Zero to Hero: My Vim Journey and Why You Should Try It Too

A seasoned developer recounts his transition from traditional text editors to Vim. Initially intimidated by Vim's shortcuts, he discovered the 'Vim language' – a system of keybindings that dramatically boosted his efficiency. Mastering Vim motions and commands allowed precise, rapid text editing, extending these gains to writing and browsing. While acknowledging the steep learning curve, the author argues that Vim's payoff is substantial, making it worthwhile for any developer.

Read more
Development

Reclaiming Focus in the Age of Distraction: A Path to Deeper Living

2025-02-16
Reclaiming Focus in the Age of Distraction: A Path to Deeper Living

Drawing on personal experience and insights from books like 'Stolen Focus' and 'Digital Minimalism', the author explores strategies for combating digital distractions and cultivating a deeper, more focused life. The article uses neuroscience to explain how tech companies manipulate dopamine levels to influence behavior, then offers practical solutions. These include creating focused work environments (libraries, cafes), using offline tools (Obsidian), establishing routines, taking regular breaks (physical, mental, creative, etc.), and incorporating mini-retirements. The author argues that minimizing digital distractions and prioritizing high-quality work and life leads to lasting satisfaction and happiness. The piece concludes by emphasizing the importance of connecting with nature, cultivating patience, and viewing creativity as a gardening process requiring nurturing.

Read more