Articles by Shiv Iyer

About Shiv Iyer

Open Source Database Systems Engineer with a deep understanding of Optimizer Internals, Performance Engineering, Scalability and Data SRE. Shiv currently is the Founder, Investor, Board Member and CEO of multiple Database Systems Infrastructure Operations companies in the Transaction Processing Computing and ColumnStores ecosystem. He is also a frequent speaker in open source software conferences globally.

PostgreSQL Locks and Mutex: Locks, Latches, and Enqueues Explained

PostgreSQL can be tuned for concurrency and performance by adjusting various configuration parameters that affect the behavior of the database system. Here are some recommended steps for tuning PostgreSQL for concurrency and performance: How to […]

PostgreSQL Recursive Queries and Hierarchical Data: Optimal Implementation

To implement recursive queries and hierarchical data optimally in PostgreSQL, you can follow these steps: This query selects all the nodes in the hierarchy, along with their name and level. By following these steps, you […]

ClickHouse Dynamic Disks in 23.2: How They Influence Performance

Dynamic disks in ClickHouse 23.2 refer to a feature that allows for more efficient use of disk space and improved performance when working with large amounts of data. Traditionally, ClickHouse used a file-based storage system […]

PostgreSQL TRACK_ACTIVITY_QUERY_SIZE: How to Tune It in postgresql.conf

In PostgreSQL, the track_activity_query_size parameter determines the maximum size of the SQL query that can be recorded in the pg_stat_activity view. By default, this parameter is set to 1024 bytes, which means that only the […]

PostgreSQL Reduce WAL: Increasing Checkpoint Distance

In PostgreSQL, the WAL (Write-Ahead Logging) is a critical component of the database system that ensures durability and consistency of data. However, frequent WAL writes can impact the performance of the database, especially if the […]

PostgreSQL “as of” queries: How to Implement Them

In PostgreSQL, you can implement “as of” queries using the SQL standard’s temporal query features, which allow you to query a table as it existed at a specific point in time. There are two main […]

PostgreSQL Slow Query: How to Compute Its Cost

The cost of a slow query in PostgreSQL can be estimated by the Query Planner, which uses statistics about the data in the tables being queried to make predictions about the query execution time. The […]

PostgreSQL Optimizer Plan: How Plan Stability Works

In PostgreSQL, optimizer plan stability is a feature that allows the query planner to reuse a previously cached query plan for a SQL statement instead of generating a new plan. This can improve query performance […]

PostgreSQL Global Indexes: How They Are Implemented

In PostgreSQL, global indexes are implemented using a shared-nothing architecture, which means that the index data is partitioned and distributed across multiple physical nodes or “shards.” This allows for parallel query processing and improved performance […]

MyRocks Bloom Filter: How It Works

Bloom filters are probabilistic data structures that are used for membership tests. They are particularly useful in databases as they allow faster and more efficient querying of data. In MyRocks, a storage engine based on […]

The Data Transformation Company

Data Architecture, Engineering and Operations for SQL, NoSQL, NewSQL, Cloud Native Data Platforms, Analytics and AI