MongoDB · Cassandra · Redis and Valkey · DynamoDB · Couchbase · Cosmos DB · Milvus · NoSQL consulting and architecture
NoSQL Consulting, Architecture and Performance Engineering
NoSQL consulting from MinervaDB starts with the access patterns, not the product. We choose the engine from the queries the application actually runs, design the data model, shard key, partition key or keyspace around them, prove the design with explain plans, tracing and load on real data shapes, and then operate the result around the clock with named engineers. We are vendor-neutral across MongoDB, Cassandra and ScyllaDB, Redis and Valkey, DynamoDB, Couchbase, Cosmos DB and the vector stores, and the most common outcome of a NoSQL consulting review is a smaller cluster with a better model, not a bigger one.
01 · The landscape
NoSQL in 2026, and why NoSQL consulting starts with the workload
“NoSQL” covers five families that share almost nothing except the absence of a fixed relational schema. A document store, a wide-column store, an in-memory key-value store, a serverless cloud table and a vector index answer different questions, fail in different ways and are priced on different units. The first job of NoSQL consulting is to put the workload in front of that choice.
Figure 1. The NoSQL consulting landscape: the five families, the engines and versions we operate in each, the access patterns each serves best, and the four questions that decide the engine before any benchmark is run.
The engines NoSQL consulting covers have moved a long way in two years. MongoDB 8.3 (May 2026, a rapid release on the 8.x line) made the cost-based ranker the default plan selector, replaced removeShard with explicit drain and commit commands, added transitions to and from an embedded config shard, and now restricts DDL on sharded clusters to mongos; 8.2 introduced a percentage-based WiredTiger cache setting and faster initial sync.
Apache Cassandra 5.0 brought storage-attached indexes, trie memtables and SSTables, the unified compaction strategy and vector search, with strictly serializable Accord transactions arriving in the unreleased 6.0 line. Valkey 9.1 (May 2026) added hash-field expiry, database-level ACLs and a material reduction in per-key memory overhead; Redis 8.x continued to fold search, JSON and vector sets into the core under its own licence.
Couchbase Server 8.0 (October 2025) unified operational, analytical and vector workloads in one platform. On the hyperscalers, DynamoDB global tables offer multi-region strong consistency, MemoryDB and ElastiCache track Valkey, and Cosmos DB, Keyspaces and Bigtable each carry a divergence map from the open-source engine they resemble.
Every one of these changes moves a design decision a NoSQL consulting engagement would have made differently in 2024, which is why the review always begins with a version inventory. Version claims on this page follow the vendors’ release notes, linked in the sections below and re-verified at the start of every engagement.
02 · Services
NoSQL consulting services
Eight fixed-scope NoSQL consulting services. Most engagements begin with the architecture and data-model review and continue as the findings dictate; the 24×7 retainer keeps the same engineers on the platform afterwards.
Engine selection and architecture review
Workload inventory, access-pattern analysis, consistency and durability requirements, growth shape and operating model, then a written recommendation with the trade-offs stated. For existing platforms, a review with prioritised, quantified findings rather than a generic best-practice list.
Data modelling and key design
Embed-or-reference decisions and shard keys for MongoDB, partition-per-query tables for Cassandra and ScyllaDB, single-table item collections for DynamoDB, keyspace and structure design for Redis and Valkey, validated with explain plans, tracing and consumed-capacity metrics on production-shaped data.
Performance engineering
Index audits from the profiler and slow logs, query-shape analysis, working-set and cache sizing, compaction and tombstone tuning, connection-pool and driver configuration, and client-side p99 measurement before and after every change.
Scalability and topology
Sharded-cluster design and rebalancing, multi-DC replication and consistency levels, cluster-mode Redis and Valkey with hash-slot planning, DynamoDB capacity and partition-heat management, and zone-aware placement on Kubernetes operators or vendor clouds.
High availability and disaster recovery
Replica-set and quorum design, failover rehearsal, backup and point-in-time recovery, cross-region topologies, RPO and RTO engineering, and quarterly restore and failover drills that are timed, not assumed.
Migrations and upgrades
Relational to NoSQL where the access patterns justify it, self-managed to Atlas, Capella, Astra, DynamoDB or Cosmos DB and back when the invoice says so, Redis to Valkey, major-version upgrades with feature-compatibility gates, dual-write and reconciliation, rehearsed cutover and a rollback path.
Security and compliance
Authentication and role design, field-level and client-side encryption, TLS everywhere, audit logging, network isolation, key rotation, and evidence packages for SOC 2, PCI DSS, HIPAA and GDPR reviews.
24×7 support and managed operations
Named engineers on a rota for incidents, monthly reviews of query shapes, growth and spend, patch and version-lifecycle management, and capacity forecasting, described in full on the NoSQL database support page.
03 · Method
The access-pattern-first modelling method NoSQL consulting runs on
Relational design normalises the data and lets the optimiser find the query. NoSQL design inverts that: the queries are known first and the data is shaped to serve them, which means a NoSQL model that was drawn from the relational schema is wrong before the first document is written.
Figure 2. Workload inventory, entities and access patterns, a model per engine, validation on real volume, and a measured rollout, with the mistakes the method exists to rule out.
The workload inventory is the artefact every NoSQL consulting deliverable hangs from. For each read and write path it records the rate, the latency target, the consistency the business actually needs and the growth shape, and in practice the top twenty paths carry the design. From those we map which entities are read together and written together, which is what decides embedding against referencing in MongoDB, partition boundaries in Cassandra and item collections in DynamoDB.
Validation happens on production-shaped data, never on synthetic key distributions, because the hot tenant, the celebrity key and the unbounded array only appear at real volume. MongoDB’s explain("executionStats"), Cassandra’s TRACING ON and nodetool tablestats, DynamoDB’s consumed capacity and ReturnConsumedCapacity, and redis-benchmark driven with the production key shape are the instruments; a NoSQL consulting recommendation that cannot show its numbers from one of them is not one we make.
04 · Document
MongoDB NoSQL consulting: replica sets, sharding and the shard-key decision
A MongoDB deployment is a set of replica sets. The single decision that dominates the cost and behaviour of a sharded cluster for its whole life is the shard key, and it is the decision most often taken by default rather than by design.
Figure 3. The sharded topology NoSQL consulting designs: mongos routers, a config server replica set or embedded config shard, three-member shard replica sets across zones, and the chunk ranges each owns.
The shard-key rules NoSQL consulting applies are short. A good shard key has high cardinality, even frequency and non-monotonic values, or is hashed, and every hot query carries it so that the router targets one shard instead of scattering to all of them. Compound keys such as {tenant_id, ts} serve multi-tenant, time-ordered data well; a monotonic _id alone sends every insert to the last chunk. Resharding and refineCollectionShardKey exist, and 8.3 replaced removeShard with explicit startShardDraining and commitShardRemoval commands, but a wrong key still costs a rebalancing window, so it is decided at design review.
Write concern majority with journaling and read concern majority are the durable defaults; w:1 is acceptable for telemetry and nothing else. Causal consistency inside a session lets a client read its own writes from a secondary, which is what makes secondaryPreferred safe for reporting.
// the two commands a MongoDB review starts with
db.orders.find({ tenant_id: "t4x", status: "open" })
.sort({ created_at: -1 })
.explain("executionStats")
// look for: IXSCAN not COLLSCAN, totalKeysExamined close to nReturned,
// no SORT stage (index covers the sort), SHARDING_FILTER on one shard
db.orders.aggregate([{ $indexStats: {} }])
// indexes with accesses.ops = 0 since the last restart are write cost
// without read benefit; every extra index slows every insert and update
The 8.3 cost-based ranker changes plan selection for eligible queries; the metrics.query.cbr.* counters in serverStatus and the new query-memory tracking fields are now on our baseline dashboard, alongside WiredTiger cache pressure, replication lag, ticket availability and the slow-query log with its query-shape hash.
05 · Wide-column
Cassandra and ScyllaDB NoSQL consulting: partition design and consistency arithmetic
Cassandra scales writes linearly because every table is designed for one query and every partition lives on a predictable set of replicas. The price is that the model must be right for the queries, and that consistency is a per-statement choice that has to be understood, not a global setting.
Figure 4. The Cassandra picture NoSQL consulting designs to: two data centres at replication factor 3 with asynchronous cross-DC replication, and the read-plus-write arithmetic that decides whether a read sees the latest write.
Partition design is where NoSQL consulting on Cassandra earns its keep. A partition should be bounded: tens of megabytes and low tens of thousands of rows is comfortable, and a partition that grows without limit, a sensor keyed only by device id for example, needs a time bucket in the partition key. LOCAL_QUORUM for both writes and reads inside a data centre gives R + W greater than RF and survives one node loss; ONE is for telemetry; EACH_QUORUM puts cross-DC latency on the write path and is rarely worth it. Lightweight transactions cost four round trips and are for the few operations that genuinely need compare-and-set until Accord lands in 6.0.
Cassandra 5.0’s storage-attached indexes replace most secondary-index and materialised-view workarounds, the unified compaction strategy replaces the STCS-versus-LCS argument for most tables, and trie memtables and SSTables cut memory and disk. Deletes are writes: tombstones must be compacted away, and repair must complete inside gc_grace_seconds or deleted data resurrects. Every NoSQL consulting review of a Cassandra estate checks repair schedule, tombstone warnings, partition-size histograms and dropped mutations before it looks at hardware. ScyllaDB follows the same model with a different engine underneath and its own tablet-based rebalancing, and we operate both.
06 · In-memory
Redis and Valkey NoSQL consulting: caching patterns, cluster mode and durability
An in-memory store is only as good as the pattern in front of it and the memory policy behind it. Most Redis incidents we attend are a cache stampede, an eviction policy chosen for a queue, or a single hot key on a single core, none of which a bigger instance fixes.
Figure 5. The Redis and Valkey design surface in NoSQL consulting: cache-aside and write-through patterns, the structures chosen per access pattern, cluster mode with 16,384 hash slots and zone-separated replicas, and the durability, eviction, memory and latency decisions.
Cluster mode, which NoSQL consulting recommends above a single primary’s memory or throughput ceiling, shards the keyspace across 16,384 hash slots; keys that must be operated on together carry a {hash tag} so they share a slot, and the client handles MOVED and ASK redirects. Replicas sit in a different zone from their primary, and failover promotes in seconds. Persistence is a design choice: RDB for restart speed, AOF everysec for a one-second loss window, both for state that must survive, none for a pure cache that can be rebuilt. Eviction follows the role: allkeys-lfu for caches, noeviction with early maxmemory alerts for queues and state.
Redis and Valkey have diverged since the 2024 licence change. Valkey stays BSD-licensed under the Linux Foundation, and 9.1 brought hash-field expiry, database-level ACLs for multi-tenancy and a substantial reduction in string-key overhead; Redis 8.x folds search, JSON, probabilistic structures and vector sets into the core under its own licence. ElastiCache and MemoryDB now track Valkey. NoSQL consulting on this family therefore includes a licensing and feature divergence check, a Redis-to-Valkey migration path where it applies, and the memory-encoding review (listpack thresholds, fragmentation ratio, used_memory against dataset) that decides whether the instance is the right size at all. Details are on the Redis and Valkey support page.
07 · Cloud-native
NoSQL consulting on DynamoDB, Cosmos DB and the managed services
On the hyperscaler-native services the limits shape the model and the bill is the performance metric. NoSQL consulting here is as much capacity and cost engineering as data modelling, because a design that works at 10 GB can cost ten times what it should at 10 TB.
DynamoDB
Single-table design with item collections keyed on partition key and sort key, global secondary indexes only for access patterns that exist, and partition heat kept even because a hot partition throttles at its own share of table throughput regardless of what the table is provisioned for. On-demand against provisioned capacity with auto-scaling is a modelled decision from the traffic shape, warm throughput settings avoid the cold-start throttle after a scale-up, and global tables with multi-region strong consistency change the write-latency conversation for active-active designs. ConsumedCapacity per access pattern, throttled-request metrics and item size distribution are the evidence set.
Cosmos DB, Keyspaces, Bigtable and the vendor clouds
Cosmos DB’s request-unit model, partition-key choice and consistency levels (strong through eventual, with session as the practical default) are the same three decisions under different names; Amazon Keyspaces and Bigtable resemble Cassandra and HBase but not completely, and the divergence map matters when an application is ported. MongoDB Atlas, Couchbase Capella and DataStax Astra remove the operations but not the modelling, and their cluster-tier pricing rewards a smaller working set as much as self-managed hardware does. Our cloud DBA services team runs the FinOps side of these platforms alongside the engineering.
08 · Vector
NoSQL consulting for vector stores beside the operational database
Retrieval for LLM applications is a NoSQL workload with its own index family. The question NoSQL consulting answers first is whether the vectors belong inside the operational store or in a dedicated engine, and the answer depends on collection size, filter selectivity and recall targets.
NoSQL consulting for retrieval starts from the engines the estate already runs. MongoDB Atlas Vector Search, Cassandra 5.0 vector indexes, Redis vector sets and Couchbase 8.0 all put approximate-nearest-neighbour search beside the operational data, which keeps one system of record and simplifies filtered retrieval. Dedicated engines such as Milvus scale to billions of vectors with HNSW, IVF and DiskANN index types, GPU indexing and independent scaling of query and index nodes, at the cost of a second system to keep consistent.
We size on the measurable trade-offs: recall at a fixed latency budget on the real embedding distribution, index build time and memory per million vectors, filter selectivity against pre- and post-filtering strategies, and the freshness the application needs. The vector data engineering practice covers the pipeline side; the enterprise RAG architecture post covers the in-VPC reference design.
09 · Performance
Performance engineering: the evidence NoSQL consulting works from
Every recommendation in a MinervaDB review names the metric or command that justifies it. The instruments differ by engine; the discipline does not.
| Engine | Evidence we read first | Typical finding |
|---|---|---|
| MongoDB | Profiler and slow-query log with query-shape hash, explain("executionStats"), $indexStats, serverStatus (WiredTiger cache, tickets, CBR metrics), rs.status() lag, sh.status() chunk balance |
COLLSCAN on a hot path; unused indexes taxing every write; working set larger than cache; scatter-gather queries missing the shard key |
| Cassandra / ScyllaDB | nodetool tablestats, tablehistograms, tpstats, compactionstats, tombstone warnings, TRACING ON, dropped mutations, repair history |
Unbounded partitions; tombstone-heavy reads; repair not completing inside gc_grace_seconds; compaction falling behind writes |
| Redis / Valkey | INFO memory and stats, SLOWLOG, LATENCY monitor, MEMORY USAGE on sampled keys, keyspace hit ratio, client-side p99, cluster slot distribution |
Hot key on one shard; wrong eviction policy; fragmentation; big keys blocking the event loop; stampede on expiry |
| DynamoDB | ConsumedReadCapacityUnits / Write per table and index, ThrottledRequests, item-size distribution, GSI backfill, contributor insights for partition heat |
Hot partition throttling under an under-utilised table; GSIs with no reader; scans standing in for a missing access pattern |
| Couchbase | Query and index service stats, resident ratio, XDCR lag, index advisor output, N1QL explain | Resident ratio too low for the working set; primary index used in production; unindexed N1QL predicates |
| Milvus | Query and index node metrics, recall at latency on the real embedding set, segment sizes, compaction state | Index type chosen for build speed not recall; filters applied post-search; segments never compacted |
Client-side latency is measured for every engine. A server-side dashboard that looks healthy while the driver’s connection pool is exhausted or the client is retrying on timeouts is the most common blind spot NoSQL consulting finds in estates that “have monitoring”.
10 · Availability
High availability and disaster recovery in NoSQL consulting
Every family offers replication; what differs is who elects the leader, what the client sees during the election, and what a restore actually takes. A recovery objective is a claim until it has been timed.
- MongoDB: three-member replica sets across three zones, priority and votes set deliberately,
majoritywrite and read concern, retryable writes on, and a restore drill from a backup that includes the oplog for point-in-time recovery. - Cassandra and ScyllaDB: replication factor 3 per data centre,
NetworkTopologyStrategy, rack awareness,LOCAL_QUORUMreads and writes, and a rehearsed loss of a data centre with the application’s consistency level unchanged. - Redis and Valkey: cluster mode or Sentinel with replicas in other zones,
min-replicas-to-writewhere loss matters, and a tested restore from RDB and AOF, because a cache that is really a database only reveals itself at restore time.
- DynamoDB and Cosmos DB: point-in-time recovery enabled and its window verified, global tables or multi-region writes where the RTO demands it, and a restore into a new table timed at production size.
- Cross-region designs choose deliberately between active-passive with asynchronous replication, active-active with conflict handling, and per-region isolation with a routing layer, with RPO, RTO and write latency written down for each.
- Quarterly drills: a timed restore and a timed failover, with the runbook corrected afterwards, under every NoSQL consulting retainer. The database SRE practice owns the SLOs and error budgets behind them.
11 · Security
Security and compliance: the first change in every NoSQL consulting review
NoSQL engines ship with permissive defaults for developer convenience, and the exposed-cluster incidents of the last decade were almost all defaults left in place. Hardening is the first change in every review and the easiest to evidence.
Identity and access
SCRAM or x.509 authentication on MongoDB with FIPS-compliant mechanisms, role-based access per database and collection; Cassandra roles and GRANT at keyspace and table level; Redis and Valkey ACLs with database-level scope in Valkey 9.x; IAM-scoped policies on DynamoDB and Cosmos DB; no shared administrative accounts anywhere.
Encryption
TLS on every listener including replication and cluster bus, encryption at rest with customer-managed keys, client-side field-level encryption for MongoDB where regulated fields must never reach the server in clear text, and key rotation scripted as a routine change.
Network, audit and evidence
Private networking and allow-lists, audit logging of authentication and schema-level events, log retention aligned to the framework, and an evidence package that answers the SOC 2, PCI DSS, HIPAA or GDPR reviewer’s questions in the order they ask them.
12 · Migrations
Migrations NoSQL consulting runs, and the ones it talks clients out of
A migration is justified by access patterns and economics, not by architecture fashion. We say so when the right answer is to stay on PostgreSQL with JSONB, and we say so when the right answer is to leave a managed service whose bill has outgrown its convenience.
| Path | When it is right | How it runs |
|---|---|---|
| Relational to MongoDB or Cassandra | Polymorphic entities, write rates or geographic distribution the relational estate cannot serve; not for “schemaless” convenience | Access-pattern model first, CDC into the new store, dual-read validation, cut-over behind a flag with the relational system kept until reconciliation is clean |
| Self-managed to Atlas, Capella, Astra, DynamoDB or Cosmos DB | Operations cost more than the service premium and the divergence map has no blockers | Feature and limit audit, live migration tooling or CDC, index and user rebuild, latency measured from the application before DNS moves |
| Managed service back to self-managed | The invoice at current volume exceeds the engineering cost of running it, usually above a few terabytes or a few hundred thousand operations per second | Kubernetes operator or VM topology designed to the same SLOs, replication-based cut-over, and a 24×7 retainer that replaces the vendor’s support |
| Redis to Valkey | Licensing, cost on ElastiCache or MemoryDB, or Valkey 9.x features; blocked only by Redis-specific modules the application depends on | Command and module inventory, replica-based sync, client cut-over, memory and latency compared before the old nodes are retired |
| Major-version upgrades | Always, on a calendar: MongoDB 7.0 estates ahead of end of life, Cassandra 4.x to 5.0, Redis 7 to 8 or Valkey 9 | Feature-compatibility version gates, driver compatibility, rolling upgrade rehearsed on a restored copy, rollback checkpoint before each stage |
14 · Questions
NoSQL consulting: frequently asked questions
The questions we are asked most often on the first call, answered the way we answer them on the first call.
Which NoSQL database should we use?
The one whose access patterns match yours, which is why NoSQL consulting starts with a workload inventory rather than a product comparison. Document stores suit polymorphic entities read as a unit, wide-column stores suit high write rates and partition-per-query reads, in-memory stores suit sub-millisecond hot data, and the serverless cloud tables suit teams that want the bill to be the capacity plan. Often the honest answer is PostgreSQL with JSONB, and we say so.
Can you fix performance without a bigger cluster?
Usually. The most common findings are a missing or wrong index, a shard or partition key that scatters hot queries, a working set larger than cache because of unused indexes and oversized documents, tombstone-heavy reads on Cassandra, and a hot key on one Redis shard. Each is a model or configuration change measured before and after; the cluster size is the last lever, not the first.
Should we move to MongoDB Atlas, DynamoDB or Cosmos DB, or stay self-managed?
It depends on the operations cost you are actually carrying, the divergence map of the target service and the invoice at your projected volume. We model all three with your numbers, and we run the migration in either direction, including repatriation when a managed bill has outgrown its convenience.
Redis or Valkey?
For caching and most data-structure workloads, Valkey 9.x is the BSD-licensed path and the one ElastiCache and MemoryDB now track; Redis 8.x is the choice when the application depends on its integrated search, JSON or vector-set features. A NoSQL consulting review inventories the commands and modules in use and gives a migration path or a reason to stay.
Do you handle Cassandra 5.0 upgrades and repair?
Yes. Cassandra 4.x to 5.0 is a rolling upgrade rehearsed on a restored copy, with storage-attached indexes and the unified compaction strategy adopted deliberately afterwards. Repair scheduling inside gc_grace_seconds, tombstone control and partition sizing are standing items in every review of a Cassandra or ScyllaDB estate.
How do you validate a data model before we commit to it?
On production-shaped data at production volume: explain plans and index statistics on MongoDB, tracing and table histograms on Cassandra, consumed capacity and throttling on DynamoDB, and client-side p99 on Redis and Valkey. The workload inventory says what the model must serve; the instruments say whether it does.
What do you need from us to start?
Read access to metrics, logs and the profiler or slow-query log, the cluster and collection or table configuration, a week of observation and the cloud bill. No change is made until the findings report is agreed and change windows are booked; most engagements are collaborative and leave your team with runbooks and dashboards it owns.
What does 24×7 NoSQL support include?
Named engineers on a rota for incidents across MongoDB, Cassandra, Redis and Valkey, DynamoDB, Couchbase, Cosmos DB and Milvus, monthly reviews of query shapes, growth and spend, version-lifecycle management and a quarterly restore and failover drill. S1 is acknowledged within 15 minutes around the clock, S2 within 12 hours, S3 within 24 hours and S4 within 48 hours, and every S1 closes with a written root-cause analysis.
Further reading
Related services
The engine pages behind this NoSQL consulting overview, and the practices that sit beside it.
NoSQL database support
24×7 support and managed operations across the same engines.
MongoDB consulting
Replica sets, sharding, Atlas and WiredTiger tuning.
Cassandra consulting
Partition design, consistency, repair and 5.0 features.
Redis and Valkey support
Caching patterns, cluster mode, Valkey migration.
Milvus support
Vector search at scale beside the operational store.
Cloud DBA services
DynamoDB, Cosmos DB and the vendor clouds, with FinOps.
Kafka consulting
The CDC and streaming path into and out of NoSQL stores.
ClickHouse consulting
The analytical tier beside operational NoSQL.
Talk to a Principal Architect about NoSQL consulting
Bring the workload, the slow-query log and the last invoice to the first NoSQL consulting call. We will tell you whether the model, the topology or the engine is the problem, and what fixing it is worth.