Commit Graph
718 Commits
Author SHA1 Message Date
Abdon Pijpelink 45f19f30ee Break up "Distributed Deployment" page into new "Scaling & Resilience" section (#2491)
* Add new Scaling landing page under Operations

Introduces a Scaling section with vertical vs. horizontal scaling
guidance and failover best practices, linking out to detail pages.

* Add new Vertical Scaling page

Dedicated how-to guidance for resizing existing nodes: when to scale
vertically, RAM sizing formulas, and Cloud/self-hosted resize steps.

* Add new Horizontal Scaling and Resilience page

Covers Raft consensus, the replication model, consistency guarantees,
Multi-AZ, and the resilience terminology used elsewhere in the docs.

* Move Distributed Deployment under Scaling and update all incoming links

Moves distributed_deployment.md into the new scaling/ section, trims
its Raft/Replication/Consistency intros into cross-links to the new
Horizontal Scaling and Resilience page, adds Multi-AZ and single-replica
cross-link callouts in the Cloud docs, rewrites all internal references
across ~30 files to the new canonical path instead of relying on
aliases, and applies Title Case to Distributed Deployment's headers.

* Split Resilience out of Horizontal Scaling and Resilience

Adds a dedicated Resilience page covering fault tolerance, Multi-AZ,
resilience terminology, and failover best practices (moved from the
Scaling landing page). Horizontal Scaling is retitled and scoped to
the underlying mechanics: Raft consensus, replication, and consistency.

* Reorganize Horizontal Scaling's structure

Moves "How Many Qdrant Nodes Should I Run?" from Distributed Deployment
into Horizontal Scaling, adds a conceptual Sharding section, and
reorders Sharding/Replication/Raft Consensus/Consistency. Moves the
remaining conceptual content out of Distributed Deployment: Temporary
Node Failure to Resilience, Error Handling folded into Replication,
sharding heuristics folded into Sharding, and the Consensus
Checkpointing explanation folded into Raft Consensus.

* Rename Scaling section to Scaling & Resilience

Renames the section and restructures the landing page: the vertical-
vs-horizontal decision is now purely about scaling, with a dedicated
Resilience section covering fault tolerance through sharding and
multi-node deployments.

* Polish Vertical Scaling and Resilience page content

Reframes Vertical Scaling's "What Not to Do" as positive "Best
Practices". Reworks Resilience's structure: moves the uptime/data-
integrity terminology into the intro as three distinct aspects of
resilience, and renames "How Resilience Works" to "Setting Up a
Resilient Qdrant Cluster".

* Add diagrams illustrating sharding and replication

Adds cluster diagrams to the Sharding and Replication sections on
Horizontal Scaling to make the shard/replica layout easier to follow.

* Add new Node Failure Recovery page

Extracts the node failure recovery scenarios out of Distributed
Deployment into their own page, with each bolded sub-header converted
to a proper heading, and links updated across Resilience and the
Scaling landing page.

* Add new Consistency Guarantees page

Extracts write consistency factor, read consistency, and write
ordering out of Distributed Deployment into their own page, positioned
after Distributed Deployment.

* Add new "Deploy Behind a Load Balancer" section

Explains why a load balancer is needed in front of a multi-node
Qdrant cluster: avoiding a single point of failure at the entry point
and making sure replicas on every node actually serve reads.

* Add new "Rebalancing" section

Documents how Qdrant Cloud automatically rebalances shards across
nodes, as its own subsection under Sharding.

* Rewrite Multi-AZ vs. Replication Factor as Multi-AZ Deployments

Defines an availability zone on first use, explains why multi-AZ
deployments guard against a zone going down, clarifies that Qdrant
Cloud is zone-aware once enabled, and that self-hosted deployments
need to place and move replicas across zones manually.

* Restructure node-count guidance into One/Two/Three-or-more Node subsections

Splits "How Many Qdrant Nodes Should I Run?" into three subsections
and drops the "balanced" framing for two nodes: it states plainly
that two nodes give more capacity without true high availability.

* Add new "Which Configuration Is Right for You?" section

Summarizes the one/two/three-or-more node tradeoffs in one place
right after the detailed breakdown.

* Add explicit _redirects entry for legacy distributed_deployment URL

Closes the redirect chain: the existing /guides/ and /operations/
legacy rules both terminate at /documentation/distributed_deployment/,
which previously had no explicit _redirects entry and only resolved
via the Hugo alias meta-refresh page.

* Fix all incoming links to Distributed Deployment and pages under Scaling

Repoints two same-page anchors in distributed_deployment.md that broke
when Write Ordering moved to Consistency Guarantees, and one link in
cloud/create-cluster.md that broke when a Resilience heading was
reworded.

* Update time-based sharding diagram and restructure section

* Fix a couple of broken links

* Move 'Consensus Checkpointing' to 'Node Failure Recovery' page
2026-07-16 09:11:58 +02:00
John Kupchanko 119cf36fce docs(article): remove benchmark callouts per reviewer request 2026-07-15 13:50:28 -07:00
John Kupchanko 7067a11662 docs(article): use measured 18x batching result from re-run
batch_size=1 vs 64 on 10k 768-dim vectors: 152.19s -> 8.17s (~18x) on
Qdrant 1.18.2. Update the callout and image alt to match the real number.
2026-07-15 10:01:21 -07:00
John Kupchanko a7f50d9ba0 docs(article): use measured benchmark numbers and Qdrant 1.18.2
Record the real re-run: parallel 1->4 workers was ~1.2x (5.58s->4.61s) on a
local single node, not 2x. Add the confirmed server version (1.18.2) to both callouts.
2026-07-15 09:54:39 -07:00
John Kupchanko 0dc0fe005b docs(article): anchor benchmark callouts to the confirmed test environment
Replace the version placeholder with the confirmed setup: local single-node
Qdrant, qdrant-client 1.12.0, Windows 11, ~10k synthetic 768-dim vectors.
2026-07-15 09:45:26 -07:00
John Kupchanko 0063e25079 docs(article): add environment and scale context to benchmark callouts
Note the local single-node setup and Qdrant version on both benchmarks,
and qualify that 10k vectors is a small sample whose gains grow with scale.
2026-07-15 09:36:46 -07:00
John Kupchanko 1104a2b17e fix(article): address review — frontmatter, redirect, TurboQuant bits, copy
- Frontmatter: full-timestamp date, add author_link and keywords, trim description under 140 chars
- Add redirect for the unpublished indexing-optimization article
- Show bits=BITS4 in the TurboQuant snippet to match the decision tree
- Replace the five repeated 'In Python, this can look like' lead-ins with specific ones
- Add prefer_grpc=True tip and a collection-status-green check
2026-07-15 08:52:21 -07:00
John Kupchanko 4515784350 feat(article): decision-tree diagram, refreshed strategy images, best-practices reframe
Replace the Choosing the Right Mix table with a decision-tree diagram,
refresh all seven strategy diagrams, and group batching, parallelization,
and sharding under Best Practices for Every Upload (no longer numbered options).
2026-07-15 08:33:34 -07:00
John KupchankoandClaude Opus 4.7 ecc0365149 Address second review round (kanungle, abdonpijpelink)
- Move the "Before we get into..." sentence into the Why Vector Type
  Matters section (per Neil's clarified intent)
- Replace all custom-styled inline HTML (vector-type badges, best-fit/
  watch-for callouts, benchmark boxes) with standard markdown for
  consistency with other articles and docs
- Point to "Qdrant's Agent Skills" at qdrant.tech/documentation/skills/
- Switch Option 3 example from scalar quantization to TurboQuant

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-07-13 13:00:02 -07:00
John KupchankoandClaude Opus 4.7 0922daf404 Address review feedback on bulk uploads article
- Convert all diagram embeds from HTML <img> to markdown image syntax
- Trim code snippets to the focal call (drop client/collection boilerplate;
  drop the points-generation block in the batching example)
- Move the "break down the difference" line to open the Vector Type section
- Remove the redundant closing sentence in Why Vector Type Matters
- Bold "there is no single configuration that works best for every bulk upload"
- Replace the Capacity Planning link with the Qdrant sizing calculator
  (sizing.qdrant.tech)
- Add a pointer to Qdrant Skills for scenario-specific guidance

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-07-10 08:15:37 -07:00
kanungle e9337e1ad5 unpublish older article on this topic 2026-07-09 21:01:22 -07:00
kanungle c4f2ca2d4c Updated preview images and article title/date 2026-07-09 20:55:18 -07:00
John KupchankoandClaude Opus 4.7 5572708d28 Add article: How to Handle Bulk Uploads in Qdrant
New production-ops article covering bulk upload best practices in Qdrant:
on-disk vector storage, payload indexes, quantization, sparse-index
on-disk storage, batching, parallelization, and sharding — for both
dense and sparse vectors.

Includes:
- content/articles/bulk-uploads-in-qdrant.md
- Cover / preview / social images (preview/)
- Seven flow diagrams (one per option) illustrating the recommended vs
  default path for each strategy

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-07-09 16:30:57 -07:00
kanungle 614c0f6c19 fix broken links from new image locations & file extensions 2026-07-08 19:31:28 -07:00
kanungle dba1c5fb6c Merge pull request #2444 from qdrant/tech-article-reorg-2
Technical Article Reorganization - Stage 2
2026-07-07 14:20:18 -07:00
Abdon Pijpelink 757767919b Add 'Mitigate Read-Write Contention' section to the bulk upload guide (#2469)
* Change bulk upload from tutorial into guide

* Add 'Mitigate Read-Write Contention' section to bulk upload guide

* Update meta descriptions
2026-07-06 10:02:00 +02:00
kanungle 2e660a99dd update turboquant article title 2026-07-02 21:16:49 -07:00
kanungle 46297e8540 reverting bad title updates 2026-07-02 20:57:43 -07:00
kanungle 670824ca60 internally approved title update & unhide 3 articles 2026-07-02 20:46:07 -07:00
Dylan Couzon b16424925b update title 2026-06-23 22:36:33 -04:00
Dylan Couzon b3b435f340 v2 final edits 2026-06-23 22:26:07 -04:00
Dylan Couzon 468425f057 update article based on feedback 2026-06-23 20:47:18 -04:00
Dylan Couzon 964a7be0c1 v2 2026-06-23 20:47:18 -04:00
Dylan Couzon e481b015d5 v1 2026-06-23 20:47:18 -04:00
kanungle 52c1564be8 updated TurboQuant article title 2026-06-23 10:39:05 -07:00
kanungle c7ef3af4d7 Standardized and SEO optimized tech article titles 2026-06-23 10:20:12 -07:00
kanungle 16efcd9124 Add Latest/Featured Articles on main page 2026-06-23 09:59:42 -07:00
kanungle d4a001c903 move turboquant article categorization 2026-06-23 09:26:04 -07:00
kanungle 37de08db16 initial category reorganization 2026-06-22 22:08:34 -07:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 8ef516b06f Update HuggingFace model links to Qdrant org across SPLADE series
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 16:20:55 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 6d63a4ebf4 Update finetune-ecommerce-search links to qdrant-labs org
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 16:18:33 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 cf78f6e44b Remove posting_list.rs links from SPLADE series parts 1 & 3
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-05 11:44:05 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 02b56a52c5 Add metric comparability notes to SPLADE series parts 1-4
Metrics were measured on a subsample (100k products, 10k queries) with
all relevant documents included, so they are not comparable to official
Amazon ESCI benchmarks. Add inline notes at each metric table/result.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-04 12:21:09 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 2d8e995a8f Fix SIMD index links in SPLADE series parts 1 & 3
Point to the actual posting_list.rs implementation instead of the
sparse-vectors article.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-04 11:43:21 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 9ab2af0542 Fix ANCE references across SPLADE series
Replace "ANCE" with "ANCE-inspired" throughout since the implementation
uses Qdrant's exact inverted index, not ANN. Reference the original
ANCE paper (Xiong et al., arxiv 2007.00808) in Part 3.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-04 11:42:36 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 f4d989b1cb Fix SPLADE architecture order in parts 1 & 2
Log saturation (ReLU + log1p) is applied per-token before max pooling
across positions, not after. Fix text descriptions and pipeline diagram.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-04 11:32:49 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 4a727882dc Fix experiment repo links in SPLADE series
Replace qdrant-labs devrel subfolder links with Thierry's experiments
repo (thierrypdamiba/finetune-ecommerce-search) across all 5 parts.
Framework/CLI links (qdrant/sparse-finetune) remain unchanged.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-03 19:28:42 +02:00
Evgeniya SukhodolskayaandClaude Sonnet 4.6 1676ac43f0 Fix GitHub repo links in sparse embeddings e-commerce series
Update links from thierrypdamiba/finetune-ecommerce-search to
qdrant-labs/devrel-projects/tree/main/qdrant-sparse-finetune across
all 5 articles.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-29 16:56:34 +02:00
Mohamed Arbi b889e19117 docs: fix typos and improve clarity in quantization/turboQuant docs (#2371) 2026-05-26 09:36:46 +02:00
Abdon Pijpelink 97b3a05c5f Reorganize search tutorials (#2352)
* Restructure search tutorials

* Deleted moved tutorial

* Re-instate deleted frontmatter

* Fix links to moved files

* Move code search and build tutorials to 'Develop&Implement' section

* Update landing pages too

* Fix broken links
2026-05-19 16:38:52 +02:00
kanungle 10299579aa Merge pull request #2328 from qdrant/turboquant-article
TurboQuant article
2026-05-13 10:49:50 -07:00
jojii 3baa204409 Update date of the article 2026-05-13 17:21:19 +02:00
jojii cb477c16c5 Add link to visual reprentation of TQ 2026-05-13 11:03:19 +02:00
jojii f9d760c05e Less em dashes 2026-05-13 10:37:39 +02:00
Ivan Pleshkov 1ad8138ec5 fix bullet padding 2026-05-12 17:52:56 +02:00
Ivan Pleshkov 4e5361d5b3 use x as letter 2026-05-12 17:16:38 +02:00
Ivan PleshkovandAbdon Pijpelink 98c3bd3a75 Update qdrant-landing/content/articles/turboquant-quantization.md
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@qdrant.com>
2026-05-12 13:56:55 +02:00
Ivan PleshkovandAbdon Pijpelink 3025dc6415 Update qdrant-landing/content/articles/turboquant-quantization.md
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@qdrant.com>
2026-05-12 13:56:28 +02:00
Ivan PleshkovandAbdon Pijpelink 18327e309e Update qdrant-landing/content/articles/turboquant-quantization.md
Co-authored-by: Abdon Pijpelink <abdon.pijpelink@qdrant.com>
2026-05-12 13:56:17 +02:00
Ivan Pleshkov 1258c41d0d fix links 2026-05-12 09:51:51 +02:00