mirror of
https://github.com/qdrant/landing_page.git
synced 2026-10-06 11:28:31 +02:00
1a40961d62
* initial commit; fixed anchor links on internal docs pages * add back in absolute paths for links in code comments * fix: update linkchecker include filter to match server port 1314 PR #1629 changed the Hugo server to port 1314 but forgot to update the --include filter, which still matched port 1313. This caused all links to be excluded, making the checker a no-op (0 checked, 82277 excluded). Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * Fix url rewrite regex so images are not impacted * Fix links from non-documentation pages * Fix broken links * more broken links * more broken links * broken link * Add srcset width descriptor to .lycheeignore * Ignore URLs that contain a % character * Anchor regex so it matches the entire URL --------- Co-authored-by: kanungle <neil.kanungo@gmail.com> Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: Abdon Pijpelink <abdon.pijpelink@qdrant.com>
84 lines
3.5 KiB
Markdown
84 lines
3.5 KiB
Markdown
---
|
|
title: From Elasticsearch
|
|
weight: 20
|
|
partition: ecosystem
|
|
---
|
|
|
|
# Migrate from Elasticsearch to Qdrant
|
|
|
|
## What You Need from Elasticsearch
|
|
|
|
- **Elasticsearch URL** — the HTTP endpoint
|
|
- **Index name** — the index containing your vectors
|
|
- **Credentials** — username/password or API key
|
|
|
|
## Concept Mapping
|
|
|
|
| Elasticsearch | Qdrant | Notes |
|
|
| :--- | :--- | :--- |
|
|
| Index | Collection | One-to-one mapping |
|
|
| Document | Point | Each document becomes a point |
|
|
| `dense_vector` field | Vector | Mapped automatically |
|
|
| Document fields | Payload | Non-vector fields become payload |
|
|
| `cosine` | `Cosine` | ES returns `1 - cosine_distance`; Qdrant returns cosine similarity directly |
|
|
| `l2_norm` | `Euclid` | Direct mapping |
|
|
| `dot_product` | `Dot` | Direct mapping |
|
|
|
|
## Run the Migration
|
|
|
|
```bash
|
|
docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration elasticsearch \
|
|
--elasticsearch.url 'https://your-es-host:9200' \
|
|
--elasticsearch.index 'your-index' \
|
|
--elasticsearch.username 'elastic' \
|
|
--elasticsearch.password 'your-password' \
|
|
--qdrant.url 'https://your-instance.cloud.qdrant.io:6334' \
|
|
--qdrant.api-key 'your-qdrant-api-key' \
|
|
--qdrant.collection 'your-collection'
|
|
```
|
|
|
|
### Using API Key Authentication
|
|
|
|
```bash
|
|
docker run --net=host --rm -it registry.cloud.qdrant.io/library/qdrant-migration elasticsearch \
|
|
--elasticsearch.url 'https://your-es-host:9200' \
|
|
--elasticsearch.index 'your-index' \
|
|
--elasticsearch.api-key 'your-es-api-key' \
|
|
--qdrant.url 'https://your-instance.cloud.qdrant.io:6334' \
|
|
--qdrant.api-key 'your-qdrant-api-key' \
|
|
--qdrant.collection 'your-collection'
|
|
```
|
|
|
|
### All Elasticsearch-Specific Flags
|
|
|
|
| Flag | Required | Description |
|
|
| :--- | :--- | :--- |
|
|
| `--elasticsearch.url` | Yes | Elasticsearch HTTP endpoint |
|
|
| `--elasticsearch.index` | Yes | Index to migrate |
|
|
| `--elasticsearch.username` | No | Username for basic auth |
|
|
| `--elasticsearch.password` | No | Password for basic auth |
|
|
| `--elasticsearch.api-key` | No | API key for authentication |
|
|
| `--elasticsearch.insecure-skip-verify` | No | Skip TLS certificate verification |
|
|
|
|
### Qdrant-Side Options
|
|
|
|
| Flag | Default | Description |
|
|
| :--- | :--- | :--- |
|
|
| `--qdrant.id-field` | `__id__` | Payload field name for original Elasticsearch document IDs |
|
|
|
|
## Hybrid Search Considerations
|
|
|
|
If your Elasticsearch setup uses hybrid BM25 + kNN scoring, you'll need to reconstruct this in Qdrant using [sparse vectors](/documentation/manage-data/vectors/#sparse-vectors) (for BM25-like behavior) alongside dense vectors. The migration tool transfers the dense vectors; you'll need to generate sparse vectors separately if you want hybrid search in Qdrant.
|
|
|
|
Qdrant supports native hybrid search with [Reciprocal Rank Fusion (RRF)](/documentation/search/hybrid-queries/) to combine dense and sparse results.
|
|
|
|
## Gotchas
|
|
|
|
- **Nested documents:** Elasticsearch nested documents need to be flattened or restructured for Qdrant's payload model.
|
|
- **Score normalization:** Elasticsearch `_score` values are not comparable to Qdrant scores. Use rank-based metrics (recall@k, Spearman correlation) rather than raw score comparison when [verifying your migration](/documentation/migration-guidance/).
|
|
- **BM25 is not migrated:** The migration tool transfers vectors and document fields. If you relied on Elasticsearch's BM25 scoring, you'll need to set up sparse vectors in Qdrant separately.
|
|
|
|
## Next Steps
|
|
|
|
After migration, verify your data arrived correctly with the [Migration Verification Guide](/documentation/migration-guidance/).
|