mirror of
https://github.com/qdrant/landing_page.git
synced 2026-09-25 22:18:30 +02:00
Add plan and experiments
This commit is contained in:
Dylan Couzon
@@ -0,0 +1,7 @@
|
|||||||
|
data/
|
||||||
|
cache/
|
||||||
|
*.pyc
|
||||||
|
__pycache__/
|
||||||
|
# Per-document fused rows: 6.7 MB, and `python run.py t5` regenerates them from cache/.
|
||||||
|
fused/
|
||||||
|
.venv/
|
||||||
@@ -0,0 +1,71 @@
|
|||||||
|
# Hybrid Fusion Experiment
|
||||||
|
|
||||||
|
The harness behind the Tuning Retrieval in Qdrant series. Every claim in those articles traces to a file here through [`grounding.md`](grounding.md).
|
||||||
|
|
||||||
|
`run.py` owns the measurement layer: corpora, indexes, the 45-arm fusion replay, and the two parity gates. `study.py` answers one series question per task on top of it.
|
||||||
|
|
||||||
|
## Run it
|
||||||
|
|
||||||
|
```bash
|
||||||
|
docker run -d --name fusion-qdrant -p 6360:6333 -p 6361:6334 qdrant/qdrant:v1.19.0
|
||||||
|
./download.sh # five corpora into data/raw/, about 1.3 GB
|
||||||
|
python test_replay.py # Gate A: the seven Rust fixtures, exact equality
|
||||||
|
python run.py t1 # corpora, avg_len, manifest.json
|
||||||
|
python run.py t3 # build indexes, cache dense and sparse top-200
|
||||||
|
python run.py t4 # Gate B: live parity against the server
|
||||||
|
python run.py t5 # replay 45 arms
|
||||||
|
python run.py t6 # candidate-breadth sweep, SciFact
|
||||||
|
python run.py t7 # four more SciFact builds, then the floor
|
||||||
|
python run.py t8 && python run.py exhibit
|
||||||
|
python figure.py && python build_notebook.py
|
||||||
|
```
|
||||||
|
|
||||||
|
Full run is about 25 minutes on a laptop, most of it embedding 207,000 documents.
|
||||||
|
|
||||||
|
Then the series tasks, which read what the above produced:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
python study.py e1 # held-out split, 200 random splits per corpus
|
||||||
|
python study.py e2 # how wide an interval each labeled-set size buys
|
||||||
|
python study.py e5 # what a second prefetch adds, and what fusion keeps
|
||||||
|
python study.py e3 # depth and hnsw_ef against ceiling and score, five corpora
|
||||||
|
python study.py e3_latency # one fused request per query, randomized across settings
|
||||||
|
python study.py e4_score # cross-encoder scores, three models. The slow one, hours
|
||||||
|
python study.py e4 # reranking quality, selected and reported on different halves
|
||||||
|
python study.py e6 # rebuild quantized, re-run the sweep, compare the verdicts
|
||||||
|
python verify_articles.py # every figure in the five articles against its artifact
|
||||||
|
```
|
||||||
|
|
||||||
|
`e1`, `e2` and `e5` are pure replay and take seconds. `e3` and `e6` need the container. `e4_score` caches to `study/rerank/` per corpus and model, so it resumes rather than restarting.
|
||||||
|
|
||||||
|
## What is here
|
||||||
|
|
||||||
|
| Path | Contents |
|
||||||
|
| --- | --- |
|
||||||
|
| `harness/replay.py` | RRF and DBSF reproduced from the Rust, in float32 |
|
||||||
|
| `harness/corpora.py` | The five loaders, subsampling at seed 42, `avg_len` measurement |
|
||||||
|
| `harness/qio.py` | Index building and retrieval |
|
||||||
|
| `harness/metrics.py` | nDCG@10, Recall@100, MRR@10, bootstrap intervals |
|
||||||
|
| `run.py` | Tasks T1 to T8, one function each |
|
||||||
|
| `study.py` | Tasks E1 to E6, one series question each |
|
||||||
|
| `verify_articles.py` | Checks all 190 published figures two ways: against the artifact, and that the article file contains the value |
|
||||||
|
| `test_replay.py` | Gate A |
|
||||||
|
| `figure.py`, `build_notebook.py` | The article figure and the companion notebook |
|
||||||
|
| `grounding.md` | Every claim, with the artifact or source line behind it |
|
||||||
|
| `engineering-question.md` | Weighted score fusion has no API; drafted for the engine team |
|
||||||
|
| `manifest.json`, `results/`, `fused/`, `diag/`, `floor/`, `breadth/`, `parity/`, `exhibit.json` | `run.py` outputs |
|
||||||
|
| `study/` | `study.py` outputs, one JSON per task, plus cached reranker scores |
|
||||||
|
|
||||||
|
`data/` and `cache/` are gitignored. `cache/` regenerates from `download.sh` plus T1 and T3.
|
||||||
|
|
||||||
|
## Two setup traps
|
||||||
|
|
||||||
|
Both would have produced quiet, wrong numbers.
|
||||||
|
|
||||||
|
`full_scan_threshold` is in KiloBytes and the server rejects anything below 10 (`config_diff.rs:57`). Separately, an HNSW graph is only built for a segment larger than `optimizers_config.indexing_threshold`, which defaults to 10,000 KB (`lib/shard/src/optimizers/config.rs:17`, v1.19.0). That is about 6,700 vectors at 384 dimensions, and it is measured per segment rather than per collection, so SciFact sits under it outright and a larger corpus can sit under it on every segment. Without setting it, dense search would have been a full scan and the `hnsw_ef` sweep would have measured nothing.
|
||||||
|
|
||||||
|
T3 gates on `indexed_vectors_count` against `points_count`, which is the direct read of whether a graph exists. It also runs the same query at `hnsw_ef` 64 and 512 and records whether they agree, but that comparison never gates: recall saturates, so SciFact returns byte-identical lists at both settings on a graph that is demonstrably HNSW.
|
||||||
|
|
||||||
|
## Two implementations, same numbers
|
||||||
|
|
||||||
|
The notebook computes nDCG@10 and the fusion arithmetic independently of the harness, which uses `pytrec_eval`. On SciFact both give 0.7175 for the default arm, 0.7323 for DBSF, 0.7067 for `k=61`, 0.9820 for the candidate ceiling, and 0.0313 for the median bootstrap interval.
|
||||||
@@ -0,0 +1,704 @@
|
|||||||
|
{
|
||||||
|
"ef16_depth20": {
|
||||||
|
"depth": 20,
|
||||||
|
"hnsw_ef": 16,
|
||||||
|
"union_recall": 0.9279999999999999,
|
||||||
|
"ideal_ndcg_10": 0.9300191174702331,
|
||||||
|
"dense_recall": 0.8246666666666667,
|
||||||
|
"sparse_recall": 0.869888888888889,
|
||||||
|
"default_ndcg_10": 0.7182688660917973,
|
||||||
|
"best_arm": "rrf_k2_w1-2",
|
||||||
|
"best_ndcg_10": 0.7186626208196644,
|
||||||
|
"ordering": [
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"rrf_k2_w1-2": 0.7186626208196644,
|
||||||
|
"rrf_k2_w1-1": 0.7182688660917973,
|
||||||
|
"dbsf": 0.7180624203560962,
|
||||||
|
"rrf_k5_w1-1": 0.7144896378229179,
|
||||||
|
"rrf_k2_w1-3": 0.7144193280684847,
|
||||||
|
"rrf_k1_w1-1": 0.7135450244676782,
|
||||||
|
"rrf_k2_w2-4": 0.7123968048344199,
|
||||||
|
"rrf_k5_w2-1": 0.7112936660210052,
|
||||||
|
"rrf_k20_w1-1": 0.7103689805696072,
|
||||||
|
"rrf_k61_w1-1": 0.709054610626914,
|
||||||
|
"rrf_k1_w2-4": 0.7072000684515861,
|
||||||
|
"rrf_k1_w1-2": 0.7072000684515861,
|
||||||
|
"rrf_k61_w2-1": 0.7062135585194244,
|
||||||
|
"rrf_k5_w1-2": 0.706119469573368,
|
||||||
|
"rrf_k20_w2-1": 0.7059670423888645,
|
||||||
|
"rrf_k2_w2-1": 0.7051988348175411,
|
||||||
|
"rrf_k5_w3-1": 0.7041194337257045,
|
||||||
|
"rrf_k5_w2-4": 0.7035188474408888,
|
||||||
|
"rrf_k5_w1-3": 0.703458974622195,
|
||||||
|
"rrf_k20_w1-2": 0.702524300928885,
|
||||||
|
"rrf_k20_w2-4": 0.7022446152670828,
|
||||||
|
"rrf_k61_w1-2": 0.701808182755178,
|
||||||
|
"rrf_k20_w1-3": 0.7011772272970471,
|
||||||
|
"rrf_k1_w1-3": 0.7007666368740246,
|
||||||
|
"rrf_k61_w2-4": 0.7003274791557945,
|
||||||
|
"rrf_k61_w3-1": 0.6996554544279036,
|
||||||
|
"rrf_k20_w3-1": 0.6996426723710097,
|
||||||
|
"rrf_k61_w1-3": 0.6989198059922149,
|
||||||
|
"rrf_k2_w3-1": 0.6984422813165032,
|
||||||
|
"rrf_k1_w2-1": 0.6811476245232382,
|
||||||
|
"rrf_k1_w3-1": 0.6649761309688809
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.6465517241379312
|
||||||
|
},
|
||||||
|
"ef16_depth50": {
|
||||||
|
"depth": 50,
|
||||||
|
"hnsw_ef": 16,
|
||||||
|
"union_recall": 0.9503333333333334,
|
||||||
|
"ideal_ndcg_10": 0.9511195792180346,
|
||||||
|
"dense_recall": 0.8820000000000001,
|
||||||
|
"sparse_recall": 0.8918888888888888,
|
||||||
|
"default_ndcg_10": 0.7194971588756962,
|
||||||
|
"best_arm": "dbsf",
|
||||||
|
"best_ndcg_10": 0.7278864243745619,
|
||||||
|
"ordering": [
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"dbsf": 0.7278864243745619,
|
||||||
|
"rrf_k2_w1-1": 0.7194971588756962,
|
||||||
|
"rrf_k2_w1-2": 0.7157663405681429,
|
||||||
|
"rrf_k5_w1-1": 0.715360060419144,
|
||||||
|
"rrf_k2_w2-4": 0.71478232340963,
|
||||||
|
"rrf_k20_w1-1": 0.714621311962853,
|
||||||
|
"rrf_k5_w2-1": 0.7143402336849811,
|
||||||
|
"rrf_k1_w1-1": 0.7142887684692664,
|
||||||
|
"rrf_k5_w3-1": 0.7106907470858285,
|
||||||
|
"rrf_k2_w1-3": 0.710128341304386,
|
||||||
|
"rrf_k20_w2-1": 0.7089818188837064,
|
||||||
|
"rrf_k61_w1-1": 0.7085654496664912,
|
||||||
|
"rrf_k5_w1-2": 0.707450594516784,
|
||||||
|
"rrf_k20_w3-1": 0.7053706507474363,
|
||||||
|
"rrf_k61_w2-1": 0.7053444556152197,
|
||||||
|
"rrf_k61_w3-1": 0.7052790567162379,
|
||||||
|
"rrf_k2_w2-1": 0.7051596768810012,
|
||||||
|
"rrf_k5_w1-3": 0.7043051670228958,
|
||||||
|
"rrf_k1_w2-4": 0.7041177382870462,
|
||||||
|
"rrf_k1_w1-2": 0.7041177382870462,
|
||||||
|
"rrf_k5_w2-4": 0.703790685484793,
|
||||||
|
"rrf_k1_w1-3": 0.7014010231101435,
|
||||||
|
"rrf_k20_w1-2": 0.7008815170374046,
|
||||||
|
"rrf_k20_w1-3": 0.6991732462220025,
|
||||||
|
"rrf_k20_w2-4": 0.6989591471922769,
|
||||||
|
"rrf_k61_w1-2": 0.6987752232207968,
|
||||||
|
"rrf_k61_w2-4": 0.6971977684589945,
|
||||||
|
"rrf_k2_w3-1": 0.6968480924560846,
|
||||||
|
"rrf_k61_w1-3": 0.6966240671744881,
|
||||||
|
"rrf_k1_w2-1": 0.6778207611055789,
|
||||||
|
"rrf_k1_w3-1": 0.6640622483356133
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.8663793103448276
|
||||||
|
},
|
||||||
|
"ef16_depth200": {
|
||||||
|
"depth": 200,
|
||||||
|
"hnsw_ef": 16,
|
||||||
|
"union_recall": 0.9816666666666667,
|
||||||
|
"ideal_ndcg_10": 0.982043823975885,
|
||||||
|
"dense_recall": 0.955,
|
||||||
|
"sparse_recall": 0.94,
|
||||||
|
"default_ndcg_10": 0.717491736277043,
|
||||||
|
"best_arm": "dbsf",
|
||||||
|
"best_ndcg_10": 0.7323037871882409,
|
||||||
|
"ordering": [
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"dbsf": 0.7323037871882409,
|
||||||
|
"rrf_k2_w1-1": 0.717491736277043,
|
||||||
|
"rrf_k5_w1-1": 0.7156308396590209,
|
||||||
|
"rrf_k2_w2-4": 0.7150768502208781,
|
||||||
|
"rrf_k2_w1-2": 0.7150124228231062,
|
||||||
|
"rrf_k5_w2-1": 0.7142404865507347,
|
||||||
|
"rrf_k20_w2-1": 0.7137673060986615,
|
||||||
|
"rrf_k5_w3-1": 0.712514365393912,
|
||||||
|
"rrf_k20_w3-1": 0.7123290351441248,
|
||||||
|
"rrf_k1_w1-1": 0.7116966674396331,
|
||||||
|
"rrf_k20_w1-1": 0.7112821368972284,
|
||||||
|
"rrf_k2_w1-3": 0.7105054986136041,
|
||||||
|
"rrf_k61_w3-1": 0.7088949151132611,
|
||||||
|
"rrf_k5_w2-4": 0.708176108103904,
|
||||||
|
"rrf_k61_w1-1": 0.7077369755668609,
|
||||||
|
"rrf_k61_w2-1": 0.7076476866448055,
|
||||||
|
"rrf_k5_w1-2": 0.7074628011684923,
|
||||||
|
"rrf_k5_w1-3": 0.7049256031971145,
|
||||||
|
"rrf_k1_w2-4": 0.7045940546967714,
|
||||||
|
"rrf_k1_w1-2": 0.7045940546967714,
|
||||||
|
"rrf_k2_w2-1": 0.7033628305613119,
|
||||||
|
"rrf_k20_w1-2": 0.7032797784391043,
|
||||||
|
"rrf_k1_w1-3": 0.7015955812699949,
|
||||||
|
"rrf_k20_w1-3": 0.7006544754820371,
|
||||||
|
"rrf_k20_w2-4": 0.6992129766041237,
|
||||||
|
"rrf_k2_w3-1": 0.6977839705926246,
|
||||||
|
"rrf_k61_w1-2": 0.6953235940524766,
|
||||||
|
"rrf_k61_w2-4": 0.6933659535058827,
|
||||||
|
"rrf_k61_w1-3": 0.6921649012827853,
|
||||||
|
"rrf_k1_w2-1": 0.6769662017394467,
|
||||||
|
"rrf_k1_w3-1": 0.6649022480113157
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.9870689655172414
|
||||||
|
},
|
||||||
|
"ef128_depth20": {
|
||||||
|
"depth": 20,
|
||||||
|
"hnsw_ef": 128,
|
||||||
|
"union_recall": 0.9279999999999999,
|
||||||
|
"ideal_ndcg_10": 0.9300191174702331,
|
||||||
|
"dense_recall": 0.8280000000000001,
|
||||||
|
"sparse_recall": 0.869888888888889,
|
||||||
|
"default_ndcg_10": 0.7155128155518965,
|
||||||
|
"best_arm": "rrf_k2_w1-2",
|
||||||
|
"best_ndcg_10": 0.7172458775130834,
|
||||||
|
"ordering": [
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"rrf_k2_w1-2": 0.7172458775130834,
|
||||||
|
"dbsf": 0.7172449501044995,
|
||||||
|
"rrf_k2_w1-1": 0.7155128155518965,
|
||||||
|
"rrf_k2_w1-3": 0.7141929350188453,
|
||||||
|
"rrf_k5_w1-1": 0.7131118419781046,
|
||||||
|
"rrf_k2_w2-4": 0.7118522356800095,
|
||||||
|
"rrf_k1_w1-1": 0.7107889739277774,
|
||||||
|
"rrf_k5_w2-1": 0.7098850336199061,
|
||||||
|
"rrf_k20_w1-1": 0.7093839764534631,
|
||||||
|
"rrf_k61_w1-1": 0.7078385283710144,
|
||||||
|
"rrf_k1_w1-2": 0.707013559299767,
|
||||||
|
"rrf_k1_w2-4": 0.707013559299767,
|
||||||
|
"rrf_k61_w2-1": 0.7046990423377331,
|
||||||
|
"rrf_k5_w1-2": 0.7044926868045217,
|
||||||
|
"rrf_k20_w2-1": 0.704452526207173,
|
||||||
|
"rrf_k5_w2-4": 0.7031900054869534,
|
||||||
|
"rrf_k5_w3-1": 0.703077687165435,
|
||||||
|
"rrf_k5_w1-3": 0.7030225421102901,
|
||||||
|
"rrf_k20_w1-2": 0.7024265371147049,
|
||||||
|
"rrf_k2_w2-1": 0.7022850545953327,
|
||||||
|
"rrf_k20_w2-4": 0.7021756797211153,
|
||||||
|
"rrf_k61_w1-2": 0.7021756797211153,
|
||||||
|
"rrf_k20_w1-3": 0.7013631554524637,
|
||||||
|
"rrf_k1_w1-3": 0.7006387201236097,
|
||||||
|
"rrf_k61_w2-4": 0.7002585436098269,
|
||||||
|
"rrf_k61_w1-3": 0.6992474190603318,
|
||||||
|
"rrf_k61_w3-1": 0.697837059321573,
|
||||||
|
"rrf_k20_w3-1": 0.6978242772646791,
|
||||||
|
"rrf_k2_w3-1": 0.6958123293356949,
|
||||||
|
"rrf_k1_w2-1": 0.6803018072010231,
|
||||||
|
"rrf_k1_w3-1": 0.6646711259156606
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.6450920689818782
|
||||||
|
},
|
||||||
|
"ef128_depth50": {
|
||||||
|
"depth": 50,
|
||||||
|
"hnsw_ef": 128,
|
||||||
|
"union_recall": 0.9503333333333334,
|
||||||
|
"ideal_ndcg_10": 0.9511195792180346,
|
||||||
|
"dense_recall": 0.8853333333333334,
|
||||||
|
"sparse_recall": 0.8918888888888888,
|
||||||
|
"default_ndcg_10": 0.7168891288761211,
|
||||||
|
"best_arm": "dbsf",
|
||||||
|
"best_ndcg_10": 0.7270333475290183,
|
||||||
|
"ordering": [
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"dbsf": 0.7270333475290183,
|
||||||
|
"rrf_k2_w1-1": 0.7168891288761211,
|
||||||
|
"rrf_k2_w1-2": 0.7145759903112014,
|
||||||
|
"rrf_k2_w2-4": 0.7143857747955454,
|
||||||
|
"rrf_k5_w2-1": 0.7131031179018119,
|
||||||
|
"rrf_k20_w1-1": 0.7129886096677298,
|
||||||
|
"rrf_k5_w1-1": 0.7129788312554507,
|
||||||
|
"rrf_k1_w1-1": 0.7116807384696913,
|
||||||
|
"rrf_k2_w1-3": 0.710128341304386,
|
||||||
|
"rrf_k5_w3-1": 0.7096592719939475,
|
||||||
|
"rrf_k61_w1-1": 0.7077673707197607,
|
||||||
|
"rrf_k20_w2-1": 0.7070958280662616,
|
||||||
|
"rrf_k5_w1-2": 0.7058238117479376,
|
||||||
|
"rrf_k20_w3-1": 0.7049691204147904,
|
||||||
|
"rrf_k5_w2-4": 0.7047348436009861,
|
||||||
|
"rrf_k1_w2-4": 0.7041576221848665,
|
||||||
|
"rrf_k1_w1-2": 0.7041576221848665,
|
||||||
|
"rrf_k5_w1-3": 0.7040998126507464,
|
||||||
|
"rrf_k61_w2-1": 0.7035828272474297,
|
||||||
|
"rrf_k2_w2-1": 0.7030903580777434,
|
||||||
|
"rrf_k61_w3-1": 0.7029903114392931,
|
||||||
|
"rrf_k20_w1-2": 0.7020753889107378,
|
||||||
|
"rrf_k1_w1-3": 0.7014010231101435,
|
||||||
|
"rrf_k20_w2-4": 0.7001893813470387,
|
||||||
|
"rrf_k61_w1-2": 0.6997743792358032,
|
||||||
|
"rrf_k20_w1-3": 0.6997474373949425,
|
||||||
|
"rrf_k61_w2-4": 0.698196924474001,
|
||||||
|
"rrf_k61_w1-3": 0.6971043386529252,
|
||||||
|
"rrf_k2_w3-1": 0.6949529827311328,
|
||||||
|
"rrf_k1_w2-1": 0.677976643304058,
|
||||||
|
"rrf_k1_w3-1": 0.6641149282290312
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.8232758620689656
|
||||||
|
},
|
||||||
|
"ef128_depth200": {
|
||||||
|
"depth": 200,
|
||||||
|
"hnsw_ef": 128,
|
||||||
|
"union_recall": 0.9816666666666667,
|
||||||
|
"ideal_ndcg_10": 0.982043823975885,
|
||||||
|
"dense_recall": 0.955,
|
||||||
|
"sparse_recall": 0.94,
|
||||||
|
"default_ndcg_10": 0.717491736277043,
|
||||||
|
"best_arm": "dbsf",
|
||||||
|
"best_ndcg_10": 0.7323037871882409,
|
||||||
|
"ordering": [
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"dbsf": 0.7323037871882409,
|
||||||
|
"rrf_k2_w1-1": 0.717491736277043,
|
||||||
|
"rrf_k5_w1-1": 0.7153997615192654,
|
||||||
|
"rrf_k2_w2-4": 0.7150768502208781,
|
||||||
|
"rrf_k2_w1-2": 0.7150124228231062,
|
||||||
|
"rrf_k5_w2-1": 0.7142404865507347,
|
||||||
|
"rrf_k20_w2-1": 0.7137274222008411,
|
||||||
|
"rrf_k5_w3-1": 0.712514365393912,
|
||||||
|
"rrf_k20_w3-1": 0.712280918873719,
|
||||||
|
"rrf_k20_w1-1": 0.712245686318288,
|
||||||
|
"rrf_k1_w1-1": 0.7116966674396331,
|
||||||
|
"rrf_k2_w1-3": 0.7105054986136041,
|
||||||
|
"rrf_k61_w3-1": 0.7088186689340121,
|
||||||
|
"rrf_k61_w2-1": 0.7075995703743996,
|
||||||
|
"rrf_k5_w2-4": 0.7072125586828444,
|
||||||
|
"rrf_k61_w1-1": 0.7067253098753955,
|
||||||
|
"rrf_k5_w1-2": 0.7062325670137304,
|
||||||
|
"rrf_k5_w1-3": 0.7049256031971145,
|
||||||
|
"rrf_k1_w2-4": 0.7045940546967714,
|
||||||
|
"rrf_k1_w1-2": 0.7045940546967714,
|
||||||
|
"rrf_k2_w2-1": 0.7033628305613119,
|
||||||
|
"rrf_k20_w1-2": 0.7032797784391043,
|
||||||
|
"rrf_k1_w1-3": 0.7015955812699949,
|
||||||
|
"rrf_k20_w1-3": 0.7006544754820371,
|
||||||
|
"rrf_k20_w2-4": 0.6982494271830642,
|
||||||
|
"rrf_k2_w3-1": 0.6977839705926246,
|
||||||
|
"rrf_k61_w1-2": 0.6953235940524766,
|
||||||
|
"rrf_k61_w2-4": 0.6933659535058827,
|
||||||
|
"rrf_k61_w1-3": 0.6921649012827853,
|
||||||
|
"rrf_k1_w2-1": 0.6769662017394467,
|
||||||
|
"rrf_k1_w3-1": 0.6649022480113157
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 1.0
|
||||||
|
},
|
||||||
|
"ef512_depth20": {
|
||||||
|
"depth": 20,
|
||||||
|
"hnsw_ef": 512,
|
||||||
|
"union_recall": 0.9279999999999999,
|
||||||
|
"ideal_ndcg_10": 0.9300191174702331,
|
||||||
|
"dense_recall": 0.8280000000000001,
|
||||||
|
"sparse_recall": 0.869888888888889,
|
||||||
|
"default_ndcg_10": 0.7155128155518965,
|
||||||
|
"best_arm": "rrf_k2_w1-2",
|
||||||
|
"best_ndcg_10": 0.7172458775130834,
|
||||||
|
"ordering": [
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"rrf_k2_w1-2": 0.7172458775130834,
|
||||||
|
"dbsf": 0.7172449501044995,
|
||||||
|
"rrf_k2_w1-1": 0.7155128155518965,
|
||||||
|
"rrf_k2_w1-3": 0.7141929350188453,
|
||||||
|
"rrf_k5_w1-1": 0.7131118419781046,
|
||||||
|
"rrf_k2_w2-4": 0.7118522356800095,
|
||||||
|
"rrf_k1_w1-1": 0.7107889739277774,
|
||||||
|
"rrf_k5_w2-1": 0.7098850336199061,
|
||||||
|
"rrf_k20_w1-1": 0.7093839764534631,
|
||||||
|
"rrf_k61_w1-1": 0.7078385283710144,
|
||||||
|
"rrf_k1_w1-2": 0.707013559299767,
|
||||||
|
"rrf_k1_w2-4": 0.707013559299767,
|
||||||
|
"rrf_k61_w2-1": 0.7046990423377331,
|
||||||
|
"rrf_k5_w1-2": 0.7044926868045217,
|
||||||
|
"rrf_k20_w2-1": 0.704452526207173,
|
||||||
|
"rrf_k5_w2-4": 0.7031900054869534,
|
||||||
|
"rrf_k5_w3-1": 0.703077687165435,
|
||||||
|
"rrf_k5_w1-3": 0.7030225421102901,
|
||||||
|
"rrf_k20_w1-2": 0.7024265371147049,
|
||||||
|
"rrf_k2_w2-1": 0.7022850545953327,
|
||||||
|
"rrf_k20_w2-4": 0.7021756797211153,
|
||||||
|
"rrf_k61_w1-2": 0.7021756797211153,
|
||||||
|
"rrf_k20_w1-3": 0.7013631554524637,
|
||||||
|
"rrf_k1_w1-3": 0.7006387201236097,
|
||||||
|
"rrf_k61_w2-4": 0.7002585436098269,
|
||||||
|
"rrf_k61_w1-3": 0.6992474190603318,
|
||||||
|
"rrf_k61_w3-1": 0.697837059321573,
|
||||||
|
"rrf_k20_w3-1": 0.6978242772646791,
|
||||||
|
"rrf_k2_w3-1": 0.6958123293356949,
|
||||||
|
"rrf_k1_w2-1": 0.6803018072010231,
|
||||||
|
"rrf_k1_w3-1": 0.6646711259156606
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.6450920689818782
|
||||||
|
},
|
||||||
|
"ef512_depth50": {
|
||||||
|
"depth": 50,
|
||||||
|
"hnsw_ef": 512,
|
||||||
|
"union_recall": 0.9503333333333334,
|
||||||
|
"ideal_ndcg_10": 0.9511195792180346,
|
||||||
|
"dense_recall": 0.8853333333333334,
|
||||||
|
"sparse_recall": 0.8918888888888888,
|
||||||
|
"default_ndcg_10": 0.7168891288761211,
|
||||||
|
"best_arm": "dbsf",
|
||||||
|
"best_ndcg_10": 0.7270333475290183,
|
||||||
|
"ordering": [
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"dbsf": 0.7270333475290183,
|
||||||
|
"rrf_k2_w1-1": 0.7168891288761211,
|
||||||
|
"rrf_k2_w1-2": 0.7145759903112014,
|
||||||
|
"rrf_k2_w2-4": 0.7143857747955454,
|
||||||
|
"rrf_k5_w2-1": 0.7131031179018119,
|
||||||
|
"rrf_k20_w1-1": 0.7129886096677298,
|
||||||
|
"rrf_k5_w1-1": 0.7129788312554507,
|
||||||
|
"rrf_k1_w1-1": 0.7116807384696913,
|
||||||
|
"rrf_k2_w1-3": 0.710128341304386,
|
||||||
|
"rrf_k5_w3-1": 0.7096592719939475,
|
||||||
|
"rrf_k61_w1-1": 0.7077673707197607,
|
||||||
|
"rrf_k20_w2-1": 0.7070958280662616,
|
||||||
|
"rrf_k5_w1-2": 0.7058238117479376,
|
||||||
|
"rrf_k20_w3-1": 0.7049691204147904,
|
||||||
|
"rrf_k5_w2-4": 0.7047348436009861,
|
||||||
|
"rrf_k1_w2-4": 0.7041576221848665,
|
||||||
|
"rrf_k1_w1-2": 0.7041576221848665,
|
||||||
|
"rrf_k5_w1-3": 0.7040998126507464,
|
||||||
|
"rrf_k61_w2-1": 0.7035828272474297,
|
||||||
|
"rrf_k2_w2-1": 0.7030903580777434,
|
||||||
|
"rrf_k61_w3-1": 0.7029903114392931,
|
||||||
|
"rrf_k20_w1-2": 0.7020753889107378,
|
||||||
|
"rrf_k1_w1-3": 0.7014010231101435,
|
||||||
|
"rrf_k20_w2-4": 0.7001893813470387,
|
||||||
|
"rrf_k61_w1-2": 0.6997743792358032,
|
||||||
|
"rrf_k20_w1-3": 0.6997474373949425,
|
||||||
|
"rrf_k61_w2-4": 0.698196924474001,
|
||||||
|
"rrf_k61_w1-3": 0.6971043386529252,
|
||||||
|
"rrf_k2_w3-1": 0.6949529827311328,
|
||||||
|
"rrf_k1_w2-1": 0.677976643304058,
|
||||||
|
"rrf_k1_w3-1": 0.6641149282290312
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 0.8232758620689656
|
||||||
|
},
|
||||||
|
"ef512_depth200": {
|
||||||
|
"depth": 200,
|
||||||
|
"hnsw_ef": 512,
|
||||||
|
"union_recall": 0.9816666666666667,
|
||||||
|
"ideal_ndcg_10": 0.982043823975885,
|
||||||
|
"dense_recall": 0.955,
|
||||||
|
"sparse_recall": 0.94,
|
||||||
|
"default_ndcg_10": 0.717491736277043,
|
||||||
|
"best_arm": "dbsf",
|
||||||
|
"best_ndcg_10": 0.7323037871882409,
|
||||||
|
"ordering": [
|
||||||
|
"dbsf",
|
||||||
|
"rrf_k2_w1-1",
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k2_w2-4",
|
||||||
|
"rrf_k2_w1-2",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k1_w1-1",
|
||||||
|
"rrf_k2_w1-3",
|
||||||
|
"rrf_k61_w3-1",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k1_w2-4",
|
||||||
|
"rrf_k1_w1-2",
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k1_w1-3",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1"
|
||||||
|
],
|
||||||
|
"arm_ndcg_10": {
|
||||||
|
"dbsf": 0.7323037871882409,
|
||||||
|
"rrf_k2_w1-1": 0.717491736277043,
|
||||||
|
"rrf_k5_w1-1": 0.7153997615192654,
|
||||||
|
"rrf_k2_w2-4": 0.7150768502208781,
|
||||||
|
"rrf_k2_w1-2": 0.7150124228231062,
|
||||||
|
"rrf_k5_w2-1": 0.7142404865507347,
|
||||||
|
"rrf_k20_w2-1": 0.7137274222008411,
|
||||||
|
"rrf_k5_w3-1": 0.712514365393912,
|
||||||
|
"rrf_k20_w3-1": 0.712280918873719,
|
||||||
|
"rrf_k20_w1-1": 0.712245686318288,
|
||||||
|
"rrf_k1_w1-1": 0.7116966674396331,
|
||||||
|
"rrf_k2_w1-3": 0.7105054986136041,
|
||||||
|
"rrf_k61_w3-1": 0.7088186689340121,
|
||||||
|
"rrf_k61_w2-1": 0.7075995703743996,
|
||||||
|
"rrf_k5_w2-4": 0.7072125586828444,
|
||||||
|
"rrf_k61_w1-1": 0.7067253098753955,
|
||||||
|
"rrf_k5_w1-2": 0.7062325670137304,
|
||||||
|
"rrf_k5_w1-3": 0.7049256031971145,
|
||||||
|
"rrf_k1_w2-4": 0.7045940546967714,
|
||||||
|
"rrf_k1_w1-2": 0.7045940546967714,
|
||||||
|
"rrf_k2_w2-1": 0.7033628305613119,
|
||||||
|
"rrf_k20_w1-2": 0.7032797784391043,
|
||||||
|
"rrf_k1_w1-3": 0.7015955812699949,
|
||||||
|
"rrf_k20_w1-3": 0.7006544754820371,
|
||||||
|
"rrf_k20_w2-4": 0.6982494271830642,
|
||||||
|
"rrf_k2_w3-1": 0.6977839705926246,
|
||||||
|
"rrf_k61_w1-2": 0.6953235940524766,
|
||||||
|
"rrf_k61_w2-4": 0.6933659535058827,
|
||||||
|
"rrf_k61_w1-3": 0.6921649012827853,
|
||||||
|
"rrf_k1_w2-1": 0.6769662017394467,
|
||||||
|
"rrf_k1_w3-1": 0.6649022480113157
|
||||||
|
},
|
||||||
|
"kendall_tau_vs_baseline": 1.0
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,425 @@
|
|||||||
|
"""Generate the companion notebook. Destination: qdrant/examples/fusion-methods/."""
|
||||||
|
|
||||||
|
import json
|
||||||
|
import pathlib
|
||||||
|
|
||||||
|
OUT = pathlib.Path(__file__).parent / "notebook" / "Tuning_Hybrid_Fusion.ipynb"
|
||||||
|
|
||||||
|
|
||||||
|
def _lines(text):
|
||||||
|
"""nbformat wants each source line to keep its newline, except the last."""
|
||||||
|
parts = text.split("\n")
|
||||||
|
return [line + "\n" for line in parts[:-1]] + parts[-1:]
|
||||||
|
|
||||||
|
|
||||||
|
def md(text):
|
||||||
|
return {"cell_type": "markdown", "metadata": {}, "source": _lines(text.strip())}
|
||||||
|
|
||||||
|
|
||||||
|
def code(text):
|
||||||
|
return {
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": None,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": _lines(text.strip("\n")),
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
CELLS = [
|
||||||
|
md("""
|
||||||
|
# Tuning Hybrid Fusion: Is Your Gain Real?
|
||||||
|
|
||||||
|
| | |
|
||||||
|
|---|---|
|
||||||
|
| **Time** | 40 min |
|
||||||
|
| **Level** | Intermediate |
|
||||||
|
| **Requires** | Qdrant 1.17.x or later |
|
||||||
|
|
||||||
|
Sweeping the fusion grid always produces a winner. This notebook decides whether that winner is
|
||||||
|
worth deploying, by measuring how large a gain has to be on your own labeled set before it means
|
||||||
|
anything.
|
||||||
|
|
||||||
|
It runs end to end on BEIR/SciFact. Swap in your own data at the cell marked **Your Data**.
|
||||||
|
The companion article is [How to Tune Hybrid Search in Qdrant](https://qdrant.tech/articles/how-to-tune-hybrid-search/).
|
||||||
|
"""),
|
||||||
|
md("## Setup"),
|
||||||
|
code("""
|
||||||
|
!pip install -q "qdrant-client>=1.17.0" datasets pandas numpy fastembed
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
<aside role="status">This notebook uses <a href="https://qdrant.tech/documentation/inference/#qdrant-cloud-inference">Qdrant Cloud Inference</a>
|
||||||
|
to embed documents server-side, so no model runs in the notebook. The free tier covers this corpus.
|
||||||
|
To run against a self-hosted cluster instead, drop <code>cloud_inference=True</code> and produce the
|
||||||
|
vectors with FastEmbed locally.</aside>
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
import numpy as np
|
||||||
|
import pandas as pd
|
||||||
|
from datasets import load_dataset
|
||||||
|
from google.colab import userdata
|
||||||
|
from qdrant_client import QdrantClient, models
|
||||||
|
|
||||||
|
# Set QDRANT_URL and QDRANT_API_KEY as Colab secrets (left sidebar, key icon).
|
||||||
|
# Values come from https://cloud.qdrant.io
|
||||||
|
client = QdrantClient(
|
||||||
|
url=userdata.get("QDRANT_URL"),
|
||||||
|
api_key=userdata.get("QDRANT_API_KEY"),
|
||||||
|
cloud_inference=True,
|
||||||
|
)
|
||||||
|
|
||||||
|
COLLECTION = "fusion_tuning"
|
||||||
|
DENSE_MODEL = "sentence-transformers/all-minilm-l6-v2"
|
||||||
|
DENSE_DIM = 384
|
||||||
|
BM25_MODEL = "qdrant/bm25"
|
||||||
|
DEPTH = 200 # candidates per leg; the article measures why this matters more than k
|
||||||
|
SEED = 42
|
||||||
|
|
||||||
|
rng = np.random.default_rng(SEED)
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Your Data
|
||||||
|
|
||||||
|
Everything downstream reads three objects: `documents` (a list of strings), `queries`
|
||||||
|
(query id to text), and `qrels` (query id to a dict of document index to relevance).
|
||||||
|
The next cell fills them from SciFact. **This is the cell to replace with your own data.**
|
||||||
|
|
||||||
|
Around 50 labeled queries is the floor for the interval at the end to say anything.
|
||||||
|
[Retrieval relevance](https://qdrant.tech/documentation/improve-search/retrieval-relevance/)
|
||||||
|
covers building a labeled set, including the warning that synthetic queries inflate scores.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
corpus_ds = load_dataset("BeIR/scifact", "corpus", split="corpus")
|
||||||
|
queries_ds = load_dataset("BeIR/scifact", "queries", split="queries")
|
||||||
|
qrels_ds = load_dataset("BeIR/scifact-qrels", split="test")
|
||||||
|
|
||||||
|
documents = [f"{d.get('title', '')} {d.get('text', '')}".strip() for d in corpus_ds]
|
||||||
|
row_of_doc = {d["_id"]: i for i, d in enumerate(corpus_ds)}
|
||||||
|
|
||||||
|
qrels = {}
|
||||||
|
for row in qrels_ds:
|
||||||
|
if row["score"] > 0:
|
||||||
|
qrels.setdefault(str(row["query-id"]), {})[row_of_doc[str(row["corpus-id"])]] = int(row["score"])
|
||||||
|
|
||||||
|
queries = {str(q["_id"]): q["text"] for q in queries_ds if str(q["_id"]) in qrels}
|
||||||
|
print(f"{len(documents):,} documents, {len(queries):,} labeled queries")
|
||||||
|
print(f"{np.mean([len(v) for v in qrels.values()]):.1f} relevant documents per query")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Split the Queries
|
||||||
|
|
||||||
|
The grid is swept on one half and the winner is checked on the other. Selecting and reporting on
|
||||||
|
the same queries is how a sweep manufactures a gain that does not repeat.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
query_ids = sorted(queries)
|
||||||
|
shuffled = rng.permutation(len(query_ids))
|
||||||
|
half = len(query_ids) // 2
|
||||||
|
tune_ids = [query_ids[i] for i in sorted(shuffled[:half])]
|
||||||
|
test_ids = [query_ids[i] for i in sorted(shuffled[half:])]
|
||||||
|
print(f"{len(tune_ids)} queries to sweep on, {len(test_ids)} held back")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Measure `avg_len` for BM25
|
||||||
|
|
||||||
|
BM25 divides document length by `avg_len`, which defaults to 256. The length it compares against is
|
||||||
|
the token count *after* stopword removal and stemming, so counting words overstates it. On SciFact
|
||||||
|
the word count is 225 and the number BM25 actually uses is 151.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
from fastembed.common.utils import remove_non_alphanumeric
|
||||||
|
from fastembed.sparse.bm25 import Bm25
|
||||||
|
|
||||||
|
_bm25 = Bm25(BM25_MODEL)
|
||||||
|
lengths = [len(_bm25._stem(_bm25.tokenizer.tokenize(remove_non_alphanumeric(t)))) for t in documents]
|
||||||
|
AVG_LEN = round(float(np.mean(lengths)), 1)
|
||||||
|
print(f"avg_len = {AVG_LEN} (mean word count would be "
|
||||||
|
f"{np.mean([len(t.split()) for t in documents]):.1f})")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Index Both Legs
|
||||||
|
|
||||||
|
One point per document, carrying a dense vector and a BM25 sparse vector. `Modifier.IDF` tells
|
||||||
|
Qdrant to apply inverse document frequency server-side, which is what makes the sparse vectors
|
||||||
|
behave like BM25 rather than raw term counts.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
if client.collection_exists(COLLECTION):
|
||||||
|
client.delete_collection(COLLECTION)
|
||||||
|
|
||||||
|
client.create_collection(
|
||||||
|
collection_name=COLLECTION,
|
||||||
|
vectors_config={"dense": models.VectorParams(size=DENSE_DIM, distance=models.Distance.COSINE)},
|
||||||
|
sparse_vectors_config={"bm25": models.SparseVectorParams(modifier=models.Modifier.IDF)},
|
||||||
|
)
|
||||||
|
|
||||||
|
client.upload_points(
|
||||||
|
collection_name=COLLECTION,
|
||||||
|
points=[
|
||||||
|
models.PointStruct(
|
||||||
|
id=i,
|
||||||
|
vector={
|
||||||
|
"dense": models.Document(text=text, model=DENSE_MODEL),
|
||||||
|
"bm25": models.Document(text=text, model=BM25_MODEL, options={"avg_len": AVG_LEN}),
|
||||||
|
},
|
||||||
|
)
|
||||||
|
for i, text in enumerate(documents)
|
||||||
|
],
|
||||||
|
batch_size=256,
|
||||||
|
)
|
||||||
|
print(f"indexed {len(documents):,} points")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Fetch the Candidates Once
|
||||||
|
|
||||||
|
Every fusion setting below reorders the same two candidate lists, so they are fetched once and
|
||||||
|
replayed offline. That turns a grid sweep from hundreds of round trips into arithmetic.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
def candidates(query_id):
|
||||||
|
dense, sparse = client.query_batch_points(
|
||||||
|
collection_name=COLLECTION,
|
||||||
|
requests=[
|
||||||
|
models.QueryRequest(
|
||||||
|
query=models.Document(text=queries[query_id], model=DENSE_MODEL),
|
||||||
|
using="dense", limit=DEPTH, with_payload=False,
|
||||||
|
),
|
||||||
|
models.QueryRequest(
|
||||||
|
query=models.Document(text=queries[query_id], model=BM25_MODEL,
|
||||||
|
options={"avg_len": AVG_LEN}),
|
||||||
|
using="bm25", limit=DEPTH, with_payload=False,
|
||||||
|
),
|
||||||
|
],
|
||||||
|
)
|
||||||
|
return {
|
||||||
|
leg: (
|
||||||
|
np.array([p.id for p in response.points], dtype=np.int64),
|
||||||
|
np.array([p.score for p in response.points], dtype=np.float32),
|
||||||
|
)
|
||||||
|
for leg, response in (("dense", dense), ("sparse", sparse))
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
legs = {qid: candidates(qid) for qid in query_ids}
|
||||||
|
print(f"cached candidates for {len(legs)} queries")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Replay the Fusion Offline
|
||||||
|
|
||||||
|
Qdrant computes RRF as `1 / ((pos + 1) / weight + k - 1)` per leg, summed across legs, in float32.
|
||||||
|
DBSF normalizes each leg against its mean plus or minus three sample standard deviations, then sums.
|
||||||
|
Both are reproduced here so a whole grid can be scored without re-querying. The float32 casts match
|
||||||
|
the engine; float64 diverges on every query.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
F32 = np.float32
|
||||||
|
|
||||||
|
|
||||||
|
def rrf(legs_for_query, k=2, weights=(1.0, 1.0)):
|
||||||
|
ids, scores = _union(legs_for_query)
|
||||||
|
for (leg_ids, _), weight, slot in zip(legs_for_query.values(), weights, _slots(legs_for_query, ids)):
|
||||||
|
positions = np.arange(1, len(leg_ids) + 1, dtype=F32)
|
||||||
|
scores[slot] += F32(1.0) / (positions / F32(weight) + F32(k) - F32(1.0))
|
||||||
|
return _rank(ids, scores)
|
||||||
|
|
||||||
|
|
||||||
|
def dbsf(legs_for_query):
|
||||||
|
ids, scores = _union(legs_for_query)
|
||||||
|
for (_, raw), slot in zip(legs_for_query.values(), _slots(legs_for_query, ids)):
|
||||||
|
scores[slot] += _distr_norm(raw)
|
||||||
|
return _rank(ids, scores)
|
||||||
|
|
||||||
|
|
||||||
|
def _distr_norm(raw):
|
||||||
|
if len(raw) < 2:
|
||||||
|
return np.full(len(raw), F32(0.5), dtype=F32)
|
||||||
|
mean, aggregate = F32(0.0), F32(0.0)
|
||||||
|
for n, value in enumerate(raw, start=1): # Welford, in float32, as the engine does
|
||||||
|
delta = F32(value) - mean
|
||||||
|
mean = mean + delta / F32(n)
|
||||||
|
aggregate = aggregate + delta * (F32(value) - mean)
|
||||||
|
spread = F32(3.0) * np.sqrt(aggregate / (F32(len(raw)) - F32(1.0)), dtype=F32)
|
||||||
|
low, high = mean - spread, mean + spread
|
||||||
|
if low == high: # a leg with no spread contributes nothing
|
||||||
|
return np.full(len(raw), F32(0.5), dtype=F32)
|
||||||
|
return (raw - low) / (high - low)
|
||||||
|
|
||||||
|
|
||||||
|
def _union(legs_for_query):
|
||||||
|
ids = np.unique(np.concatenate([leg_ids for leg_ids, _ in legs_for_query.values()]))
|
||||||
|
return ids, np.zeros(len(ids), dtype=F32)
|
||||||
|
|
||||||
|
|
||||||
|
def _slots(legs_for_query, ids):
|
||||||
|
return [np.searchsorted(ids, leg_ids) for leg_ids, _ in legs_for_query.values()]
|
||||||
|
|
||||||
|
|
||||||
|
def _rank(ids, scores):
|
||||||
|
# Fusion sorts on score alone and leaves ties in arbitrary order. Breaking them
|
||||||
|
# by id keeps two identical queries from returning two different orders.
|
||||||
|
return ids[np.lexsort((ids, -scores))]
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Move 1: Can Fusion Help At All?
|
||||||
|
|
||||||
|
Fusion reorders the candidates the legs returned, so the best it could possibly do is order that
|
||||||
|
union perfectly. If that ceiling is already below your target, the fix is a larger prefetch `limit`
|
||||||
|
or a better retriever, and no value of `k` will reach it.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
def dcg(gains):
|
||||||
|
return sum(gain / np.log2(i + 2) for i, gain in enumerate(gains[:10]))
|
||||||
|
|
||||||
|
|
||||||
|
def ndcg_from_gains(gains, query_id):
|
||||||
|
ideal = sorted(qrels[query_id].values(), reverse=True)
|
||||||
|
return dcg(gains) / dcg(ideal) if any(ideal) else 0.0
|
||||||
|
|
||||||
|
|
||||||
|
def ndcg_at_10(ranked, query_id):
|
||||||
|
return ndcg_from_gains([qrels[query_id].get(int(doc), 0) for doc in ranked[:10]], query_id)
|
||||||
|
|
||||||
|
|
||||||
|
def ceiling(query_id):
|
||||||
|
# The best nDCG@10 any ordering of these candidates could reach.
|
||||||
|
union = np.unique(np.concatenate([ids for ids, _ in legs[query_id].values()]))
|
||||||
|
return ndcg_from_gains(
|
||||||
|
sorted((qrels[query_id].get(int(doc), 0) for doc in union), reverse=True), query_id
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
achieved = np.mean([ndcg_at_10(rrf(legs[q]), q) for q in test_ids])
|
||||||
|
best_possible = np.mean([ceiling(q) for q in test_ids])
|
||||||
|
print(f"default fusion nDCG@10 : {achieved:.4f}")
|
||||||
|
print(f"candidate ceiling : {best_possible:.4f}")
|
||||||
|
print(f"headroom fusion can use: {best_possible - achieved:.4f}")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Move 2: Does Each Leg Earn Its Place?
|
||||||
|
|
||||||
|
Split the default arm's top 10 by which leg found each result. A leg whose unique documents never
|
||||||
|
survive into the top 10 is paying latency for nothing; a leg that contributes relevant documents no
|
||||||
|
other leg found is worth keeping even when it scores poorly alone.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
rows = []
|
||||||
|
for query_id in test_ids:
|
||||||
|
dense_ids = set(legs[query_id]["dense"][0].tolist())
|
||||||
|
sparse_ids = set(legs[query_id]["sparse"][0].tolist())
|
||||||
|
for doc in rrf(legs[query_id])[:10]:
|
||||||
|
doc = int(doc)
|
||||||
|
rows.append({
|
||||||
|
"source": "both" if doc in dense_ids and doc in sparse_ids
|
||||||
|
else ("dense only" if doc in dense_ids else "sparse only"),
|
||||||
|
"relevant": qrels[query_id].get(doc, 0) > 0,
|
||||||
|
})
|
||||||
|
|
||||||
|
top10 = pd.DataFrame(rows)
|
||||||
|
print(top10.groupby("source").agg(share=("relevant", "size"), relevant=("relevant", "mean")))
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Move 3: Which Way to Move `k`
|
||||||
|
|
||||||
|
Low `k` rewards a document that one leg ranked first. High `k` rewards documents both legs found.
|
||||||
|
Corpora with about one relevant document per query tend to want low `k`; corpora with many relevant
|
||||||
|
documents tend to want high `k`. Sweep on the tuning half only.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
GRID = {"dbsf": None}
|
||||||
|
for k in (1, 2, 5, 20, 61):
|
||||||
|
for a, b in ((1, 1), (1, 2), (1, 3), (2, 1), (3, 1), (2, 4)):
|
||||||
|
GRID[f"k={k} w=({a},{b})"] = (k, (float(a), float(b)))
|
||||||
|
DEFAULT = "k=2 w=(1,1)"
|
||||||
|
|
||||||
|
|
||||||
|
def run_arm(name, ids):
|
||||||
|
setting = GRID[name]
|
||||||
|
fuse = (lambda q: dbsf(legs[q])) if setting is None else (lambda q: rrf(legs[q], *setting))
|
||||||
|
return np.array([ndcg_at_10(fuse(q), q) for q in ids])
|
||||||
|
|
||||||
|
|
||||||
|
tuning = {name: run_arm(name, tune_ids) for name in GRID}
|
||||||
|
summary = pd.Series({name: values.mean() for name, values in tuning.items()}).sort_values(ascending=False)
|
||||||
|
print(summary.head(8).round(4).to_string())
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## Move 4: When to Stop
|
||||||
|
|
||||||
|
Resampling the queries with replacement gives a 95% interval on the mean per-query gain over the
|
||||||
|
default. A setting whose interval includes zero did not beat the default; it beat this particular
|
||||||
|
sample of queries.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
def interval(gains, resamples=1000):
|
||||||
|
gains = np.asarray(gains, dtype=float)
|
||||||
|
draws = np.random.default_rng(SEED).integers(0, len(gains), size=(resamples, len(gains)))
|
||||||
|
low, high = np.percentile(gains[draws].mean(axis=1), [2.5, 97.5])
|
||||||
|
return gains.mean(), low, high
|
||||||
|
|
||||||
|
|
||||||
|
baseline = tuning[DEFAULT]
|
||||||
|
report = pd.DataFrame(
|
||||||
|
[(name, *interval(values - baseline)) for name, values in tuning.items() if name != DEFAULT],
|
||||||
|
columns=["arm", "gain", "low", "high"],
|
||||||
|
).sort_values("gain", ascending=False)
|
||||||
|
report["clears"] = report["low"] > 0
|
||||||
|
print(report.head(10).round(4).to_string(index=False))
|
||||||
|
print(f"\\nmedian interval width: {(report['high'] - report['low']).median():.4f}")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## The Decision
|
||||||
|
|
||||||
|
A rule, not a table. Take the mildest setting that clears its interval, then confirm it on the half
|
||||||
|
you held back. A gain that does not repeat on unseen queries was a property of the tuning sample.
|
||||||
|
"""),
|
||||||
|
code("""
|
||||||
|
def extremity(name):
|
||||||
|
# Distance from the default, so the mildest clearing setting wins.
|
||||||
|
if GRID[name] is None:
|
||||||
|
return float("inf") # a different method, not a milder setting
|
||||||
|
k, (a, b) = GRID[name]
|
||||||
|
return abs(np.log2(k / 2)) + abs(np.log2(a / b))
|
||||||
|
|
||||||
|
|
||||||
|
clearing = report[report["clears"]]["arm"].tolist()
|
||||||
|
if best_possible - achieved > 0.20 and not clearing:
|
||||||
|
print("Candidate ceiling is far above what fusion reaches and nothing clears: raise the "
|
||||||
|
"prefetch limit or improve a leg before tuning fusion.")
|
||||||
|
elif not clearing:
|
||||||
|
print(f"Nothing clears the interval. Keep the default ({DEFAULT}). This is a real answer.")
|
||||||
|
else:
|
||||||
|
choice = min(clearing, key=extremity)
|
||||||
|
held_out = run_arm(choice, test_ids) - run_arm(DEFAULT, test_ids)
|
||||||
|
gain, low, high = interval(held_out)
|
||||||
|
print(f"Candidate setting : {choice}")
|
||||||
|
print(f"On held-out queries: {gain:+.4f} interval [{low:+.4f}, {high:+.4f}]")
|
||||||
|
print("Deploy it." if low > 0 else "It did not repeat on held-out queries. Keep the default.")
|
||||||
|
"""),
|
||||||
|
md("""
|
||||||
|
## What This Leaves You With
|
||||||
|
|
||||||
|
A setting you can defend, or the default and a reason. Both are results. Two things to re-run
|
||||||
|
rather than assume: the interval widens as your labeled set shrinks, and the winning setting can
|
||||||
|
change when you change the prefetch `limit`, because fusion only ever reorders what the legs
|
||||||
|
returned.
|
||||||
|
|
||||||
|
The measurements behind the defaults here, across five corpora, are in
|
||||||
|
[How to Tune Hybrid Search in Qdrant](https://qdrant.tech/articles/how-to-tune-hybrid-search/).
|
||||||
|
"""),
|
||||||
|
]
|
||||||
|
|
||||||
|
NOTEBOOK = {
|
||||||
|
"cells": CELLS,
|
||||||
|
"metadata": {
|
||||||
|
"colab": {"provenance": []},
|
||||||
|
"kernelspec": {"display_name": "Python 3", "name": "python3"},
|
||||||
|
"language_info": {"name": "python"},
|
||||||
|
},
|
||||||
|
"nbformat": 4,
|
||||||
|
"nbformat_minor": 0,
|
||||||
|
}
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
OUT.parent.mkdir(parents=True, exist_ok=True)
|
||||||
|
OUT.write_text(json.dumps(NOTEBOOK, indent=1))
|
||||||
|
print(f"wrote {OUT} ({len(CELLS)} cells)")
|
||||||
@@ -0,0 +1,420 @@
|
|||||||
|
{
|
||||||
|
"tie_rate_build1": {
|
||||||
|
"rrf_k1_w1-1": 0.07658815132048538,
|
||||||
|
"rrf_k1_w1-2": 0.04525339043540329,
|
||||||
|
"rrf_k1_w1-3": 0.024125624553890078,
|
||||||
|
"rrf_k1_w2-1": 0.04089935760171306,
|
||||||
|
"rrf_k1_w3-1": 0.020342612419700215,
|
||||||
|
"rrf_k1_w2-4": 0.04525339043540329,
|
||||||
|
"rrf_k2_w1-1": 0.07801570306923626,
|
||||||
|
"rrf_k2_w1-2": 0.05039257673090649,
|
||||||
|
"rrf_k2_w1-3": 0.02498215560314062,
|
||||||
|
"rrf_k2_w2-1": 0.05017844396859386,
|
||||||
|
"rrf_k2_w3-1": 0.02198429693076374,
|
||||||
|
"rrf_k2_w2-4": 0.041613133476088505,
|
||||||
|
"rrf_k5_w1-1": 0.06987865810135618,
|
||||||
|
"rrf_k5_w1-2": 0.03518915060670949,
|
||||||
|
"rrf_k5_w1-3": 0.020770877944325482,
|
||||||
|
"rrf_k5_w2-1": 0.03090649536045682,
|
||||||
|
"rrf_k5_w3-1": 0.01777301927194861,
|
||||||
|
"rrf_k5_w2-4": 0.026338329764453966,
|
||||||
|
"rrf_k20_w1-1": 0.047037830121341904,
|
||||||
|
"rrf_k20_w1-2": 0.014204139900071376,
|
||||||
|
"rrf_k20_w1-3": 0.0053533190578158455,
|
||||||
|
"rrf_k20_w2-1": 0.011848679514632407,
|
||||||
|
"rrf_k20_w3-1": 0.00478229835831549,
|
||||||
|
"rrf_k20_w2-4": 0.01034975017844397,
|
||||||
|
"rrf_k61_w1-1": 0.03618843683083512,
|
||||||
|
"rrf_k61_w1-2": 0.009921484653818702,
|
||||||
|
"rrf_k61_w1-3": 0.0039257673090649535,
|
||||||
|
"rrf_k61_w2-1": 0.009064953604568167,
|
||||||
|
"rrf_k61_w3-1": 0.003997144896502498,
|
||||||
|
"rrf_k61_w2-4": 0.009850107066381156,
|
||||||
|
"dbsf": 0.03254817987152034,
|
||||||
|
"dense_only": 0.032762312633832974,
|
||||||
|
"sparse_only": 0.03683083511777302,
|
||||||
|
"unreachable_minmax_w1-1": 0.03418986438258387,
|
||||||
|
"unreachable_minmax_w1-2": 0.03154889364739472,
|
||||||
|
"unreachable_minmax_w1-3": 0.030478229835831552,
|
||||||
|
"unreachable_minmax_w2-1": 0.03226266952177017,
|
||||||
|
"unreachable_minmax_w3-1": 0.03162027123483226,
|
||||||
|
"unreachable_minmax_w2-4": 0.03154889364739472,
|
||||||
|
"unreachable_distr_w1-1": 0.03254817987152034,
|
||||||
|
"unreachable_distr_w1-2": 0.03126338329764454,
|
||||||
|
"unreachable_distr_w1-3": 0.031049250535331904,
|
||||||
|
"unreachable_distr_w2-1": 0.03240542469664526,
|
||||||
|
"unreachable_distr_w3-1": 0.03126338329764454,
|
||||||
|
"unreachable_distr_w2-4": 0.03126338329764454
|
||||||
|
},
|
||||||
|
"bootstrap_vs_default": {
|
||||||
|
"dbsf": {
|
||||||
|
"mean": -0.004477639564784207,
|
||||||
|
"low": -0.01373890994415563,
|
||||||
|
"high": 0.004933195988142008,
|
||||||
|
"half_width": 0.009336052966148818,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"dense_only": {
|
||||||
|
"mean": -0.03114010061198946,
|
||||||
|
"low": -0.04350010251379562,
|
||||||
|
"high": -0.018863261065648933,
|
||||||
|
"half_width": 0.012318420724073345,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-1": {
|
||||||
|
"mean": -0.004549312740206345,
|
||||||
|
"low": -0.007939157277795166,
|
||||||
|
"high": -0.001221940947488077,
|
||||||
|
"half_width": 0.0033586081651535444,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-2": {
|
||||||
|
"mean": -0.041134387541324265,
|
||||||
|
"low": -0.04920293819145784,
|
||||||
|
"high": -0.03288919114727575,
|
||||||
|
"half_width": 0.008156873522091043,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-3": {
|
||||||
|
"mean": -0.05197040127036051,
|
||||||
|
"low": -0.061013478757966255,
|
||||||
|
"high": -0.04255617058113633,
|
||||||
|
"half_width": 0.009228654088414962,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-1": {
|
||||||
|
"mean": -0.007545521112078894,
|
||||||
|
"low": -0.015616468260802659,
|
||||||
|
"high": 0.00019063230061311948,
|
||||||
|
"half_width": 0.00790355028070789,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-4": {
|
||||||
|
"mean": -0.041134387541324265,
|
||||||
|
"low": -0.04920293819145784,
|
||||||
|
"high": -0.03288919114727575,
|
||||||
|
"half_width": 0.008156873522091043,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k1_w3-1": {
|
||||||
|
"mean": -0.011127744708697587,
|
||||||
|
"low": -0.02006774311208496,
|
||||||
|
"high": -0.002274231751172483,
|
||||||
|
"half_width": 0.008896755680456237,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-1": {
|
||||||
|
"mean": 0.005252202395584227,
|
||||||
|
"low": -0.0030940078202507464,
|
||||||
|
"high": 0.014157590698603395,
|
||||||
|
"half_width": 0.00862579925942707,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-2": {
|
||||||
|
"mean": 0.009730192229853342,
|
||||||
|
"low": 0.00035291783705517177,
|
||||||
|
"high": 0.019535915835879956,
|
||||||
|
"half_width": 0.009591498999412392,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-3": {
|
||||||
|
"mean": 0.007706128931238203,
|
||||||
|
"low": -0.001884953196192329,
|
||||||
|
"high": 0.017582849945525007,
|
||||||
|
"half_width": 0.009733901570858667,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-1": {
|
||||||
|
"mean": -0.006452470904860269,
|
||||||
|
"low": -0.016307014460749912,
|
||||||
|
"high": 0.00412282314413927,
|
||||||
|
"half_width": 0.010214918802444592,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-4": {
|
||||||
|
"mean": 0.0068635924293981776,
|
||||||
|
"low": -0.0034848317948100263,
|
||||||
|
"high": 0.016945712614388563,
|
||||||
|
"half_width": 0.010215272204599295,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k20_w3-1": {
|
||||||
|
"mean": -0.015351304368652318,
|
||||||
|
"low": -0.026875469465979324,
|
||||||
|
"high": -0.003738198171122041,
|
||||||
|
"half_width": 0.011568635647428641,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-2": {
|
||||||
|
"mean": -0.01570512260919304,
|
||||||
|
"low": -0.021297774608392155,
|
||||||
|
"high": -0.01021434384910021,
|
||||||
|
"half_width": 0.005541715379645973,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-3": {
|
||||||
|
"mean": -0.0199715251980907,
|
||||||
|
"low": -0.026382729033082714,
|
||||||
|
"high": -0.013298759392765471,
|
||||||
|
"half_width": 0.006541984820158621,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-1": {
|
||||||
|
"mean": 0.0034969443914085753,
|
||||||
|
"low": -0.0012360901024986205,
|
||||||
|
"high": 0.008046304181541552,
|
||||||
|
"half_width": 0.004641197142020086,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-4": {
|
||||||
|
"mean": -0.0007280780268010461,
|
||||||
|
"low": -0.006414083928683647,
|
||||||
|
"high": 0.005762475235556406,
|
||||||
|
"half_width": 0.006088279582120026,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k2_w3-1": {
|
||||||
|
"mean": 0.002013102981318605,
|
||||||
|
"low": -0.004054642572030859,
|
||||||
|
"high": 0.007625914175895798,
|
||||||
|
"half_width": 0.005840278373963328,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-1": {
|
||||||
|
"mean": 0.008727675711350398,
|
||||||
|
"low": 0.003698976378705185,
|
||||||
|
"high": 0.0145279227761344,
|
||||||
|
"half_width": 0.005414473198714608,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-2": {
|
||||||
|
"mean": 0.010012859198230563,
|
||||||
|
"low": 0.0031261678890812375,
|
||||||
|
"high": 0.01743472960773837,
|
||||||
|
"half_width": 0.007154280859328566,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-3": {
|
||||||
|
"mean": 0.00903804742022131,
|
||||||
|
"low": 0.0010082886310971361,
|
||||||
|
"high": 0.01725036286940529,
|
||||||
|
"half_width": 0.008121037119154077,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-1": {
|
||||||
|
"mean": 0.0023201051560455955,
|
||||||
|
"low": -0.004663977757095185,
|
||||||
|
"high": 0.009935837224448817,
|
||||||
|
"half_width": 0.007299907490772001,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-4": {
|
||||||
|
"mean": 0.01160300859302481,
|
||||||
|
"low": 0.003638251554866433,
|
||||||
|
"high": 0.02023867771560154,
|
||||||
|
"half_width": 0.008300213080367554,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k5_w3-1": {
|
||||||
|
"mean": 3.670331826511037e-05,
|
||||||
|
"low": -0.007720194894946932,
|
||||||
|
"high": 0.007380247574369389,
|
||||||
|
"half_width": 0.00755022123465816,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-1": {
|
||||||
|
"mean": -0.0009185658465819535,
|
||||||
|
"low": -0.010248817208809258,
|
||||||
|
"high": 0.009115463999734064,
|
||||||
|
"half_width": 0.009682140604271661,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-2": {
|
||||||
|
"mean": 0.005482549278142366,
|
||||||
|
"low": -0.004988988583321589,
|
||||||
|
"high": 0.015867121394615026,
|
||||||
|
"half_width": 0.010428054988968307,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-3": {
|
||||||
|
"mean": 0.004004794377531072,
|
||||||
|
"low": -0.00638225112374891,
|
||||||
|
"high": 0.014296159943985321,
|
||||||
|
"half_width": 0.010339205533867116,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-1": {
|
||||||
|
"mean": -0.013180486898135483,
|
||||||
|
"low": -0.023631170512038974,
|
||||||
|
"high": -0.0017858549664653029,
|
||||||
|
"half_width": 0.010922657772786835,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-4": {
|
||||||
|
"mean": 0.004508572445385608,
|
||||||
|
"low": -0.006114769174532899,
|
||||||
|
"high": 0.015064479569876381,
|
||||||
|
"half_width": 0.010589624372204641,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"rrf_k61_w3-1": {
|
||||||
|
"mean": -0.023981202116551265,
|
||||||
|
"low": -0.035572083365930374,
|
||||||
|
"high": -0.012179803340527751,
|
||||||
|
"half_width": 0.011696140012701311,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"sparse_only": {
|
||||||
|
"mean": -0.09921384722088293,
|
||||||
|
"low": -0.11225906898533486,
|
||||||
|
"high": -0.08610526136822816,
|
||||||
|
"half_width": 0.01307690380855335,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-1": {
|
||||||
|
"mean": -0.004477639564784207,
|
||||||
|
"low": -0.01373890994415563,
|
||||||
|
"high": 0.004933195988142008,
|
||||||
|
"half_width": 0.009336052966148818,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-2": {
|
||||||
|
"mean": -0.032767444573246346,
|
||||||
|
"low": -0.04305435529834205,
|
||||||
|
"high": -0.022241310002528245,
|
||||||
|
"half_width": 0.010406522647906901,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-3": {
|
||||||
|
"mean": -0.04865650894966063,
|
||||||
|
"low": -0.059175822694236525,
|
||||||
|
"high": -0.037270499194518955,
|
||||||
|
"half_width": 0.010952661749858785,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-1": {
|
||||||
|
"mean": 0.015344829745522967,
|
||||||
|
"low": 0.007044916519805886,
|
||||||
|
"high": 0.02485799007057041,
|
||||||
|
"half_width": 0.008906536775382261,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-4": {
|
||||||
|
"mean": -0.032767444573246346,
|
||||||
|
"low": -0.04305435529834205,
|
||||||
|
"high": -0.022241310002528245,
|
||||||
|
"half_width": 0.010406522647906901,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_distr_w3-1": {
|
||||||
|
"mean": 0.01207377452288898,
|
||||||
|
"low": 0.003380435980078124,
|
||||||
|
"high": 0.020711977088495377,
|
||||||
|
"half_width": 0.008665770554208627,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-1": {
|
||||||
|
"mean": 0.004077661500885598,
|
||||||
|
"low": -0.0047866297632367365,
|
||||||
|
"high": 0.012665542986878265,
|
||||||
|
"half_width": 0.0087260863750575,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-2": {
|
||||||
|
"mean": -0.024530291473419088,
|
||||||
|
"low": -0.03443138403643833,
|
||||||
|
"high": -0.014356472459790442,
|
||||||
|
"half_width": 0.010037455788323942,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-3": {
|
||||||
|
"mean": -0.04268727687372426,
|
||||||
|
"low": -0.05322847711635545,
|
||||||
|
"high": -0.03188737469913657,
|
||||||
|
"half_width": 0.010670551208609439,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-1": {
|
||||||
|
"mean": 0.01378494671040041,
|
||||||
|
"low": 0.005122086385512493,
|
||||||
|
"high": 0.02237692080545851,
|
||||||
|
"half_width": 0.00862741720997301,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-4": {
|
||||||
|
"mean": -0.024530291473419088,
|
||||||
|
"low": -0.03443138403643833,
|
||||||
|
"high": -0.014356472459790442,
|
||||||
|
"half_width": 0.010037455788323942,
|
||||||
|
"n": 1401
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w3-1": {
|
||||||
|
"mean": 0.01049976413685176,
|
||||||
|
"low": 0.0012019802837948,
|
||||||
|
"high": 0.019228825555031664,
|
||||||
|
"half_width": 0.009013422635618433,
|
||||||
|
"n": 1401
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move1_can_fusion_help": {
|
||||||
|
"union_recall": 0.9971448965024983,
|
||||||
|
"ideal_ndcg_10": 0.9971448965024983,
|
||||||
|
"default_ndcg_10": 0.5216250430660505,
|
||||||
|
"headroom": 0.47551985343644776,
|
||||||
|
"dense_recall": 0.9828693790149893,
|
||||||
|
"sparse_recall": 0.961456102783726
|
||||||
|
},
|
||||||
|
"move2_where_results_come_from": {
|
||||||
|
"top10_source_share": {
|
||||||
|
"both": 0.8995003568879372,
|
||||||
|
"dense_only": 0.051177730192719484,
|
||||||
|
"sparse_only": 0.049321912919343326
|
||||||
|
},
|
||||||
|
"top10_relevant_source_share": {
|
||||||
|
"both": 0.978965819456617,
|
||||||
|
"dense_only": 0.015775635407537247,
|
||||||
|
"sparse_only": 0.0052585451358457495
|
||||||
|
},
|
||||||
|
"unique_relevant_per_query": {
|
||||||
|
"dense": 0.03568879371877231,
|
||||||
|
"sparse": 0.014275517487508922
|
||||||
|
},
|
||||||
|
"unique_relevant_surviving_into_top10": {
|
||||||
|
"dense": 0.36,
|
||||||
|
"sparse": 0.3
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move3_which_way_to_move_k": {
|
||||||
|
"k_sweep_equal_weights": {
|
||||||
|
"1": 0.5170757303258442,
|
||||||
|
"2": 0.5216250430660505,
|
||||||
|
"5": 0.5303527187774009,
|
||||||
|
"20": 0.5268772454616347,
|
||||||
|
"61": 0.5207064772194686
|
||||||
|
},
|
||||||
|
"best_k": 5,
|
||||||
|
"span": 0.01327698845155667,
|
||||||
|
"tie_rate_top10": {
|
||||||
|
"k1": 0.07658815132048538,
|
||||||
|
"k2": 0.07801570306923626,
|
||||||
|
"k5": 0.06987865810135618,
|
||||||
|
"k20": 0.047037830121341904,
|
||||||
|
"k61": 0.03618843683083512
|
||||||
|
},
|
||||||
|
"dbsf_minus_default": -0.004477639564784197
|
||||||
|
},
|
||||||
|
"move4_when_to_stop": {
|
||||||
|
"arms_clearing": 5,
|
||||||
|
"clearing_arms": [
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k20_w1-2"
|
||||||
|
],
|
||||||
|
"dbsf_clears": false,
|
||||||
|
"nominal_winner": "rrf_k5_w2-4",
|
||||||
|
"prescription": "rrf_k5_w1-1",
|
||||||
|
"median_interval_width": 0.016926012339794624
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,419 @@
|
|||||||
|
{
|
||||||
|
"tie_rate_build1": {
|
||||||
|
"rrf_k1_w1-1": 0.42129999999999995,
|
||||||
|
"rrf_k1_w1-2": 0.25739999999999996,
|
||||||
|
"rrf_k1_w1-3": 0.1554,
|
||||||
|
"rrf_k1_w2-1": 0.25830000000000003,
|
||||||
|
"rrf_k1_w3-1": 0.15319999999999998,
|
||||||
|
"rrf_k1_w2-4": 0.25739999999999996,
|
||||||
|
"rrf_k2_w1-1": 0.4163,
|
||||||
|
"rrf_k2_w1-2": 0.24860000000000002,
|
||||||
|
"rrf_k2_w1-3": 0.152,
|
||||||
|
"rrf_k2_w2-1": 0.25520000000000004,
|
||||||
|
"rrf_k2_w3-1": 0.1511,
|
||||||
|
"rrf_k2_w2-4": 0.24290000000000003,
|
||||||
|
"rrf_k5_w1-1": 0.39670000000000005,
|
||||||
|
"rrf_k5_w1-2": 0.2308,
|
||||||
|
"rrf_k5_w1-3": 0.141,
|
||||||
|
"rrf_k5_w2-1": 0.2293,
|
||||||
|
"rrf_k5_w3-1": 0.14110000000000003,
|
||||||
|
"rrf_k5_w2-4": 0.1998,
|
||||||
|
"rrf_k20_w1-1": 0.2847,
|
||||||
|
"rrf_k20_w1-2": 0.1343,
|
||||||
|
"rrf_k20_w1-3": 0.069,
|
||||||
|
"rrf_k20_w2-1": 0.1306,
|
||||||
|
"rrf_k20_w3-1": 0.0692,
|
||||||
|
"rrf_k20_w2-4": 0.068,
|
||||||
|
"rrf_k61_w1-1": 0.11109999999999999,
|
||||||
|
"rrf_k61_w1-2": 0.037899999999999996,
|
||||||
|
"rrf_k61_w1-3": 0.017500000000000005,
|
||||||
|
"rrf_k61_w2-1": 0.0378,
|
||||||
|
"rrf_k61_w3-1": 0.0175,
|
||||||
|
"rrf_k61_w2-4": 0.017799999999999996,
|
||||||
|
"dbsf": 0.0001,
|
||||||
|
"dense_only": 0.0006,
|
||||||
|
"sparse_only": 0.0121,
|
||||||
|
"unreachable_minmax_w1-1": 0.032299999999999995,
|
||||||
|
"unreachable_minmax_w1-2": 0.0037,
|
||||||
|
"unreachable_minmax_w1-3": 0.0046,
|
||||||
|
"unreachable_minmax_w2-1": 0.0003,
|
||||||
|
"unreachable_minmax_w3-1": 0.0003,
|
||||||
|
"unreachable_minmax_w2-4": 0.0037,
|
||||||
|
"unreachable_distr_w1-1": 0.0001,
|
||||||
|
"unreachable_distr_w1-2": 0.0021000000000000003,
|
||||||
|
"unreachable_distr_w1-3": 0.003,
|
||||||
|
"unreachable_distr_w2-1": 0.0003,
|
||||||
|
"unreachable_distr_w3-1": 0.0003,
|
||||||
|
"unreachable_distr_w2-4": 0.0021000000000000003
|
||||||
|
},
|
||||||
|
"bootstrap_vs_default": {
|
||||||
|
"dbsf": {
|
||||||
|
"mean": 0.01605561405880898,
|
||||||
|
"low": 0.004291764418856112,
|
||||||
|
"high": 0.027459457153364446,
|
||||||
|
"half_width": 0.011583846367254166,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"dense_only": {
|
||||||
|
"mean": -0.025640659413030766,
|
||||||
|
"low": -0.040107556467039666,
|
||||||
|
"high": -0.010534542453031462,
|
||||||
|
"half_width": 0.014786507007004103,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-1": {
|
||||||
|
"mean": -0.00542972086520554,
|
||||||
|
"low": -0.009365486341511796,
|
||||||
|
"high": -0.0014673208714981825,
|
||||||
|
"half_width": 0.003949082735006807,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-2": {
|
||||||
|
"mean": -0.05306916773218919,
|
||||||
|
"low": -0.06217125795577106,
|
||||||
|
"high": -0.04401656387745263,
|
||||||
|
"half_width": 0.009077347039159214,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-3": {
|
||||||
|
"mean": -0.07495267132764266,
|
||||||
|
"low": -0.08546120328898946,
|
||||||
|
"high": -0.06454542583361611,
|
||||||
|
"half_width": 0.010457888727686673,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-1": {
|
||||||
|
"mean": -0.0028026677281732548,
|
||||||
|
"low": -0.01200583075538532,
|
||||||
|
"high": 0.006856860691557725,
|
||||||
|
"half_width": 0.009431345723471523,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-4": {
|
||||||
|
"mean": -0.05306916773218919,
|
||||||
|
"low": -0.06217125795577106,
|
||||||
|
"high": -0.04401656387745263,
|
||||||
|
"half_width": 0.009077347039159214,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k1_w3-1": {
|
||||||
|
"mean": -0.005078321187041935,
|
||||||
|
"low": -0.015250661695480113,
|
||||||
|
"high": 0.006088714404234221,
|
||||||
|
"half_width": 0.010669688049857167,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-1": {
|
||||||
|
"mean": -0.004447270398657604,
|
||||||
|
"low": -0.014295296418546573,
|
||||||
|
"high": 0.006080978910301416,
|
||||||
|
"half_width": 0.010188137664423995,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-2": {
|
||||||
|
"mean": -0.012686062254268932,
|
||||||
|
"low": -0.02523136568095212,
|
||||||
|
"high": 0.0004052625522385436,
|
||||||
|
"half_width": 0.012818314116595331,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-3": {
|
||||||
|
"mean": -0.01878121752827439,
|
||||||
|
"low": -0.03203756221901269,
|
||||||
|
"high": -0.005416508442605105,
|
||||||
|
"half_width": 0.013310526888203791,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-1": {
|
||||||
|
"mean": -0.009949184846732805,
|
||||||
|
"low": -0.021760873671099346,
|
||||||
|
"high": 0.001996580251355817,
|
||||||
|
"half_width": 0.011878726961227581,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-4": {
|
||||||
|
"mean": -0.02253222351229175,
|
||||||
|
"low": -0.03687296238732293,
|
||||||
|
"high": -0.008018735873935638,
|
||||||
|
"half_width": 0.014427113256693647,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k20_w3-1": {
|
||||||
|
"mean": -0.01588709558639438,
|
||||||
|
"low": -0.029099587487311382,
|
||||||
|
"high": -0.0026085125048216735,
|
||||||
|
"half_width": 0.013245537491244854,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-2": {
|
||||||
|
"mean": -0.024569763934013635,
|
||||||
|
"low": -0.031377941143983124,
|
||||||
|
"high": -0.01809569086831448,
|
||||||
|
"half_width": 0.0066411251378343215,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-3": {
|
||||||
|
"mean": -0.040348892925198714,
|
||||||
|
"low": -0.04886859200439007,
|
||||||
|
"high": -0.03202387009638766,
|
||||||
|
"half_width": 0.008422360954001205,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-1": {
|
||||||
|
"mean": 0.011797899979702596,
|
||||||
|
"low": 0.005698996206289197,
|
||||||
|
"high": 0.018505628182254284,
|
||||||
|
"half_width": 0.006403315987982544,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-4": {
|
||||||
|
"mean": -0.01817447406073294,
|
||||||
|
"low": -0.025253868929841713,
|
||||||
|
"high": -0.011604571025066067,
|
||||||
|
"half_width": 0.006824648952387823,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k2_w3-1": {
|
||||||
|
"mean": 0.011662096902904895,
|
||||||
|
"low": 0.004901090867350699,
|
||||||
|
"high": 0.019261669068484106,
|
||||||
|
"half_width": 0.007180289100566704,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-1": {
|
||||||
|
"mean": 0.0024252122534517183,
|
||||||
|
"low": -0.00290270846737078,
|
||||||
|
"high": 0.007458415073172821,
|
||||||
|
"half_width": 0.0051805617702718005,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-2": {
|
||||||
|
"mean": -0.007165493741176878,
|
||||||
|
"low": -0.014828820467101256,
|
||||||
|
"high": 0.0007035056955051531,
|
||||||
|
"half_width": 0.007766163081303205,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-3": {
|
||||||
|
"mean": -0.016872569775803703,
|
||||||
|
"low": -0.026274338284402867,
|
||||||
|
"high": -0.0071743268018265045,
|
||||||
|
"half_width": 0.00955000574128818,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-1": {
|
||||||
|
"mean": 0.012029593359179493,
|
||||||
|
"low": 0.0044325422759719,
|
||||||
|
"high": 0.019479893352468167,
|
||||||
|
"half_width": 0.007523675538248134,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-4": {
|
||||||
|
"mean": -0.004828086837404117,
|
||||||
|
"low": -0.014868726242385253,
|
||||||
|
"high": 0.0056624562400018445,
|
||||||
|
"half_width": 0.010265591241193549,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k5_w3-1": {
|
||||||
|
"mean": 0.011495654615249198,
|
||||||
|
"low": 0.0030686243882941068,
|
||||||
|
"high": 0.01977806769277024,
|
||||||
|
"half_width": 0.008354721652238066,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-1": {
|
||||||
|
"mean": -0.029754226656058532,
|
||||||
|
"low": -0.044185364771889925,
|
||||||
|
"high": -0.016032577011572492,
|
||||||
|
"half_width": 0.014076393880158716,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-2": {
|
||||||
|
"mean": -0.02994172353386015,
|
||||||
|
"low": -0.044804885662511486,
|
||||||
|
"high": -0.014513601094169104,
|
||||||
|
"half_width": 0.015145642284171191,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-3": {
|
||||||
|
"mean": -0.03388471348742384,
|
||||||
|
"low": -0.04944297132531202,
|
||||||
|
"high": -0.018330250968495686,
|
||||||
|
"half_width": 0.015556360178408168,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-1": {
|
||||||
|
"mean": -0.03703696687204194,
|
||||||
|
"low": -0.052251354188105135,
|
||||||
|
"high": -0.021642782226859083,
|
||||||
|
"half_width": 0.015304285980623026,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-4": {
|
||||||
|
"mean": -0.03643782010239211,
|
||||||
|
"low": -0.052537142753138914,
|
||||||
|
"high": -0.020157246173142896,
|
||||||
|
"half_width": 0.016189948289998007,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"rrf_k61_w3-1": {
|
||||||
|
"mean": -0.04346782042167798,
|
||||||
|
"low": -0.05864925484407678,
|
||||||
|
"high": -0.02859636113018583,
|
||||||
|
"half_width": 0.015026446856945474,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"sparse_only": {
|
||||||
|
"mean": -0.14291203020078969,
|
||||||
|
"low": -0.16051657775645564,
|
||||||
|
"high": -0.12647263526882613,
|
||||||
|
"half_width": 0.017021971243814757,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-1": {
|
||||||
|
"mean": 0.01605561405880898,
|
||||||
|
"low": 0.004291764418856112,
|
||||||
|
"high": 0.027459457153364446,
|
||||||
|
"half_width": 0.011583846367254166,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-2": {
|
||||||
|
"mean": -0.03608845828550322,
|
||||||
|
"low": -0.05049439691209061,
|
||||||
|
"high": -0.02281132414150622,
|
||||||
|
"half_width": 0.013841536385292194,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-3": {
|
||||||
|
"mean": -0.061626609464963435,
|
||||||
|
"low": -0.07664698139912716,
|
||||||
|
"high": -0.04732134749818558,
|
||||||
|
"half_width": 0.014662816950470791,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-1": {
|
||||||
|
"mean": 0.03181355963836828,
|
||||||
|
"low": 0.021144692125362963,
|
||||||
|
"high": 0.04151602950305956,
|
||||||
|
"half_width": 0.0101856686888483,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-4": {
|
||||||
|
"mean": -0.03608845828550322,
|
||||||
|
"low": -0.05049439691209061,
|
||||||
|
"high": -0.02281132414150622,
|
||||||
|
"half_width": 0.013841536385292194,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_distr_w3-1": {
|
||||||
|
"mean": 0.03111202543445303,
|
||||||
|
"low": 0.020178383756842794,
|
||||||
|
"high": 0.04156303937286202,
|
||||||
|
"half_width": 0.010692327808009614,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-1": {
|
||||||
|
"mean": 0.014977095209883329,
|
||||||
|
"low": 0.005218204102605788,
|
||||||
|
"high": 0.02459504334347515,
|
||||||
|
"half_width": 0.009688419620434681,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-2": {
|
||||||
|
"mean": -0.051413092090969455,
|
||||||
|
"low": -0.06535384679837442,
|
||||||
|
"high": -0.038089347408468734,
|
||||||
|
"half_width": 0.01363224969495284,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-3": {
|
||||||
|
"mean": -0.07533097724415116,
|
||||||
|
"low": -0.09004020766917203,
|
||||||
|
"high": -0.06128656360394481,
|
||||||
|
"half_width": 0.01437682203261361,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-1": {
|
||||||
|
"mean": 0.02687809775152952,
|
||||||
|
"low": 0.016548522541715575,
|
||||||
|
"high": 0.03762050795440273,
|
||||||
|
"half_width": 0.010535992706343577,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-4": {
|
||||||
|
"mean": -0.051413092090969455,
|
||||||
|
"low": -0.06535384679837442,
|
||||||
|
"high": -0.038089347408468734,
|
||||||
|
"half_width": 0.01363224969495284,
|
||||||
|
"n": 1000
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w3-1": {
|
||||||
|
"mean": 0.0213479762220107,
|
||||||
|
"low": 0.01018165684232131,
|
||||||
|
"high": 0.03310729376857287,
|
||||||
|
"half_width": 0.011462818463125779,
|
||||||
|
"n": 1000
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move1_can_fusion_help": {
|
||||||
|
"union_recall": 0.949,
|
||||||
|
"ideal_ndcg_10": 0.949,
|
||||||
|
"default_ndcg_10": 0.6555386875236466,
|
||||||
|
"headroom": 0.2934613124763533,
|
||||||
|
"dense_recall": 0.921,
|
||||||
|
"sparse_recall": 0.76
|
||||||
|
},
|
||||||
|
"move2_where_results_come_from": {
|
||||||
|
"top10_source_share": {
|
||||||
|
"both": 0.4181,
|
||||||
|
"dense_only": 0.295,
|
||||||
|
"sparse_only": 0.2869
|
||||||
|
},
|
||||||
|
"top10_relevant_source_share": {
|
||||||
|
"both": 0.8738738738738738,
|
||||||
|
"dense_only": 0.11325611325611326,
|
||||||
|
"sparse_only": 0.01287001287001287
|
||||||
|
},
|
||||||
|
"unique_relevant_per_query": {
|
||||||
|
"dense": 0.189,
|
||||||
|
"sparse": 0.028
|
||||||
|
},
|
||||||
|
"unique_relevant_surviving_into_top10": {
|
||||||
|
"dense": 0.4656084656084656,
|
||||||
|
"sparse": 0.35714285714285715
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move3_which_way_to_move_k": {
|
||||||
|
"k_sweep_equal_weights": {
|
||||||
|
"1": 0.6501089666584411,
|
||||||
|
"2": 0.6555386875236466,
|
||||||
|
"5": 0.6579638997770983,
|
||||||
|
"20": 0.651091417124989,
|
||||||
|
"61": 0.6257844608675881
|
||||||
|
},
|
||||||
|
"best_k": 5,
|
||||||
|
"span": 0.03217943890951025,
|
||||||
|
"tie_rate_top10": {
|
||||||
|
"k1": 0.42129999999999995,
|
||||||
|
"k2": 0.4163,
|
||||||
|
"k5": 0.39670000000000005,
|
||||||
|
"k20": 0.2847,
|
||||||
|
"k61": 0.11109999999999999
|
||||||
|
},
|
||||||
|
"dbsf_minus_default": 0.016055614058808954
|
||||||
|
},
|
||||||
|
"move4_when_to_stop": {
|
||||||
|
"arms_clearing": 5,
|
||||||
|
"clearing_arms": [
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k5_w3-1"
|
||||||
|
],
|
||||||
|
"dbsf_clears": true,
|
||||||
|
"nominal_winner": "dbsf",
|
||||||
|
"prescription": "rrf_k2_w2-1",
|
||||||
|
"median_interval_width": 0.020453728905617544
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,420 @@
|
|||||||
|
{
|
||||||
|
"tie_rate_build1": {
|
||||||
|
"rrf_k1_w1-1": 0.06575,
|
||||||
|
"rrf_k1_w1-2": 0.03975,
|
||||||
|
"rrf_k1_w1-3": 0.025,
|
||||||
|
"rrf_k1_w2-1": 0.0355,
|
||||||
|
"rrf_k1_w3-1": 0.02125,
|
||||||
|
"rrf_k1_w2-4": 0.03975,
|
||||||
|
"rrf_k2_w1-1": 0.0645,
|
||||||
|
"rrf_k2_w1-2": 0.04075000000000001,
|
||||||
|
"rrf_k2_w1-3": 0.023250000000000003,
|
||||||
|
"rrf_k2_w2-1": 0.0435,
|
||||||
|
"rrf_k2_w3-1": 0.019000000000000003,
|
||||||
|
"rrf_k2_w2-4": 0.032,
|
||||||
|
"rrf_k5_w1-1": 0.06,
|
||||||
|
"rrf_k5_w1-2": 0.027750000000000004,
|
||||||
|
"rrf_k5_w1-3": 0.022000000000000002,
|
||||||
|
"rrf_k5_w2-1": 0.03125,
|
||||||
|
"rrf_k5_w3-1": 0.018500000000000003,
|
||||||
|
"rrf_k5_w2-4": 0.021,
|
||||||
|
"rrf_k20_w1-1": 0.037,
|
||||||
|
"rrf_k20_w1-2": 0.014500000000000002,
|
||||||
|
"rrf_k20_w1-3": 0.0085,
|
||||||
|
"rrf_k20_w2-1": 0.01225,
|
||||||
|
"rrf_k20_w3-1": 0.00775,
|
||||||
|
"rrf_k20_w2-4": 0.01225,
|
||||||
|
"rrf_k61_w1-1": 0.027999999999999997,
|
||||||
|
"rrf_k61_w1-2": 0.0105,
|
||||||
|
"rrf_k61_w1-3": 0.005,
|
||||||
|
"rrf_k61_w2-1": 0.0085,
|
||||||
|
"rrf_k61_w3-1": 0.00625,
|
||||||
|
"rrf_k61_w2-4": 0.009999999999999998,
|
||||||
|
"dbsf": 0.0005,
|
||||||
|
"dense_only": 0.0,
|
||||||
|
"sparse_only": 0.05200000000000001,
|
||||||
|
"unreachable_minmax_w1-1": 0.00575,
|
||||||
|
"unreachable_minmax_w1-2": 0.0045,
|
||||||
|
"unreachable_minmax_w1-3": 0.005,
|
||||||
|
"unreachable_minmax_w2-1": 0.0005,
|
||||||
|
"unreachable_minmax_w3-1": 0.0005,
|
||||||
|
"unreachable_minmax_w2-4": 0.0045,
|
||||||
|
"unreachable_distr_w1-1": 0.0005,
|
||||||
|
"unreachable_distr_w1-2": 0.003,
|
||||||
|
"unreachable_distr_w1-3": 0.0034999999999999996,
|
||||||
|
"unreachable_distr_w2-1": 0.0005,
|
||||||
|
"unreachable_distr_w3-1": 0.0005,
|
||||||
|
"unreachable_distr_w2-4": 0.003
|
||||||
|
},
|
||||||
|
"bootstrap_vs_default": {
|
||||||
|
"dbsf": {
|
||||||
|
"mean": 0.01839085364039045,
|
||||||
|
"low": 0.00980400860176687,
|
||||||
|
"high": 0.02674529517819176,
|
||||||
|
"half_width": 0.008470643288212443,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"dense_only": {
|
||||||
|
"mean": 0.003916573187224914,
|
||||||
|
"low": -0.00846236457647099,
|
||||||
|
"high": 0.016899286017432888,
|
||||||
|
"half_width": 0.012680825296951938,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-1": {
|
||||||
|
"mean": -0.0013563050118625952,
|
||||||
|
"low": -0.003419736757304306,
|
||||||
|
"high": 0.0006648972056947907,
|
||||||
|
"half_width": 0.0020423169814995485,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-2": {
|
||||||
|
"mean": -0.024000424219103512,
|
||||||
|
"low": -0.031647973417531734,
|
||||||
|
"high": -0.016609041089421784,
|
||||||
|
"half_width": 0.007519466164054975,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-3": {
|
||||||
|
"mean": -0.03766513252396882,
|
||||||
|
"low": -0.04742911133999406,
|
||||||
|
"high": -0.02812576802264746,
|
||||||
|
"half_width": 0.009651671658673299,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-1": {
|
||||||
|
"mean": 0.0088713623332841,
|
||||||
|
"low": 0.0023033406876908046,
|
||||||
|
"high": 0.01552784725121163,
|
||||||
|
"half_width": 0.006612253281760413,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-4": {
|
||||||
|
"mean": -0.024000424219103512,
|
||||||
|
"low": -0.031647973417531734,
|
||||||
|
"high": -0.016609041089421784,
|
||||||
|
"half_width": 0.007519466164054975,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k1_w3-1": {
|
||||||
|
"mean": 0.009228545048939813,
|
||||||
|
"low": 0.0008147190825958862,
|
||||||
|
"high": 0.017414800629841933,
|
||||||
|
"half_width": 0.008300040773623023,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-1": {
|
||||||
|
"mean": 0.004358207418525032,
|
||||||
|
"low": -0.004858586253120476,
|
||||||
|
"high": 0.013109932115668901,
|
||||||
|
"half_width": 0.008984259184394688,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-2": {
|
||||||
|
"mean": 0.00747782144679388,
|
||||||
|
"low": -0.002754374867755998,
|
||||||
|
"high": 0.017059258026158264,
|
||||||
|
"half_width": 0.009906816446957132,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-3": {
|
||||||
|
"mean": 0.010322382835455314,
|
||||||
|
"low": 0.000224804514317622,
|
||||||
|
"high": 0.01999999011352626,
|
||||||
|
"half_width": 0.009887592799604319,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-1": {
|
||||||
|
"mean": -0.0058015445610532955,
|
||||||
|
"low": -0.01742261694512168,
|
||||||
|
"high": 0.004286979797147922,
|
||||||
|
"half_width": 0.010854798371134802,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-4": {
|
||||||
|
"mean": 0.0031397805025624227,
|
||||||
|
"low": -0.008576899750309579,
|
||||||
|
"high": 0.013509637848346636,
|
||||||
|
"half_width": 0.011043268799328107,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k20_w3-1": {
|
||||||
|
"mean": -0.012067850986310245,
|
||||||
|
"low": -0.024572335723007516,
|
||||||
|
"high": -0.0011395204888186277,
|
||||||
|
"half_width": 0.011716407617094443,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-2": {
|
||||||
|
"mean": -0.014273543654132206,
|
||||||
|
"low": -0.021413012729145576,
|
||||||
|
"high": -0.008117061104594111,
|
||||||
|
"half_width": 0.006647975812275732,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-3": {
|
||||||
|
"mean": -0.023142797659287916,
|
||||||
|
"low": -0.03184059513625672,
|
||||||
|
"high": -0.015205056769953052,
|
||||||
|
"half_width": 0.008317769183151833,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-1": {
|
||||||
|
"mean": 0.008605462719973967,
|
||||||
|
"low": 0.0035754542211537984,
|
||||||
|
"high": 0.01365057671370075,
|
||||||
|
"half_width": 0.005037561246273476,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-4": {
|
||||||
|
"mean": -0.00948693390252816,
|
||||||
|
"low": -0.015465080352382258,
|
||||||
|
"high": -0.0039028084461256076,
|
||||||
|
"half_width": 0.005781135953128325,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k2_w3-1": {
|
||||||
|
"mean": 0.008199357026661825,
|
||||||
|
"low": 0.0017332867396746537,
|
||||||
|
"high": 0.014908408872103505,
|
||||||
|
"half_width": 0.006587561066214426,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-1": {
|
||||||
|
"mean": 0.00032271157545683176,
|
||||||
|
"low": -0.004744671462879598,
|
||||||
|
"high": 0.004496400547309273,
|
||||||
|
"half_width": 0.004620536005094435,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-2": {
|
||||||
|
"mean": -0.0016086118564141527,
|
||||||
|
"low": -0.008196733528831211,
|
||||||
|
"high": 0.004582552276603352,
|
||||||
|
"half_width": 0.006389642902717282,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-3": {
|
||||||
|
"mean": -0.002202435035073261,
|
||||||
|
"low": -0.00977725723549038,
|
||||||
|
"high": 0.004545168819938572,
|
||||||
|
"half_width": 0.007161213027714476,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-1": {
|
||||||
|
"mean": 0.0020938035824597263,
|
||||||
|
"low": -0.0043590634431108525,
|
||||||
|
"high": 0.00824494689528972,
|
||||||
|
"half_width": 0.006302005169200287,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-4": {
|
||||||
|
"mean": 0.0044013295202004555,
|
||||||
|
"low": -0.0035448190879311644,
|
||||||
|
"high": 0.011202824547749781,
|
||||||
|
"half_width": 0.007373821817840473,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k5_w3-1": {
|
||||||
|
"mean": -0.00025377913577704915,
|
||||||
|
"low": -0.00724693149519601,
|
||||||
|
"high": 0.006443312121844843,
|
||||||
|
"half_width": 0.006845121808520427,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-1": {
|
||||||
|
"mean": -0.00321850535725273,
|
||||||
|
"low": -0.015293862110860024,
|
||||||
|
"high": 0.007602583098838913,
|
||||||
|
"half_width": 0.011448222604849468,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-2": {
|
||||||
|
"mean": 0.0033031655222944558,
|
||||||
|
"low": -0.008495203171965827,
|
||||||
|
"high": 0.0145130705717553,
|
||||||
|
"half_width": 0.011504136871860565,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-3": {
|
||||||
|
"mean": 0.007545243836409348,
|
||||||
|
"low": -0.0031421565836466715,
|
||||||
|
"high": 0.017960741044899965,
|
||||||
|
"half_width": 0.010551448814273319,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-1": {
|
||||||
|
"mean": -0.010433114227544593,
|
||||||
|
"low": -0.023532475229380907,
|
||||||
|
"high": 0.0013997609673174491,
|
||||||
|
"half_width": 0.012466118098349178,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-4": {
|
||||||
|
"mean": 0.003864890546579488,
|
||||||
|
"low": -0.00800388022017349,
|
||||||
|
"high": 0.01493102055572217,
|
||||||
|
"half_width": 0.01146745038794783,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"rrf_k61_w3-1": {
|
||||||
|
"mean": -0.016652266549259952,
|
||||||
|
"low": -0.03068966198112876,
|
||||||
|
"high": -0.004569537461409921,
|
||||||
|
"half_width": 0.01306006225985942,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"sparse_only": {
|
||||||
|
"mean": -0.07814752721533537,
|
||||||
|
"low": -0.09410896998886281,
|
||||||
|
"high": -0.06316070941353971,
|
||||||
|
"half_width": 0.01547413028766155,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-1": {
|
||||||
|
"mean": 0.01839085364039045,
|
||||||
|
"low": 0.00980400860176687,
|
||||||
|
"high": 0.02674529517819176,
|
||||||
|
"half_width": 0.008470643288212443,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-2": {
|
||||||
|
"mean": -0.0017591221768137285,
|
||||||
|
"low": -0.012435796554487805,
|
||||||
|
"high": 0.007154980461808968,
|
||||||
|
"half_width": 0.009795388508148387,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-3": {
|
||||||
|
"mean": -0.01941486426640665,
|
||||||
|
"low": -0.030743047510981714,
|
||||||
|
"high": -0.008928044092283292,
|
||||||
|
"half_width": 0.010907501709349211,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-1": {
|
||||||
|
"mean": 0.023402446641652207,
|
||||||
|
"low": 0.01459528652031773,
|
||||||
|
"high": 0.032585385504272445,
|
||||||
|
"half_width": 0.008995049491977356,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-4": {
|
||||||
|
"mean": -0.0017591221768137285,
|
||||||
|
"low": -0.012435796554487805,
|
||||||
|
"high": 0.007154980461808968,
|
||||||
|
"half_width": 0.009795388508148387,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_distr_w3-1": {
|
||||||
|
"mean": 0.02056123347371398,
|
||||||
|
"low": 0.011437052717321804,
|
||||||
|
"high": 0.029532772454252728,
|
||||||
|
"half_width": 0.009047859868465461,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-1": {
|
||||||
|
"mean": 0.014592925691918023,
|
||||||
|
"low": 0.004960702121168833,
|
||||||
|
"high": 0.023652371752090895,
|
||||||
|
"half_width": 0.009345834815461031,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-2": {
|
||||||
|
"mean": -0.00932192278945577,
|
||||||
|
"low": -0.02142429566652931,
|
||||||
|
"high": 0.0005077279175697197,
|
||||||
|
"half_width": 0.010966011792049516,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-3": {
|
||||||
|
"mean": -0.023981849265658967,
|
||||||
|
"low": -0.037085080958206465,
|
||||||
|
"high": -0.012952954639418318,
|
||||||
|
"half_width": 0.012066063159394073,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-1": {
|
||||||
|
"mean": 0.023191461022890287,
|
||||||
|
"low": 0.014351123368223757,
|
||||||
|
"high": 0.03263349942559031,
|
||||||
|
"half_width": 0.009141188028683276,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-4": {
|
||||||
|
"mean": -0.00932192278945577,
|
||||||
|
"low": -0.02142429566652931,
|
||||||
|
"high": 0.0005077279175697197,
|
||||||
|
"half_width": 0.010966011792049516,
|
||||||
|
"n": 400
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w3-1": {
|
||||||
|
"mean": 0.021703622548656112,
|
||||||
|
"low": 0.012259161502429965,
|
||||||
|
"high": 0.030744761223189993,
|
||||||
|
"half_width": 0.009242799860380013,
|
||||||
|
"n": 400
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move1_can_fusion_help": {
|
||||||
|
"union_recall": 0.8708302656214341,
|
||||||
|
"ideal_ndcg_10": 0.9508464223519653,
|
||||||
|
"default_ndcg_10": 0.4638190359359708,
|
||||||
|
"headroom": 0.48702738641599447,
|
||||||
|
"dense_recall": 0.7977153417976502,
|
||||||
|
"sparse_recall": 0.7650791492293604
|
||||||
|
},
|
||||||
|
"move2_where_results_come_from": {
|
||||||
|
"top10_source_share": {
|
||||||
|
"both": 0.90075,
|
||||||
|
"sparse_only": 0.0565,
|
||||||
|
"dense_only": 0.04275
|
||||||
|
},
|
||||||
|
"top10_relevant_source_share": {
|
||||||
|
"both": 0.9573978123200921,
|
||||||
|
"dense_only": 0.024179620034542316,
|
||||||
|
"sparse_only": 0.018422567645365574
|
||||||
|
},
|
||||||
|
"unique_relevant_per_query": {
|
||||||
|
"dense": 4.915,
|
||||||
|
"sparse": 3.485
|
||||||
|
},
|
||||||
|
"unique_relevant_surviving_into_top10": {
|
||||||
|
"dense": 0.021363173957273652,
|
||||||
|
"sparse": 0.02295552367288379
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move3_which_way_to_move_k": {
|
||||||
|
"k_sweep_equal_weights": {
|
||||||
|
"1": 0.46246273092410817,
|
||||||
|
"2": 0.4638190359359708,
|
||||||
|
"5": 0.4641417475114276,
|
||||||
|
"20": 0.46817724335449584,
|
||||||
|
"61": 0.460600530578718
|
||||||
|
},
|
||||||
|
"best_k": 20,
|
||||||
|
"span": 0.007576712775777816,
|
||||||
|
"tie_rate_top10": {
|
||||||
|
"k1": 0.06575,
|
||||||
|
"k2": 0.0645,
|
||||||
|
"k5": 0.06,
|
||||||
|
"k20": 0.037,
|
||||||
|
"k61": 0.027999999999999997
|
||||||
|
},
|
||||||
|
"dbsf_minus_default": 0.018390853640390448
|
||||||
|
},
|
||||||
|
"move4_when_to_stop": {
|
||||||
|
"arms_clearing": 6,
|
||||||
|
"clearing_arms": [
|
||||||
|
"rrf_k2_w2-1",
|
||||||
|
"rrf_k2_w3-1",
|
||||||
|
"rrf_k1_w2-1",
|
||||||
|
"rrf_k1_w3-1",
|
||||||
|
"rrf_k20_w1-3"
|
||||||
|
],
|
||||||
|
"dbsf_clears": true,
|
||||||
|
"nominal_winner": "dbsf",
|
||||||
|
"prescription": "rrf_k2_w2-1",
|
||||||
|
"median_interval_width": 0.016617809956774858
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,602 @@
|
|||||||
|
{
|
||||||
|
"tie_rate_build1": {
|
||||||
|
"rrf_k1_w1-1": 0.129,
|
||||||
|
"rrf_k1_w1-2": 0.08700000000000001,
|
||||||
|
"rrf_k1_w1-3": 0.03866666666666667,
|
||||||
|
"rrf_k1_w2-1": 0.07166666666666667,
|
||||||
|
"rrf_k1_w3-1": 0.03333333333333333,
|
||||||
|
"rrf_k1_w2-4": 0.08700000000000001,
|
||||||
|
"rrf_k2_w1-1": 0.12466666666666666,
|
||||||
|
"rrf_k2_w1-2": 0.08333333333333333,
|
||||||
|
"rrf_k2_w1-3": 0.04066666666666666,
|
||||||
|
"rrf_k2_w2-1": 0.07833333333333334,
|
||||||
|
"rrf_k2_w3-1": 0.03799999999999999,
|
||||||
|
"rrf_k2_w2-4": 0.06166666666666667,
|
||||||
|
"rrf_k5_w1-1": 0.10833333333333334,
|
||||||
|
"rrf_k5_w1-2": 0.054000000000000006,
|
||||||
|
"rrf_k5_w1-3": 0.03233333333333333,
|
||||||
|
"rrf_k5_w2-1": 0.06400000000000002,
|
||||||
|
"rrf_k5_w3-1": 0.030666666666666672,
|
||||||
|
"rrf_k5_w2-4": 0.041666666666666664,
|
||||||
|
"rrf_k20_w1-1": 0.062333333333333345,
|
||||||
|
"rrf_k20_w1-2": 0.016333333333333335,
|
||||||
|
"rrf_k20_w1-3": 0.006666666666666666,
|
||||||
|
"rrf_k20_w2-1": 0.024333333333333335,
|
||||||
|
"rrf_k20_w3-1": 0.006,
|
||||||
|
"rrf_k20_w2-4": 0.006666666666666666,
|
||||||
|
"rrf_k61_w1-1": 0.02766666666666667,
|
||||||
|
"rrf_k61_w1-2": 0.004666666666666666,
|
||||||
|
"rrf_k61_w1-3": 0.0010000000000000002,
|
||||||
|
"rrf_k61_w2-1": 0.010666666666666668,
|
||||||
|
"rrf_k61_w3-1": 0.0020000000000000005,
|
||||||
|
"rrf_k61_w2-4": 0.003666666666666667,
|
||||||
|
"dbsf": 0.0,
|
||||||
|
"dense_only": 0.0,
|
||||||
|
"sparse_only": 0.0,
|
||||||
|
"unreachable_minmax_w1-1": 0.002666666666666667,
|
||||||
|
"unreachable_minmax_w1-2": 0.0,
|
||||||
|
"unreachable_minmax_w1-3": 0.0,
|
||||||
|
"unreachable_minmax_w2-1": 0.0,
|
||||||
|
"unreachable_minmax_w3-1": 0.0,
|
||||||
|
"unreachable_minmax_w2-4": 0.0,
|
||||||
|
"unreachable_distr_w1-1": 0.0,
|
||||||
|
"unreachable_distr_w1-2": 0.0,
|
||||||
|
"unreachable_distr_w1-3": 0.0,
|
||||||
|
"unreachable_distr_w2-1": 0.0,
|
||||||
|
"unreachable_distr_w3-1": 0.0,
|
||||||
|
"unreachable_distr_w2-4": 0.0
|
||||||
|
},
|
||||||
|
"tie_rate_build2": {
|
||||||
|
"rrf_k1_w1-1": 0.12833333333333333,
|
||||||
|
"rrf_k1_w1-2": 0.08633333333333333,
|
||||||
|
"rrf_k1_w1-3": 0.038000000000000006,
|
||||||
|
"rrf_k1_w2-1": 0.07166666666666668,
|
||||||
|
"rrf_k1_w3-1": 0.03333333333333333,
|
||||||
|
"rrf_k1_w2-4": 0.08633333333333333,
|
||||||
|
"rrf_k2_w1-1": 0.12400000000000001,
|
||||||
|
"rrf_k2_w1-2": 0.08266666666666668,
|
||||||
|
"rrf_k2_w1-3": 0.04066666666666667,
|
||||||
|
"rrf_k2_w2-1": 0.07766666666666668,
|
||||||
|
"rrf_k2_w3-1": 0.038,
|
||||||
|
"rrf_k2_w2-4": 0.06166666666666667,
|
||||||
|
"rrf_k5_w1-1": 0.10766666666666667,
|
||||||
|
"rrf_k5_w1-2": 0.05333333333333334,
|
||||||
|
"rrf_k5_w1-3": 0.03233333333333333,
|
||||||
|
"rrf_k5_w2-1": 0.06400000000000002,
|
||||||
|
"rrf_k5_w3-1": 0.030666666666666672,
|
||||||
|
"rrf_k5_w2-4": 0.041,
|
||||||
|
"rrf_k20_w1-1": 0.06233333333333333,
|
||||||
|
"rrf_k20_w1-2": 0.016333333333333335,
|
||||||
|
"rrf_k20_w1-3": 0.006666666666666667,
|
||||||
|
"rrf_k20_w2-1": 0.024333333333333335,
|
||||||
|
"rrf_k20_w3-1": 0.006,
|
||||||
|
"rrf_k20_w2-4": 0.006666666666666667,
|
||||||
|
"rrf_k61_w1-1": 0.028,
|
||||||
|
"rrf_k61_w1-2": 0.004666666666666666,
|
||||||
|
"rrf_k61_w1-3": 0.0010000000000000002,
|
||||||
|
"rrf_k61_w2-1": 0.010666666666666668,
|
||||||
|
"rrf_k61_w3-1": 0.0020000000000000005,
|
||||||
|
"rrf_k61_w2-4": 0.003666666666666667,
|
||||||
|
"dbsf": 0.0006666666666666668,
|
||||||
|
"dense_only": 0.0,
|
||||||
|
"sparse_only": 0.0,
|
||||||
|
"unreachable_minmax_w1-1": 0.002666666666666667,
|
||||||
|
"unreachable_minmax_w1-2": 0.0,
|
||||||
|
"unreachable_minmax_w1-3": 0.0,
|
||||||
|
"unreachable_minmax_w2-1": 0.0,
|
||||||
|
"unreachable_minmax_w3-1": 0.0,
|
||||||
|
"unreachable_minmax_w2-4": 0.0,
|
||||||
|
"unreachable_distr_w1-1": 0.0006666666666666668,
|
||||||
|
"unreachable_distr_w1-2": 0.0,
|
||||||
|
"unreachable_distr_w1-3": 0.0,
|
||||||
|
"unreachable_distr_w2-1": 0.0,
|
||||||
|
"unreachable_distr_w3-1": 0.0,
|
||||||
|
"unreachable_distr_w2-4": 0.0
|
||||||
|
},
|
||||||
|
"tie_rate_build3": {
|
||||||
|
"rrf_k1_w1-1": 0.12833333333333333,
|
||||||
|
"rrf_k1_w1-2": 0.08633333333333333,
|
||||||
|
"rrf_k1_w1-3": 0.038000000000000006,
|
||||||
|
"rrf_k1_w2-1": 0.07166666666666668,
|
||||||
|
"rrf_k1_w3-1": 0.03333333333333333,
|
||||||
|
"rrf_k1_w2-4": 0.08633333333333333,
|
||||||
|
"rrf_k2_w1-1": 0.12400000000000001,
|
||||||
|
"rrf_k2_w1-2": 0.08266666666666668,
|
||||||
|
"rrf_k2_w1-3": 0.04066666666666667,
|
||||||
|
"rrf_k2_w2-1": 0.07766666666666668,
|
||||||
|
"rrf_k2_w3-1": 0.03866666666666667,
|
||||||
|
"rrf_k2_w2-4": 0.061000000000000006,
|
||||||
|
"rrf_k5_w1-1": 0.10766666666666667,
|
||||||
|
"rrf_k5_w1-2": 0.05333333333333334,
|
||||||
|
"rrf_k5_w1-3": 0.03233333333333333,
|
||||||
|
"rrf_k5_w2-1": 0.06400000000000002,
|
||||||
|
"rrf_k5_w3-1": 0.030666666666666672,
|
||||||
|
"rrf_k5_w2-4": 0.041,
|
||||||
|
"rrf_k20_w1-1": 0.06233333333333333,
|
||||||
|
"rrf_k20_w1-2": 0.016333333333333335,
|
||||||
|
"rrf_k20_w1-3": 0.006666666666666667,
|
||||||
|
"rrf_k20_w2-1": 0.024333333333333335,
|
||||||
|
"rrf_k20_w3-1": 0.006,
|
||||||
|
"rrf_k20_w2-4": 0.006666666666666667,
|
||||||
|
"rrf_k61_w1-1": 0.028,
|
||||||
|
"rrf_k61_w1-2": 0.004666666666666666,
|
||||||
|
"rrf_k61_w1-3": 0.0010000000000000002,
|
||||||
|
"rrf_k61_w2-1": 0.010666666666666668,
|
||||||
|
"rrf_k61_w3-1": 0.0020000000000000005,
|
||||||
|
"rrf_k61_w2-4": 0.003666666666666667,
|
||||||
|
"dbsf": 0.0,
|
||||||
|
"dense_only": 0.0,
|
||||||
|
"sparse_only": 0.0,
|
||||||
|
"unreachable_minmax_w1-1": 0.002666666666666667,
|
||||||
|
"unreachable_minmax_w1-2": 0.0,
|
||||||
|
"unreachable_minmax_w1-3": 0.0,
|
||||||
|
"unreachable_minmax_w2-1": 0.0,
|
||||||
|
"unreachable_minmax_w3-1": 0.0,
|
||||||
|
"unreachable_minmax_w2-4": 0.0,
|
||||||
|
"unreachable_distr_w1-1": 0.0,
|
||||||
|
"unreachable_distr_w1-2": 0.0,
|
||||||
|
"unreachable_distr_w1-3": 0.0,
|
||||||
|
"unreachable_distr_w2-1": 0.0,
|
||||||
|
"unreachable_distr_w3-1": 0.0,
|
||||||
|
"unreachable_distr_w2-4": 0.0
|
||||||
|
},
|
||||||
|
"tie_rate_build4": {
|
||||||
|
"rrf_k1_w1-1": 0.12833333333333333,
|
||||||
|
"rrf_k1_w1-2": 0.08633333333333333,
|
||||||
|
"rrf_k1_w1-3": 0.038000000000000006,
|
||||||
|
"rrf_k1_w2-1": 0.07166666666666668,
|
||||||
|
"rrf_k1_w3-1": 0.03333333333333333,
|
||||||
|
"rrf_k1_w2-4": 0.08633333333333333,
|
||||||
|
"rrf_k2_w1-1": 0.12400000000000001,
|
||||||
|
"rrf_k2_w1-2": 0.08266666666666668,
|
||||||
|
"rrf_k2_w1-3": 0.04066666666666667,
|
||||||
|
"rrf_k2_w2-1": 0.07766666666666668,
|
||||||
|
"rrf_k2_w3-1": 0.038,
|
||||||
|
"rrf_k2_w2-4": 0.060333333333333336,
|
||||||
|
"rrf_k5_w1-1": 0.10766666666666667,
|
||||||
|
"rrf_k5_w1-2": 0.05333333333333334,
|
||||||
|
"rrf_k5_w1-3": 0.03233333333333333,
|
||||||
|
"rrf_k5_w2-1": 0.06400000000000002,
|
||||||
|
"rrf_k5_w3-1": 0.030666666666666672,
|
||||||
|
"rrf_k5_w2-4": 0.041,
|
||||||
|
"rrf_k20_w1-1": 0.06233333333333333,
|
||||||
|
"rrf_k20_w1-2": 0.016333333333333335,
|
||||||
|
"rrf_k20_w1-3": 0.006666666666666667,
|
||||||
|
"rrf_k20_w2-1": 0.024333333333333335,
|
||||||
|
"rrf_k20_w3-1": 0.006,
|
||||||
|
"rrf_k20_w2-4": 0.006666666666666667,
|
||||||
|
"rrf_k61_w1-1": 0.02766666666666667,
|
||||||
|
"rrf_k61_w1-2": 0.004666666666666666,
|
||||||
|
"rrf_k61_w1-3": 0.0010000000000000002,
|
||||||
|
"rrf_k61_w2-1": 0.010666666666666668,
|
||||||
|
"rrf_k61_w3-1": 0.0020000000000000005,
|
||||||
|
"rrf_k61_w2-4": 0.003666666666666667,
|
||||||
|
"dbsf": 0.0006666666666666668,
|
||||||
|
"dense_only": 0.0,
|
||||||
|
"sparse_only": 0.0,
|
||||||
|
"unreachable_minmax_w1-1": 0.002666666666666667,
|
||||||
|
"unreachable_minmax_w1-2": 0.0,
|
||||||
|
"unreachable_minmax_w1-3": 0.0,
|
||||||
|
"unreachable_minmax_w2-1": 0.0,
|
||||||
|
"unreachable_minmax_w3-1": 0.0,
|
||||||
|
"unreachable_minmax_w2-4": 0.0,
|
||||||
|
"unreachable_distr_w1-1": 0.0006666666666666668,
|
||||||
|
"unreachable_distr_w1-2": 0.0,
|
||||||
|
"unreachable_distr_w1-3": 0.0,
|
||||||
|
"unreachable_distr_w2-1": 0.0,
|
||||||
|
"unreachable_distr_w3-1": 0.0,
|
||||||
|
"unreachable_distr_w2-4": 0.0
|
||||||
|
},
|
||||||
|
"tie_rate_build5": {
|
||||||
|
"rrf_k1_w1-1": 0.12833333333333333,
|
||||||
|
"rrf_k1_w1-2": 0.08633333333333333,
|
||||||
|
"rrf_k1_w1-3": 0.038000000000000006,
|
||||||
|
"rrf_k1_w2-1": 0.07233333333333335,
|
||||||
|
"rrf_k1_w3-1": 0.03333333333333333,
|
||||||
|
"rrf_k1_w2-4": 0.08633333333333333,
|
||||||
|
"rrf_k2_w1-1": 0.12400000000000001,
|
||||||
|
"rrf_k2_w1-2": 0.08266666666666668,
|
||||||
|
"rrf_k2_w1-3": 0.04066666666666667,
|
||||||
|
"rrf_k2_w2-1": 0.078,
|
||||||
|
"rrf_k2_w3-1": 0.03833333333333333,
|
||||||
|
"rrf_k2_w2-4": 0.06166666666666667,
|
||||||
|
"rrf_k5_w1-1": 0.107,
|
||||||
|
"rrf_k5_w1-2": 0.05333333333333334,
|
||||||
|
"rrf_k5_w1-3": 0.03233333333333333,
|
||||||
|
"rrf_k5_w2-1": 0.06433333333333335,
|
||||||
|
"rrf_k5_w3-1": 0.030666666666666672,
|
||||||
|
"rrf_k5_w2-4": 0.04033333333333334,
|
||||||
|
"rrf_k20_w1-1": 0.06233333333333333,
|
||||||
|
"rrf_k20_w1-2": 0.016000000000000004,
|
||||||
|
"rrf_k20_w1-3": 0.006666666666666667,
|
||||||
|
"rrf_k20_w2-1": 0.024333333333333335,
|
||||||
|
"rrf_k20_w3-1": 0.006,
|
||||||
|
"rrf_k20_w2-4": 0.006666666666666667,
|
||||||
|
"rrf_k61_w1-1": 0.02766666666666667,
|
||||||
|
"rrf_k61_w1-2": 0.004666666666666666,
|
||||||
|
"rrf_k61_w1-3": 0.0010000000000000002,
|
||||||
|
"rrf_k61_w2-1": 0.010666666666666668,
|
||||||
|
"rrf_k61_w3-1": 0.0020000000000000005,
|
||||||
|
"rrf_k61_w2-4": 0.003666666666666667,
|
||||||
|
"dbsf": 0.0006666666666666668,
|
||||||
|
"dense_only": 0.0,
|
||||||
|
"sparse_only": 0.0,
|
||||||
|
"unreachable_minmax_w1-1": 0.002666666666666667,
|
||||||
|
"unreachable_minmax_w1-2": 0.0,
|
||||||
|
"unreachable_minmax_w1-3": 0.0,
|
||||||
|
"unreachable_minmax_w2-1": 0.0,
|
||||||
|
"unreachable_minmax_w3-1": 0.0,
|
||||||
|
"unreachable_minmax_w2-4": 0.0,
|
||||||
|
"unreachable_distr_w1-1": 0.0006666666666666668,
|
||||||
|
"unreachable_distr_w1-2": 0.0,
|
||||||
|
"unreachable_distr_w1-3": 0.0,
|
||||||
|
"unreachable_distr_w2-1": 0.0,
|
||||||
|
"unreachable_distr_w3-1": 0.0,
|
||||||
|
"unreachable_distr_w2-4": 0.0
|
||||||
|
},
|
||||||
|
"bootstrap_vs_default": {
|
||||||
|
"dbsf": {
|
||||||
|
"mean": 0.0148120509111978,
|
||||||
|
"low": -5.953175509289564e-05,
|
||||||
|
"high": 0.028957222106201674,
|
||||||
|
"half_width": 0.014508376930647285,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"dense_only": {
|
||||||
|
"mean": -0.0936321074769497,
|
||||||
|
"low": -0.12288030975215582,
|
||||||
|
"high": -0.06531995130314641,
|
||||||
|
"half_width": 0.028780179224504703,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-1": {
|
||||||
|
"mean": -0.005795068837409961,
|
||||||
|
"low": -0.012612598230697806,
|
||||||
|
"high": 0.0002529349879887875,
|
||||||
|
"half_width": 0.006432766609343297,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-2": {
|
||||||
|
"mean": -0.012897681580271691,
|
||||||
|
"low": -0.02902432609501724,
|
||||||
|
"high": 0.003364459037312714,
|
||||||
|
"half_width": 0.016194392566164978,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-3": {
|
||||||
|
"mean": -0.015896155007048187,
|
||||||
|
"low": -0.03316444728724951,
|
||||||
|
"high": 0.001563167162355138,
|
||||||
|
"half_width": 0.017363807224802325,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-1": {
|
||||||
|
"mean": -0.04052553453759641,
|
||||||
|
"low": -0.057716101849540936,
|
||||||
|
"high": -0.024250329509186996,
|
||||||
|
"half_width": 0.016732886170176972,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-4": {
|
||||||
|
"mean": -0.012897681580271691,
|
||||||
|
"low": -0.02902432609501724,
|
||||||
|
"high": 0.003364459037312714,
|
||||||
|
"half_width": 0.016194392566164978,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k1_w3-1": {
|
||||||
|
"mean": -0.052589488265727354,
|
||||||
|
"low": -0.07182613047029464,
|
||||||
|
"high": -0.033599751736829525,
|
||||||
|
"half_width": 0.019113189366732557,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-1": {
|
||||||
|
"mean": -0.005246049958755128,
|
||||||
|
"low": -0.019981066105774128,
|
||||||
|
"high": 0.008853340019319438,
|
||||||
|
"half_width": 0.014417203062546784,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-2": {
|
||||||
|
"mean": -0.01421195783793877,
|
||||||
|
"low": -0.03206880595530935,
|
||||||
|
"high": 0.002361589117950677,
|
||||||
|
"half_width": 0.017215197536630013,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-3": {
|
||||||
|
"mean": -0.01683726079500603,
|
||||||
|
"low": -0.03483350238013899,
|
||||||
|
"high": 0.0006723448926476276,
|
||||||
|
"half_width": 0.01775292363639331,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-1": {
|
||||||
|
"mean": -0.003764314076201951,
|
||||||
|
"low": -0.018789730201049282,
|
||||||
|
"high": 0.011447874697959333,
|
||||||
|
"half_width": 0.015118802449504308,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-4": {
|
||||||
|
"mean": -0.01924230909397895,
|
||||||
|
"low": -0.03756368798733765,
|
||||||
|
"high": -0.0016972704295104384,
|
||||||
|
"half_width": 0.017933208778913606,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k20_w3-1": {
|
||||||
|
"mean": -0.005210817403324089,
|
||||||
|
"low": -0.02173723387477904,
|
||||||
|
"high": 0.01192195059699864,
|
||||||
|
"half_width": 0.01682959223588884,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-2": {
|
||||||
|
"mean": -0.0024793134539368507,
|
||||||
|
"low": -0.011064726691162301,
|
||||||
|
"high": 0.006153776504826365,
|
||||||
|
"half_width": 0.008609251597994333,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-3": {
|
||||||
|
"mean": -0.006986237663438958,
|
||||||
|
"low": -0.018791929918964563,
|
||||||
|
"high": 0.004000191855589505,
|
||||||
|
"half_width": 0.011396060887277034,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-1": {
|
||||||
|
"mean": -0.014128905715731234,
|
||||||
|
"low": -0.02418323223759274,
|
||||||
|
"high": -0.004179668127274476,
|
||||||
|
"half_width": 0.010001782055159131,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-4": {
|
||||||
|
"mean": -0.002414886056164996,
|
||||||
|
"low": -0.01303131674004109,
|
||||||
|
"high": 0.008286671382137826,
|
||||||
|
"half_width": 0.010658994061089458,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k2_w3-1": {
|
||||||
|
"mean": -0.019707765684418378,
|
||||||
|
"low": -0.032502444007537115,
|
||||||
|
"high": -0.006696902942335711,
|
||||||
|
"half_width": 0.012902770532600702,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-1": {
|
||||||
|
"mean": -0.0020919747577776717,
|
||||||
|
"low": -0.009599077079766757,
|
||||||
|
"high": 0.005428137647222147,
|
||||||
|
"half_width": 0.007513607363494452,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-2": {
|
||||||
|
"mean": -0.011259169263312687,
|
||||||
|
"low": -0.024038985894735826,
|
||||||
|
"high": 0.0020622942656687553,
|
||||||
|
"half_width": 0.013050640080202291,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-3": {
|
||||||
|
"mean": -0.012566133079928609,
|
||||||
|
"low": -0.02671740701376856,
|
||||||
|
"high": 0.0007378203497424219,
|
||||||
|
"half_width": 0.013727613681755492,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-1": {
|
||||||
|
"mean": -0.003251249726308402,
|
||||||
|
"low": -0.014413246813699225,
|
||||||
|
"high": 0.008209207386503301,
|
||||||
|
"half_width": 0.011311227100101264,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-4": {
|
||||||
|
"mean": -0.010279177594198679,
|
||||||
|
"low": -0.02384479318524111,
|
||||||
|
"high": 0.003909035136350715,
|
||||||
|
"half_width": 0.013876914160795912,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k5_w3-1": {
|
||||||
|
"mean": -0.0049773708831310605,
|
||||||
|
"low": -0.017805137495439563,
|
||||||
|
"high": 0.00820384787530326,
|
||||||
|
"half_width": 0.013004492685371412,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-1": {
|
||||||
|
"mean": -0.010766426401647667,
|
||||||
|
"low": -0.028117527817939126,
|
||||||
|
"high": 0.006392549208538399,
|
||||||
|
"half_width": 0.017255038513238764,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-2": {
|
||||||
|
"mean": -0.022168142224566558,
|
||||||
|
"low": -0.041065134925576265,
|
||||||
|
"high": -0.0038357459512886904,
|
||||||
|
"half_width": 0.018614694487143788,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-3": {
|
||||||
|
"mean": -0.025326834994257853,
|
||||||
|
"low": -0.04514893102189854,
|
||||||
|
"high": -0.005721743339532963,
|
||||||
|
"half_width": 0.019713593841182788,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-1": {
|
||||||
|
"mean": -0.009892165902643482,
|
||||||
|
"low": -0.02708940402319369,
|
||||||
|
"high": 0.007525538432136595,
|
||||||
|
"half_width": 0.01730747122766514,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-4": {
|
||||||
|
"mean": -0.024125782771160374,
|
||||||
|
"low": -0.04336733854200013,
|
||||||
|
"high": -0.006048496392484867,
|
||||||
|
"half_width": 0.018659421074757633,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"rrf_k61_w3-1": {
|
||||||
|
"mean": -0.008673067343030973,
|
||||||
|
"low": -0.027251764072556545,
|
||||||
|
"high": 0.00944314627543872,
|
||||||
|
"half_width": 0.018347455173997634,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"sparse_only": {
|
||||||
|
"mean": -0.028896180491396344,
|
||||||
|
"low": -0.05025038285684287,
|
||||||
|
"high": -0.007028804458213823,
|
||||||
|
"half_width": 0.021610789199314525,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-1": {
|
||||||
|
"mean": 0.0148120509111978,
|
||||||
|
"low": -5.953175509289564e-05,
|
||||||
|
"high": 0.028957222106201674,
|
||||||
|
"half_width": 0.014508376930647285,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-2": {
|
||||||
|
"mean": 0.01959455327345713,
|
||||||
|
"low": 0.0033936247550928216,
|
||||||
|
"high": 0.034583810189748446,
|
||||||
|
"half_width": 0.015595092717327811,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-3": {
|
||||||
|
"mean": 0.013398014782700389,
|
||||||
|
"low": -0.003708942764738101,
|
||||||
|
"high": 0.030333443841980706,
|
||||||
|
"half_width": 0.017021193303359404,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-1": {
|
||||||
|
"mean": -0.0023145890851863876,
|
||||||
|
"low": -0.019669946572120494,
|
||||||
|
"high": 0.013628965993201715,
|
||||||
|
"half_width": 0.016649456282661103,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-4": {
|
||||||
|
"mean": 0.01959455327345713,
|
||||||
|
"low": 0.0033936247550928216,
|
||||||
|
"high": 0.034583810189748446,
|
||||||
|
"half_width": 0.015595092717327811,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_distr_w3-1": {
|
||||||
|
"mean": -0.01997423748871315,
|
||||||
|
"low": -0.03625818133628806,
|
||||||
|
"high": -0.0030143153292530593,
|
||||||
|
"half_width": 0.0166219330035175,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-1": {
|
||||||
|
"mean": 0.006282759874353763,
|
||||||
|
"low": -0.006528038801336352,
|
||||||
|
"high": 0.018068549176992806,
|
||||||
|
"half_width": 0.012298293989164578,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-2": {
|
||||||
|
"mean": 0.014368682084967483,
|
||||||
|
"low": -0.0009609254407235614,
|
||||||
|
"high": 0.029814421758110526,
|
||||||
|
"half_width": 0.015387673599417045,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-3": {
|
||||||
|
"mean": 0.010199724525326602,
|
||||||
|
"low": -0.00718095089221834,
|
||||||
|
"high": 0.027432257350353498,
|
||||||
|
"half_width": 0.01730660412128592,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-1": {
|
||||||
|
"mean": -0.02358413081258322,
|
||||||
|
"low": -0.040767085736328035,
|
||||||
|
"high": -0.006066684370192523,
|
||||||
|
"half_width": 0.017350200683067755,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-4": {
|
||||||
|
"mean": 0.014368682084967483,
|
||||||
|
"low": -0.0009609254407235614,
|
||||||
|
"high": 0.029814421758110526,
|
||||||
|
"half_width": 0.015387673599417045,
|
||||||
|
"n": 300
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w3-1": {
|
||||||
|
"mean": -0.03554277120593072,
|
||||||
|
"low": -0.05612193603528988,
|
||||||
|
"high": -0.01646558730035657,
|
||||||
|
"half_width": 0.019828174367466655,
|
||||||
|
"n": 300
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move1_can_fusion_help": {
|
||||||
|
"union_recall": 0.9816666666666667,
|
||||||
|
"ideal_ndcg_10": 0.982043823975885,
|
||||||
|
"default_ndcg_10": 0.717491736277043,
|
||||||
|
"headroom": 0.264552087698842,
|
||||||
|
"dense_recall": 0.955,
|
||||||
|
"sparse_recall": 0.94
|
||||||
|
},
|
||||||
|
"move2_where_results_come_from": {
|
||||||
|
"top10_source_share": {
|
||||||
|
"both": 0.792,
|
||||||
|
"dense_only": 0.11266666666666666,
|
||||||
|
"sparse_only": 0.09533333333333334
|
||||||
|
},
|
||||||
|
"top10_relevant_source_share": {
|
||||||
|
"both": 0.9753521126760564,
|
||||||
|
"dense_only": 0.014084507042253521,
|
||||||
|
"sparse_only": 0.01056338028169014
|
||||||
|
},
|
||||||
|
"unique_relevant_per_query": {
|
||||||
|
"dense": 0.043333333333333335,
|
||||||
|
"sparse": 0.02666666666666667
|
||||||
|
},
|
||||||
|
"unique_relevant_surviving_into_top10": {
|
||||||
|
"dense": 0.3076923076923077,
|
||||||
|
"sparse": 0.375
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move3_which_way_to_move_k": {
|
||||||
|
"k_sweep_equal_weights": {
|
||||||
|
"1": 0.7116966674396331,
|
||||||
|
"2": 0.717491736277043,
|
||||||
|
"5": 0.7153997615192654,
|
||||||
|
"20": 0.712245686318288,
|
||||||
|
"61": 0.7067253098753955
|
||||||
|
},
|
||||||
|
"best_k": 2,
|
||||||
|
"span": 0.010766426401647489,
|
||||||
|
"tie_rate_top10": {
|
||||||
|
"k1": 0.129,
|
||||||
|
"k2": 0.12466666666666666,
|
||||||
|
"k5": 0.10833333333333334,
|
||||||
|
"k20": 0.062333333333333345,
|
||||||
|
"k61": 0.02766666666666667
|
||||||
|
},
|
||||||
|
"dbsf_minus_default": 0.01481205091119786
|
||||||
|
},
|
||||||
|
"move4_when_to_stop": {
|
||||||
|
"arms_clearing": 0,
|
||||||
|
"clearing_arms": [],
|
||||||
|
"dbsf_clears": false,
|
||||||
|
"nominal_winner": "dbsf",
|
||||||
|
"prescription": "rrf_k2_w1-1",
|
||||||
|
"median_interval_width": 0.03131319501566929
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,433 @@
|
|||||||
|
{
|
||||||
|
"tie_rate_build1": {
|
||||||
|
"rrf_k1_w1-1": 0.143125,
|
||||||
|
"rrf_k1_w1-2": 0.08833333333333335,
|
||||||
|
"rrf_k1_w1-3": 0.052916666666666674,
|
||||||
|
"rrf_k1_w2-1": 0.079375,
|
||||||
|
"rrf_k1_w3-1": 0.05666666666666667,
|
||||||
|
"rrf_k1_w2-4": 0.08833333333333335,
|
||||||
|
"rrf_k2_w1-1": 0.14208333333333334,
|
||||||
|
"rrf_k2_w1-2": 0.091875,
|
||||||
|
"rrf_k2_w1-3": 0.04916666666666667,
|
||||||
|
"rrf_k2_w2-1": 0.08791666666666667,
|
||||||
|
"rrf_k2_w3-1": 0.05541666666666667,
|
||||||
|
"rrf_k2_w2-4": 0.08854166666666667,
|
||||||
|
"rrf_k5_w1-1": 0.12854166666666667,
|
||||||
|
"rrf_k5_w1-2": 0.08145833333333334,
|
||||||
|
"rrf_k5_w1-3": 0.0475,
|
||||||
|
"rrf_k5_w2-1": 0.07833333333333332,
|
||||||
|
"rrf_k5_w3-1": 0.05229166666666667,
|
||||||
|
"rrf_k5_w2-4": 0.06708333333333334,
|
||||||
|
"rrf_k20_w1-1": 0.088125,
|
||||||
|
"rrf_k20_w1-2": 0.04104166666666667,
|
||||||
|
"rrf_k20_w1-3": 0.02125,
|
||||||
|
"rrf_k20_w2-1": 0.039375,
|
||||||
|
"rrf_k20_w3-1": 0.023958333333333335,
|
||||||
|
"rrf_k20_w2-4": 0.025625000000000002,
|
||||||
|
"rrf_k61_w1-1": 0.04729166666666667,
|
||||||
|
"rrf_k61_w1-2": 0.020625,
|
||||||
|
"rrf_k61_w1-3": 0.011250000000000001,
|
||||||
|
"rrf_k61_w2-1": 0.019583333333333338,
|
||||||
|
"rrf_k61_w3-1": 0.009166666666666667,
|
||||||
|
"rrf_k61_w2-4": 0.015208333333333334,
|
||||||
|
"dbsf": 0.005625000000000001,
|
||||||
|
"dense_only": 0.008541666666666666,
|
||||||
|
"sparse_only": 0.19291666666666668,
|
||||||
|
"unreachable_minmax_w1-1": 0.027708333333333335,
|
||||||
|
"unreachable_minmax_w1-2": 0.018333333333333333,
|
||||||
|
"unreachable_minmax_w1-3": 0.022708333333333334,
|
||||||
|
"unreachable_minmax_w2-1": 0.006041666666666667,
|
||||||
|
"unreachable_minmax_w3-1": 0.006041666666666667,
|
||||||
|
"unreachable_minmax_w2-4": 0.018333333333333333,
|
||||||
|
"unreachable_distr_w1-1": 0.005625000000000001,
|
||||||
|
"unreachable_distr_w1-2": 0.013125000000000001,
|
||||||
|
"unreachable_distr_w1-3": 0.017083333333333336,
|
||||||
|
"unreachable_distr_w2-1": 0.005000000000000001,
|
||||||
|
"unreachable_distr_w3-1": 0.005833333333333334,
|
||||||
|
"unreachable_distr_w2-4": 0.013125000000000001
|
||||||
|
},
|
||||||
|
"bootstrap_vs_default": {
|
||||||
|
"dbsf": {
|
||||||
|
"mean": 0.03828629409890931,
|
||||||
|
"low": 0.029647179634253555,
|
||||||
|
"high": 0.04708266027432365,
|
||||||
|
"half_width": 0.008717740320035049,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"dense_only": {
|
||||||
|
"mean": -0.03334473688833569,
|
||||||
|
"low": -0.04414906128540304,
|
||||||
|
"high": -0.021906432639341517,
|
||||||
|
"half_width": 0.01112131432303076,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-1": {
|
||||||
|
"mean": -0.0022516016302967594,
|
||||||
|
"low": -0.0036602291358976084,
|
||||||
|
"high": -0.001027773335197612,
|
||||||
|
"half_width": 0.0013162279003499982,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-2": {
|
||||||
|
"mean": -0.0025330411707959327,
|
||||||
|
"low": -0.007646257504954509,
|
||||||
|
"high": 0.002525764250959846,
|
||||||
|
"half_width": 0.005086010877957178,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k1_w1-3": {
|
||||||
|
"mean": -0.0038791556707879708,
|
||||||
|
"low": -0.011132911329326332,
|
||||||
|
"high": 0.002822887719037095,
|
||||||
|
"half_width": 0.006977899524181714,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-1": {
|
||||||
|
"mean": -0.012067202490492165,
|
||||||
|
"low": -0.017095759245353136,
|
||||||
|
"high": -0.00673730189143724,
|
||||||
|
"half_width": 0.005179228676957947,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k1_w2-4": {
|
||||||
|
"mean": -0.0025330411707959327,
|
||||||
|
"low": -0.007646257504954509,
|
||||||
|
"high": 0.002525764250959846,
|
||||||
|
"half_width": 0.005086010877957178,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k1_w3-1": {
|
||||||
|
"mean": -0.015671564571848175,
|
||||||
|
"low": -0.022775295235139142,
|
||||||
|
"high": -0.008635297968260318,
|
||||||
|
"half_width": 0.007069998633439412,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-1": {
|
||||||
|
"mean": 0.03166751678471227,
|
||||||
|
"low": 0.024933644143885735,
|
||||||
|
"high": 0.03889705796982621,
|
||||||
|
"half_width": 0.006981706912970238,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-2": {
|
||||||
|
"mean": 0.03493339339673267,
|
||||||
|
"low": 0.02750236221078256,
|
||||||
|
"high": 0.043146257157102,
|
||||||
|
"half_width": 0.007821947473159719,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k20_w1-3": {
|
||||||
|
"mean": 0.032187083169047316,
|
||||||
|
"low": 0.023762730311959152,
|
||||||
|
"high": 0.040677694338715265,
|
||||||
|
"half_width": 0.008457482013378056,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-1": {
|
||||||
|
"mean": 0.035879320378541156,
|
||||||
|
"low": 0.028068770924081467,
|
||||||
|
"high": 0.044040214724719355,
|
||||||
|
"half_width": 0.007985721900318944,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k20_w2-4": {
|
||||||
|
"mean": 0.03363528663102809,
|
||||||
|
"low": 0.024909098955336346,
|
||||||
|
"high": 0.04297548113428083,
|
||||||
|
"half_width": 0.009033191089472243,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k20_w3-1": {
|
||||||
|
"mean": 0.03614627334849881,
|
||||||
|
"low": 0.02750454008370346,
|
||||||
|
"high": 0.044909943341983324,
|
||||||
|
"half_width": 0.008702701629139933,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-2": {
|
||||||
|
"mean": 0.0010651235342690102,
|
||||||
|
"low": -0.003681058884806809,
|
||||||
|
"high": 0.0057246048470925015,
|
||||||
|
"half_width": 0.004702831865949655,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k2_w1-3": {
|
||||||
|
"mean": 0.0010245777599071242,
|
||||||
|
"low": -0.005290910349519423,
|
||||||
|
"high": 0.007036805833640872,
|
||||||
|
"half_width": 0.0061638580915801475,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-1": {
|
||||||
|
"mean": -0.005601659366308205,
|
||||||
|
"low": -0.009830553821803326,
|
||||||
|
"high": -0.001117507909421838,
|
||||||
|
"half_width": 0.004356522956190744,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k2_w2-4": {
|
||||||
|
"mean": 0.004413527735863278,
|
||||||
|
"low": -9.372313774938445e-05,
|
||||||
|
"high": 0.008826693754111003,
|
||||||
|
"half_width": 0.004460208445930194,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k2_w3-1": {
|
||||||
|
"mean": -0.007576997256313832,
|
||||||
|
"low": -0.013738412461731435,
|
||||||
|
"high": -0.0013660682719942386,
|
||||||
|
"half_width": 0.0061861720948685976,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-1": {
|
||||||
|
"mean": 0.008167901222788843,
|
||||||
|
"low": 0.005924866336863484,
|
||||||
|
"high": 0.010672434165203536,
|
||||||
|
"half_width": 0.002373783914170026,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-2": {
|
||||||
|
"mean": 0.013639375472078549,
|
||||||
|
"low": 0.009202108143191879,
|
||||||
|
"high": 0.01815436580111953,
|
||||||
|
"half_width": 0.004476128828963826,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k5_w1-3": {
|
||||||
|
"mean": 0.015620476043567607,
|
||||||
|
"low": 0.010866177247206591,
|
||||||
|
"high": 0.020577432214804032,
|
||||||
|
"half_width": 0.00485562748379872,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-1": {
|
||||||
|
"mean": 0.010073685048439564,
|
||||||
|
"low": 0.0055379117481071105,
|
||||||
|
"high": 0.015220451441509979,
|
||||||
|
"half_width": 0.004841269846701434,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k5_w2-4": {
|
||||||
|
"mean": 0.025351486582550153,
|
||||||
|
"low": 0.01963719454414564,
|
||||||
|
"high": 0.031535137325069296,
|
||||||
|
"half_width": 0.005948971390461829,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k5_w3-1": {
|
||||||
|
"mean": 0.01072557131607097,
|
||||||
|
"low": 0.004948951010304209,
|
||||||
|
"high": 0.016907730344941682,
|
||||||
|
"half_width": 0.005979389667318737,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-1": {
|
||||||
|
"mean": 0.03602098377536381,
|
||||||
|
"low": 0.02709304948893049,
|
||||||
|
"high": 0.04533146098756151,
|
||||||
|
"half_width": 0.009119205749315509,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-2": {
|
||||||
|
"mean": 0.032329368024012796,
|
||||||
|
"low": 0.023390482060427067,
|
||||||
|
"high": 0.04155925156673052,
|
||||||
|
"half_width": 0.009084384753151728,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k61_w1-3": {
|
||||||
|
"mean": 0.0288627830810352,
|
||||||
|
"low": 0.019609617977011766,
|
||||||
|
"high": 0.03813231476170846,
|
||||||
|
"half_width": 0.009261348392348347,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-1": {
|
||||||
|
"mean": 0.03575735083664481,
|
||||||
|
"low": 0.026185238249609673,
|
||||||
|
"high": 0.045493498097021995,
|
||||||
|
"half_width": 0.009654129923706161,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k61_w2-4": {
|
||||||
|
"mean": 0.03129971735030443,
|
||||||
|
"low": 0.02229565842373485,
|
||||||
|
"high": 0.0408665819903541,
|
||||||
|
"half_width": 0.009285461783309627,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"rrf_k61_w3-1": {
|
||||||
|
"mean": 0.034372734386247814,
|
||||||
|
"low": 0.024571099580303006,
|
||||||
|
"high": 0.044310763944094674,
|
||||||
|
"half_width": 0.009869832181895834,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"sparse_only": {
|
||||||
|
"mean": -0.015629565687052947,
|
||||||
|
"low": -0.02621770409315238,
|
||||||
|
"high": -0.005260478909026861,
|
||||||
|
"half_width": 0.01047861259206276,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-1": {
|
||||||
|
"mean": 0.03828629409890931,
|
||||||
|
"low": 0.029647179634253555,
|
||||||
|
"high": 0.04708266027432365,
|
||||||
|
"half_width": 0.008717740320035049,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-2": {
|
||||||
|
"mean": 0.027929491972728367,
|
||||||
|
"low": 0.01942592514776902,
|
||||||
|
"high": 0.035682850175572725,
|
||||||
|
"half_width": 0.008128462513901853,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_distr_w1-3": {
|
||||||
|
"mean": 0.017795327882595025,
|
||||||
|
"low": 0.00914880839230222,
|
||||||
|
"high": 0.025619923290712707,
|
||||||
|
"half_width": 0.008235557449205243,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-1": {
|
||||||
|
"mean": 0.02485877677558061,
|
||||||
|
"low": 0.01669218432020627,
|
||||||
|
"high": 0.033535666725218266,
|
||||||
|
"half_width": 0.008421741202505998,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_distr_w2-4": {
|
||||||
|
"mean": 0.027929491972728367,
|
||||||
|
"low": 0.01942592514776902,
|
||||||
|
"high": 0.035682850175572725,
|
||||||
|
"half_width": 0.008128462513901853,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_distr_w3-1": {
|
||||||
|
"mean": 0.01071161758405796,
|
||||||
|
"low": 0.002329351742784434,
|
||||||
|
"high": 0.019457521053826227,
|
||||||
|
"half_width": 0.008564084655520896,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-1": {
|
||||||
|
"mean": 0.030906891097393988,
|
||||||
|
"low": 0.024085483040927495,
|
||||||
|
"high": 0.03823061872195101,
|
||||||
|
"half_width": 0.007072567840511756,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-2": {
|
||||||
|
"mean": 0.02213314629479027,
|
||||||
|
"low": 0.01441458016517394,
|
||||||
|
"high": 0.029628810732143972,
|
||||||
|
"half_width": 0.007607115283485016,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w1-3": {
|
||||||
|
"mean": 0.011198472697296605,
|
||||||
|
"low": 0.0029588659768859694,
|
||||||
|
"high": 0.019749556961386548,
|
||||||
|
"half_width": 0.00839534549225029,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-1": {
|
||||||
|
"mean": 0.015179114499766286,
|
||||||
|
"low": 0.0071007008756296935,
|
||||||
|
"high": 0.02359009646125361,
|
||||||
|
"half_width": 0.008244697792811957,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w2-4": {
|
||||||
|
"mean": 0.02213314629479027,
|
||||||
|
"low": 0.01441458016517394,
|
||||||
|
"high": 0.029628810732143972,
|
||||||
|
"half_width": 0.007607115283485016,
|
||||||
|
"n": 480
|
||||||
|
},
|
||||||
|
"unreachable_minmax_w3-1": {
|
||||||
|
"mean": 0.001380646016131356,
|
||||||
|
"low": -0.007673544672019807,
|
||||||
|
"high": 0.010232680887092605,
|
||||||
|
"half_width": 0.008953112779556207,
|
||||||
|
"n": 480
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move1_can_fusion_help": {
|
||||||
|
"union_recall": 0.6219253272588373,
|
||||||
|
"ideal_ndcg_10": 0.9724833111880725,
|
||||||
|
"default_ndcg_10": 0.7254095560214437,
|
||||||
|
"headroom": 0.24707375516662877,
|
||||||
|
"dense_recall": 0.4783544341317294,
|
||||||
|
"sparse_recall": 0.5137209978879221
|
||||||
|
},
|
||||||
|
"move2_where_results_come_from": {
|
||||||
|
"top10_source_share": {
|
||||||
|
"both": 0.7754166666666666,
|
||||||
|
"sparse_only": 0.11520833333333333,
|
||||||
|
"dense_only": 0.109375
|
||||||
|
},
|
||||||
|
"top10_relevant_source_share": {
|
||||||
|
"both": 0.862607338017174,
|
||||||
|
"sparse_only": 0.0712984647410877,
|
||||||
|
"dense_only": 0.06609419724173822
|
||||||
|
},
|
||||||
|
"unique_relevant_per_query": {
|
||||||
|
"dense": 36.079331941544886,
|
||||||
|
"sparse": 38.45720250521921
|
||||||
|
},
|
||||||
|
"unique_relevant_surviving_into_top10": {
|
||||||
|
"dense": 0.014697372989237357,
|
||||||
|
"sparse": 0.014874328212366322
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"move3_which_way_to_move_k": {
|
||||||
|
"k_sweep_equal_weights": {
|
||||||
|
"1": 0.7231579543911469,
|
||||||
|
"2": 0.7254095560214437,
|
||||||
|
"5": 0.7335774572442326,
|
||||||
|
"20": 0.7570770728061561,
|
||||||
|
"61": 0.7614305397968075
|
||||||
|
},
|
||||||
|
"best_k": 61,
|
||||||
|
"span": 0.038272585405660586,
|
||||||
|
"tie_rate_top10": {
|
||||||
|
"k1": 0.143125,
|
||||||
|
"k2": 0.14208333333333334,
|
||||||
|
"k5": 0.12854166666666667,
|
||||||
|
"k20": 0.088125,
|
||||||
|
"k61": 0.04729166666666667
|
||||||
|
},
|
||||||
|
"dbsf_minus_default": 0.03828629409890938
|
||||||
|
},
|
||||||
|
"move4_when_to_stop": {
|
||||||
|
"arms_clearing": 19,
|
||||||
|
"clearing_arms": [
|
||||||
|
"rrf_k5_w1-1",
|
||||||
|
"rrf_k5_w1-2",
|
||||||
|
"rrf_k5_w2-1",
|
||||||
|
"rrf_k5_w2-4",
|
||||||
|
"rrf_k5_w1-3",
|
||||||
|
"rrf_k5_w3-1",
|
||||||
|
"rrf_k20_w1-1",
|
||||||
|
"rrf_k20_w1-2",
|
||||||
|
"rrf_k20_w2-1",
|
||||||
|
"rrf_k20_w2-4",
|
||||||
|
"rrf_k20_w3-1",
|
||||||
|
"rrf_k20_w1-3",
|
||||||
|
"rrf_k61_w1-1",
|
||||||
|
"rrf_k61_w1-2",
|
||||||
|
"rrf_k61_w2-1",
|
||||||
|
"rrf_k61_w2-4",
|
||||||
|
"rrf_k61_w1-3",
|
||||||
|
"rrf_k61_w3-1"
|
||||||
|
],
|
||||||
|
"dbsf_clears": true,
|
||||||
|
"nominal_winner": "dbsf",
|
||||||
|
"prescription": "rrf_k5_w1-1",
|
||||||
|
"median_interval_width": 0.01316407161905031
|
||||||
|
}
|
||||||
|
}
|
||||||
Executable
+25
@@ -0,0 +1,25 @@
|
|||||||
|
#!/usr/bin/env bash
|
||||||
|
# Fetch the five raw corpora into data/raw/. Pinned URLs; SHA256 is recorded by T1.
|
||||||
|
set -euo pipefail
|
||||||
|
cd "$(dirname "$0")/data/raw"
|
||||||
|
|
||||||
|
BEIR=https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets
|
||||||
|
WANDS_SHA=3b74dcf4ba29ab8ff3e6a50b5b09fc627cb882b5
|
||||||
|
CSN_SHA=bd0cf261e357a3eb5c8fba490d23ec1a1cd59555
|
||||||
|
|
||||||
|
fetch() { # fetch <url> <outfile>
|
||||||
|
if [ -s "$2" ]; then echo "have $2"; return; fi
|
||||||
|
echo "get $2"
|
||||||
|
curl -fsSL -C - -o "$2" "$1"
|
||||||
|
}
|
||||||
|
|
||||||
|
fetch "$BEIR/scifact.zip" scifact.zip
|
||||||
|
fetch "$BEIR/arguana.zip" arguana.zip
|
||||||
|
fetch "https://raw.githubusercontent.com/wayfair/WANDS/$WANDS_SHA/dataset/product.csv" wands_product.csv
|
||||||
|
fetch "https://raw.githubusercontent.com/wayfair/WANDS/$WANDS_SHA/dataset/query.csv" wands_query.csv
|
||||||
|
fetch "https://raw.githubusercontent.com/wayfair/WANDS/$WANDS_SHA/dataset/label.csv" wands_label.csv
|
||||||
|
fetch "https://huggingface.co/datasets/code-search-net/code_search_net/resolve/$CSN_SHA/python/train-00000-of-00001.parquet" csn_python_train.parquet
|
||||||
|
fetch "$BEIR/dbpedia-entity.zip" dbpedia-entity.zip
|
||||||
|
|
||||||
|
echo "--- sizes ---"
|
||||||
|
ls -l
|
||||||
@@ -0,0 +1,820 @@
|
|||||||
|
"""E7: the RAM boundary and the price of recovery.
|
||||||
|
|
||||||
|
The full DBPedia-entity BEIR corpus, embedded once, ingested into one
|
||||||
|
collection, then run under two container memory limits. This file owns only
|
||||||
|
E7. It imports the harness for the corpus loader and the embedding model so
|
||||||
|
E7 and E1 to E6 share one definition of both; it writes nothing that E1 to E6
|
||||||
|
read, and it runs against its own container and its own storage volume.
|
||||||
|
|
||||||
|
Phase 1 tasks, in order. `e7_phase1.sh` chains them unattended.
|
||||||
|
|
||||||
|
python e7.py corpus stream the zip, write frames, measure avg_len
|
||||||
|
python e7.py embed the embedding pass, resumable
|
||||||
|
python e7.py queries the 400 test queries, embedded once
|
||||||
|
python e7.py up 10g start the E7 container at a memory limit
|
||||||
|
python e7.py ingest create the collection and upload
|
||||||
|
python e7.py ingest 100000 smoke the same path over a slice, to prove it
|
||||||
|
python e7.py warm one pass of the query set
|
||||||
|
python e7.py mem steady-10g the memory measurements, named by lifecycle point
|
||||||
|
|
||||||
|
The cell list E7a and E7b run is pre-registered in `e7_cells.py`.
|
||||||
|
"""
|
||||||
|
|
||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import json
|
||||||
|
import subprocess
|
||||||
|
import sys
|
||||||
|
import time
|
||||||
|
from pathlib import Path
|
||||||
|
|
||||||
|
import numpy as np
|
||||||
|
import pandas as pd
|
||||||
|
|
||||||
|
from harness import CACHE, ROOT
|
||||||
|
from harness import corpora as C
|
||||||
|
from harness import qio
|
||||||
|
|
||||||
|
E7 = ROOT / "e7"
|
||||||
|
E7.mkdir(parents=True, exist_ok=True)
|
||||||
|
|
||||||
|
NAME = "dbpedia-full"
|
||||||
|
COLLECTION = "dbpedia_full"
|
||||||
|
CONTAINER = "e7-qdrant"
|
||||||
|
VOLUME = "e7-qdrant-storage"
|
||||||
|
IMAGE = "qdrant/qdrant:v1.19.0"
|
||||||
|
PORT = 6370
|
||||||
|
URL = f"http://localhost:{PORT}"
|
||||||
|
|
||||||
|
DOCS = CACHE / f"{NAME}_corpus.parquet"
|
||||||
|
QUERIES = CACHE / f"{NAME}_queries.parquet"
|
||||||
|
QRELS = CACHE / f"{NAME}_qrels.parquet"
|
||||||
|
DENSE = CACHE / f"{NAME}_dense.npy"
|
||||||
|
QDENSE = CACHE / f"{NAME}_qdense.npy"
|
||||||
|
PROGRESS = CACHE / f"{NAME}_dense.progress.json"
|
||||||
|
CORPUS_JSON = E7 / "corpus.json"
|
||||||
|
|
||||||
|
EMBED_BATCH = 256
|
||||||
|
UPLOAD_BATCH = 512
|
||||||
|
|
||||||
|
|
||||||
|
def _write(path: Path, payload: dict) -> None:
|
||||||
|
path.write_text(json.dumps(payload, indent=2, sort_keys=True) + "\n")
|
||||||
|
print(f"wrote {path.relative_to(ROOT)}")
|
||||||
|
|
||||||
|
|
||||||
|
def _sh(*args: str) -> str:
|
||||||
|
return subprocess.run(args, capture_output=True, text=True, check=True).stdout.strip()
|
||||||
|
|
||||||
|
|
||||||
|
# ------------------------------------------------------------------- corpus
|
||||||
|
|
||||||
|
|
||||||
|
CHUNK = 250_000
|
||||||
|
|
||||||
|
|
||||||
|
def corpus() -> None:
|
||||||
|
"""Write the whole 4.6M-document corpus, not the 100k sample E1 to E6 use.
|
||||||
|
|
||||||
|
The zip is read in one streaming pass into parquet row groups. `load_beir`
|
||||||
|
holds every document in a Python list, which is 3 GB of strings here and
|
||||||
|
twice that while the frame is built, so only its qrels reader, its
|
||||||
|
field recipe and its answerable-query rule are reused.
|
||||||
|
"""
|
||||||
|
import zipfile
|
||||||
|
|
||||||
|
import pyarrow as pa
|
||||||
|
import pyarrow.parquet as pq
|
||||||
|
|
||||||
|
started = time.time()
|
||||||
|
path = C.RAW / "dbpedia-entity.zip"
|
||||||
|
schema = pa.schema(
|
||||||
|
[("point_id", pa.int64()), ("doc_id", pa.string()), ("text", pa.string())]
|
||||||
|
)
|
||||||
|
doc_ids: list[str] = []
|
||||||
|
with zipfile.ZipFile(path) as archive:
|
||||||
|
corpus_member, queries_member, qrels_member = C._beir_members(archive, "dbpedia-entity")
|
||||||
|
qrels = C._read_qrels(archive, qrels_member)
|
||||||
|
with archive.open(queries_member) as handle:
|
||||||
|
queries = pd.DataFrame(
|
||||||
|
[
|
||||||
|
{"query_id": str(row["_id"]), "text": row["text"]}
|
||||||
|
for row in map(json.loads, C.io.TextIOWrapper(handle, "utf-8"))
|
||||||
|
]
|
||||||
|
)
|
||||||
|
with pq.ParquetWriter(DOCS, schema) as writer, archive.open(corpus_member) as handle:
|
||||||
|
batch: list[tuple[str, str]] = []
|
||||||
|
for line in C.io.TextIOWrapper(handle, "utf-8"):
|
||||||
|
row = json.loads(line)
|
||||||
|
batch.append(
|
||||||
|
(
|
||||||
|
str(row["_id"]),
|
||||||
|
f"{row.get('title', '')} {row.get('text', '')}".strip(),
|
||||||
|
)
|
||||||
|
)
|
||||||
|
if len(batch) == CHUNK:
|
||||||
|
_flush(writer, schema, batch, len(doc_ids))
|
||||||
|
doc_ids.extend(d for d, _ in batch)
|
||||||
|
batch = []
|
||||||
|
print(f" {len(doc_ids)} documents", flush=True)
|
||||||
|
if batch:
|
||||||
|
_flush(writer, schema, batch, len(doc_ids))
|
||||||
|
doc_ids.extend(d for d, _ in batch)
|
||||||
|
|
||||||
|
# Same rule as load_beir: a query whose relevant documents are all missing
|
||||||
|
# scores zero under every arm, so it is dropped rather than left to pad.
|
||||||
|
qrels = qrels[qrels["doc_id"].isin(set(doc_ids))].reset_index(drop=True)
|
||||||
|
answerable = set(qrels.loc[qrels["relevance"] > 0, "query_id"])
|
||||||
|
queries = queries[queries["query_id"].isin(answerable)].reset_index(drop=True)
|
||||||
|
qrels = qrels[qrels["query_id"].isin(answerable)].reset_index(drop=True)
|
||||||
|
queries.to_parquet(QUERIES, index=False)
|
||||||
|
qrels.to_parquet(QRELS, index=False)
|
||||||
|
loaded = time.time() - started
|
||||||
|
print(f"corpus written in {loaded:.0f}s, measuring avg_len", flush=True)
|
||||||
|
|
||||||
|
digest = C.hashlib.sha256("\n".join(doc_ids).encode()).hexdigest()
|
||||||
|
del doc_ids
|
||||||
|
lengths = _avg_len(len(qrels))
|
||||||
|
_write(
|
||||||
|
CORPUS_JSON,
|
||||||
|
{
|
||||||
|
"corpus": NAME,
|
||||||
|
"source": {
|
||||||
|
"file": path.name,
|
||||||
|
"url": f"{C.BEIR_BASE}/dbpedia-entity.zip",
|
||||||
|
"sha256": C.sha256(path),
|
||||||
|
"bytes": path.stat().st_size,
|
||||||
|
},
|
||||||
|
"license": "CC BY-SA 3.0",
|
||||||
|
"field_recipe": 'title + " " + text',
|
||||||
|
"docs": lengths.pop("docs"),
|
||||||
|
"queries": len(queries),
|
||||||
|
"qrels": len(qrels),
|
||||||
|
"relevant_per_query": round(
|
||||||
|
int((qrels["relevance"] > 0).sum()) / max(len(queries), 1), 4
|
||||||
|
),
|
||||||
|
"max_relevance": int(qrels["relevance"].max()),
|
||||||
|
"doc_id_sha256": digest,
|
||||||
|
**lengths,
|
||||||
|
"load_seconds": round(loaded, 1),
|
||||||
|
},
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def _flush(writer, schema, batch: list[tuple[str, str]], offset: int) -> None:
|
||||||
|
import pyarrow as pa
|
||||||
|
|
||||||
|
writer.write_table(
|
||||||
|
pa.Table.from_arrays(
|
||||||
|
[
|
||||||
|
pa.array(range(offset, offset + len(batch)), pa.int64()),
|
||||||
|
pa.array([d for d, _ in batch], pa.string()),
|
||||||
|
pa.array([t for _, t in batch], pa.string()),
|
||||||
|
],
|
||||||
|
schema=schema,
|
||||||
|
)
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def _avg_len(_unused: int) -> dict:
|
||||||
|
"""`measure_avg_len` over 4.6M documents, one row group per process.
|
||||||
|
|
||||||
|
The stemmer is pure Python, so processes are the only way to use more than
|
||||||
|
one core, and the totals are sums, so chunking changes nothing.
|
||||||
|
"""
|
||||||
|
import pyarrow.parquet as pq
|
||||||
|
from concurrent.futures import ProcessPoolExecutor
|
||||||
|
|
||||||
|
groups = pq.ParquetFile(DOCS).num_row_groups
|
||||||
|
stemmed = raw = docs = 0
|
||||||
|
with ProcessPoolExecutor(max_workers=10) as pool:
|
||||||
|
for part in pool.map(_avg_len_chunk, range(groups)):
|
||||||
|
stemmed += part[0]
|
||||||
|
raw += part[1]
|
||||||
|
docs += part[2]
|
||||||
|
return {
|
||||||
|
"avg_len": round(stemmed / max(docs, 1), 4),
|
||||||
|
"avg_raw_tokens": round(raw / max(docs, 1), 4),
|
||||||
|
"docs": docs,
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def _avg_len_chunk(group: int) -> tuple[int, int, int]:
|
||||||
|
import pyarrow.parquet as pq
|
||||||
|
from fastembed.common.utils import remove_non_alphanumeric
|
||||||
|
|
||||||
|
texts = pq.ParquetFile(DOCS).read_row_group(group, columns=["text"]).column("text").to_pylist()
|
||||||
|
bm25 = qio.bm25_model(256.0)
|
||||||
|
stemmed = raw = 0
|
||||||
|
for text in texts:
|
||||||
|
tokens = bm25.tokenizer.tokenize(remove_non_alphanumeric(text))
|
||||||
|
raw += len(tokens)
|
||||||
|
stemmed += len(bm25._stem(tokens))
|
||||||
|
return stemmed, raw, len(texts)
|
||||||
|
|
||||||
|
|
||||||
|
# ------------------------------------------------------------------ embedding
|
||||||
|
|
||||||
|
|
||||||
|
def embed() -> None:
|
||||||
|
"""Write float32 vectors straight into a memmap, resuming where it stopped.
|
||||||
|
|
||||||
|
7.1 GB of vectors will not sit in a Python list, and the pass runs for
|
||||||
|
hours, so the array on disk is the progress record.
|
||||||
|
"""
|
||||||
|
import pyarrow.parquet as pq
|
||||||
|
from fastembed import TextEmbedding
|
||||||
|
|
||||||
|
reader = pq.ParquetFile(DOCS)
|
||||||
|
total = reader.metadata.num_rows
|
||||||
|
done = 0
|
||||||
|
if PROGRESS.exists():
|
||||||
|
saved = json.loads(PROGRESS.read_text())
|
||||||
|
# Resuming on a row count alone would attach a stale run's vectors to a
|
||||||
|
# rebuilt corpus's doc_ids, and every check downstream would pass. The
|
||||||
|
# corpus digest, the model and the dimension have to match too.
|
||||||
|
# A progress file with no identity was written by the pass that
|
||||||
|
# introduced this check, so it is accepted once and rewritten with one.
|
||||||
|
if "identity" in saved and saved["identity"] != _identity():
|
||||||
|
raise SystemExit(
|
||||||
|
f"{PROGRESS.name} was written for a different corpus or model. "
|
||||||
|
f"Delete it and {DENSE.name} to start the pass again."
|
||||||
|
)
|
||||||
|
done = saved["rows"]
|
||||||
|
if done >= total:
|
||||||
|
print(f"embedded {total} already")
|
||||||
|
return
|
||||||
|
|
||||||
|
vectors = np.lib.format.open_memmap(
|
||||||
|
DENSE,
|
||||||
|
mode="r+" if DENSE.exists() else "w+",
|
||||||
|
dtype=np.float32,
|
||||||
|
shape=(total, qio.DENSE_DIM),
|
||||||
|
)
|
||||||
|
model = TextEmbedding(qio.DENSE_MODEL)
|
||||||
|
started, at, group_start = time.time(), done, 0
|
||||||
|
print(f"embedding {total - done} of {total} from row {done}", flush=True)
|
||||||
|
for group in range(reader.num_row_groups):
|
||||||
|
rows = reader.metadata.row_group(group).num_rows
|
||||||
|
if group_start + rows <= done:
|
||||||
|
group_start += rows
|
||||||
|
continue
|
||||||
|
# One row group at a time: 4.6M documents of text will not sit in
|
||||||
|
# memory beside a 7.1 GB vector array for the hours this takes.
|
||||||
|
texts = reader.read_row_group(group, columns=["text"]).column("text").to_pylist()
|
||||||
|
for offset in range(at - group_start, rows, EMBED_BATCH):
|
||||||
|
stop = min(offset + EMBED_BATCH, rows)
|
||||||
|
batch = texts[offset:stop]
|
||||||
|
vectors[group_start + offset : group_start + stop] = np.asarray(
|
||||||
|
list(model.embed(batch, batch_size=EMBED_BATCH)), np.float32
|
||||||
|
)
|
||||||
|
at = group_start + stop
|
||||||
|
if (stop // EMBED_BATCH) % 100 == 0 or stop == rows:
|
||||||
|
vectors.flush()
|
||||||
|
_checkpoint(at, total, done, started)
|
||||||
|
group_start += rows
|
||||||
|
vectors.flush()
|
||||||
|
_checkpoint(at, total, done, started)
|
||||||
|
|
||||||
|
|
||||||
|
def _checkpoint(at: int, total: int, done: int, started: float) -> None:
|
||||||
|
rate = (at - done) / max(time.time() - started, 1e-9)
|
||||||
|
PROGRESS.write_text(
|
||||||
|
json.dumps(
|
||||||
|
{
|
||||||
|
"rows": at,
|
||||||
|
"total": total,
|
||||||
|
"docs_per_second": round(rate, 1),
|
||||||
|
"identity": _identity(),
|
||||||
|
}
|
||||||
|
)
|
||||||
|
)
|
||||||
|
left = (total - at) / max(rate, 1e-9)
|
||||||
|
print(f" {at}/{total} {rate:.0f} docs/s {left / 60:.0f} min left", flush=True)
|
||||||
|
|
||||||
|
|
||||||
|
def _identity() -> dict:
|
||||||
|
"""What the vectors on disk have to agree with: which documents, in which
|
||||||
|
order, through which model. Carried by the progress file and asserted again
|
||||||
|
at ingest, because a mismatch produces a collection that looks correct."""
|
||||||
|
meta = json.loads(CORPUS_JSON.read_text())
|
||||||
|
return {
|
||||||
|
"doc_id_sha256": meta["doc_id_sha256"],
|
||||||
|
"docs": meta["docs"],
|
||||||
|
"model": qio.DENSE_MODEL,
|
||||||
|
"dim": qio.DENSE_DIM,
|
||||||
|
"source_sha256": meta["source"]["sha256"],
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def queries() -> None:
|
||||||
|
"""The 400 test queries, embedded once with the corpus model."""
|
||||||
|
from fastembed import TextEmbedding
|
||||||
|
|
||||||
|
frame = pd.read_parquet(QUERIES)
|
||||||
|
model = TextEmbedding(qio.DENSE_MODEL)
|
||||||
|
vectors = np.asarray(
|
||||||
|
list(model.embed([str(t) for t in frame["text"]], batch_size=EMBED_BATCH)), np.float32
|
||||||
|
)
|
||||||
|
np.save(QDENSE, vectors)
|
||||||
|
print(f"wrote {QDENSE.name} {vectors.shape}")
|
||||||
|
|
||||||
|
|
||||||
|
# ------------------------------------------------------------------ container
|
||||||
|
|
||||||
|
|
||||||
|
def up(limit: str = "14g") -> None:
|
||||||
|
"""Start the E7 container at a memory limit, on its own volume and port.
|
||||||
|
|
||||||
|
The five E1 to E6 collections live in `fusion-qdrant` and are not touched.
|
||||||
|
Recreating this container at a different limit keeps the collection,
|
||||||
|
because the storage is a named volume.
|
||||||
|
"""
|
||||||
|
# A graceful stop first: `rm -f` is a crash shutdown, and reopening the
|
||||||
|
# volume would then start with WAL recovery and an optimizer pass that
|
||||||
|
# contaminate the regime the new limit is supposed to isolate.
|
||||||
|
subprocess.run(["docker", "stop", "-t", "120", CONTAINER], capture_output=True)
|
||||||
|
subprocess.run(["docker", "rm", "-f", CONTAINER], capture_output=True)
|
||||||
|
_sh("docker", "volume", "create", VOLUME)
|
||||||
|
_sh(
|
||||||
|
"docker", "run", "-d",
|
||||||
|
"--name", CONTAINER,
|
||||||
|
"--memory", limit,
|
||||||
|
# Match the limit so the container cannot page out to the VM's swap and
|
||||||
|
# hide the boundary the experiment is built to measure.
|
||||||
|
"--memory-swap", limit,
|
||||||
|
"-p", f"{PORT}:6333",
|
||||||
|
"-p", f"{PORT + 1}:6334",
|
||||||
|
"-v", f"{VOLUME}:/qdrant/storage",
|
||||||
|
IMAGE,
|
||||||
|
)
|
||||||
|
for _ in range(60):
|
||||||
|
try:
|
||||||
|
_client().get_collections()
|
||||||
|
print(f"{CONTAINER} up at {limit}, {URL}")
|
||||||
|
return
|
||||||
|
except Exception:
|
||||||
|
time.sleep(1)
|
||||||
|
raise SystemExit(f"{CONTAINER} did not answer on {URL}")
|
||||||
|
|
||||||
|
|
||||||
|
def cold(limit: str = "4g") -> None:
|
||||||
|
"""Start a cell from a controlled cache state, which is the only way a
|
||||||
|
memory limit means anything here.
|
||||||
|
|
||||||
|
Page cache is charged to the cgroup that first faults a page in, and the
|
||||||
|
charge survives the container that made it. Recreating a container over a
|
||||||
|
warm volume therefore hands it gigabytes of resident pages it is never
|
||||||
|
billed for: measured at 4 GiB, the cgroup reported 32 MB of file cache
|
||||||
|
while the process held 9.49 GB, the limit was never reached, and 400
|
||||||
|
queries ran in 2.9 s instead of 158 s. Dropping the cache with the files
|
||||||
|
still mapped does not help either, because `drop_caches` frees only clean
|
||||||
|
unmapped pages. The server has to stop first.
|
||||||
|
"""
|
||||||
|
subprocess.run(["docker", "stop", "-t", "120", CONTAINER], capture_output=True)
|
||||||
|
before = _vm_cache()
|
||||||
|
_sh(
|
||||||
|
"docker", "run", "--rm", "--privileged", "--pid=host", "alpine",
|
||||||
|
"sh", "-c", "sync; echo 3 > /proc/sys/vm/drop_caches",
|
||||||
|
)
|
||||||
|
after = _vm_cache()
|
||||||
|
print(f"VM page cache {before / 1e9:.2f} GB -> {after / 1e9:.2f} GB")
|
||||||
|
if after > 2e9:
|
||||||
|
raise SystemExit(f"page cache still {after / 1e9:.2f} GB; something is holding the files")
|
||||||
|
# The host layer too, where it is permitted. macOS caches the VM's disk
|
||||||
|
# image, so a guest-only drop still leaves reads that never reach the SSD.
|
||||||
|
# `purge` needs sudo and may refuse without a terminal, so the outcome is
|
||||||
|
# recorded rather than assumed either way.
|
||||||
|
host = subprocess.run(["sudo", "-n", "purge"], capture_output=True, text=True)
|
||||||
|
host_dropped = host.returncode == 0
|
||||||
|
print(f"host page cache dropped: {host_dropped}")
|
||||||
|
up(limit)
|
||||||
|
_wait_ready()
|
||||||
|
_write(
|
||||||
|
E7 / f"cold-{limit}.json",
|
||||||
|
{
|
||||||
|
"limit": limit,
|
||||||
|
"vm_cache_before_bytes": before,
|
||||||
|
"vm_cache_after_bytes": after,
|
||||||
|
"host_purge_ran": host_dropped,
|
||||||
|
"host_swap_after": _sh("sysctl", "-n", "vm.swapusage"),
|
||||||
|
},
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
def _vm_cache() -> int:
|
||||||
|
"""`Cached` in the VM, read from a throwaway container so it can be taken
|
||||||
|
while the E7 container is stopped."""
|
||||||
|
out = _sh("docker", "run", "--rm", "alpine", "awk", "/^Cached:/{print $2*1024}", "/proc/meminfo")
|
||||||
|
return int(out)
|
||||||
|
|
||||||
|
|
||||||
|
def _wait_ready(collection: str = COLLECTION, wait_seconds: int = 600) -> None:
|
||||||
|
"""Ready means it answers a real query with its own shard active.
|
||||||
|
|
||||||
|
The status field is not the test. A collection whose shard reports Active
|
||||||
|
and which serves a query can report `grey`, and waiting for the literal
|
||||||
|
`green` polled a perfectly healthy collection for twenty minutes.
|
||||||
|
"""
|
||||||
|
import numpy as np
|
||||||
|
from qdrant_client import models
|
||||||
|
|
||||||
|
conn = _client()
|
||||||
|
probe = np.load(QDENSE)[0].tolist()
|
||||||
|
deadline = time.time() + wait_seconds
|
||||||
|
while time.time() < deadline:
|
||||||
|
try:
|
||||||
|
info = conn.get_collection(collection)
|
||||||
|
shards = conn.collection_cluster_info(collection).local_shards
|
||||||
|
conn.query_points(collection, query=probe, using="dense", limit=1)
|
||||||
|
# Compare enum values, not their repr. `str(state)` is "Active",
|
||||||
|
# not "ReplicaState.ACTIVE", and guessing that spelling wrong made
|
||||||
|
# this poll a healthy collection until it was killed.
|
||||||
|
if shards and all(s.state == models.ReplicaState.ACTIVE for s in shards):
|
||||||
|
print(f"{collection} ready, {info.points_count} points, status {info.status}")
|
||||||
|
return
|
||||||
|
except Exception:
|
||||||
|
pass
|
||||||
|
time.sleep(5)
|
||||||
|
raise SystemExit(f"{collection} not ready within {wait_seconds}s")
|
||||||
|
|
||||||
|
|
||||||
|
def _client():
|
||||||
|
from qdrant_client import QdrantClient
|
||||||
|
|
||||||
|
return QdrantClient(url=URL, timeout=3600)
|
||||||
|
|
||||||
|
|
||||||
|
# -------------------------------------------------------------------- ingest
|
||||||
|
|
||||||
|
|
||||||
|
def ingest(rows: str = "all", collection: str = COLLECTION) -> None:
|
||||||
|
"""Create the collection and stream every document into it.
|
||||||
|
|
||||||
|
Dense only: a BM25 prefetch would hold about 1.5 GB of page cache the
|
||||||
|
experiment is trying to starve, so under the tight limit the evicted
|
||||||
|
structure could be the sparse index rather than the originals.
|
||||||
|
|
||||||
|
Indexing is off during the upload and switched on afterwards, so the HNSW
|
||||||
|
graph is built once instead of being rebuilt under every optimizer pass.
|
||||||
|
That also makes the build and optimization times E7b reports separable.
|
||||||
|
"""
|
||||||
|
from qdrant_client import models
|
||||||
|
|
||||||
|
docs = pd.read_parquet(DOCS, columns=["point_id", "doc_id"])
|
||||||
|
dense = np.load(DENSE, mmap_mode="r")
|
||||||
|
if len(dense) != len(docs):
|
||||||
|
raise SystemExit(f"{len(dense)} vectors against {len(docs)} documents")
|
||||||
|
# The vectors and the doc_ids they are about to be paired with have to come
|
||||||
|
# from the same corpus, checked against the digest rather than the count.
|
||||||
|
identity = _identity()
|
||||||
|
digest = C.hashlib.sha256("\n".join(docs["doc_id"]).encode()).hexdigest()
|
||||||
|
if digest != identity["doc_id_sha256"]:
|
||||||
|
raise SystemExit("the parquet's doc_ids do not match the recorded corpus digest")
|
||||||
|
if dense.dtype != np.float32 or dense.shape[1] != qio.DENSE_DIM:
|
||||||
|
raise SystemExit(f"vectors are {dense.dtype} {dense.shape}, not float32 x {qio.DENSE_DIM}")
|
||||||
|
# A row count runs the same path over a slice, which is how the upload is
|
||||||
|
# proved before the overnight one starts.
|
||||||
|
total = len(docs) if rows == "all" else int(rows)
|
||||||
|
# A slice needs only its own rows embedded; the full ingest needs all of them.
|
||||||
|
saved = json.loads(PROGRESS.read_text()) if PROGRESS.exists() else {}
|
||||||
|
if (saved.get("rows") or 0) < total:
|
||||||
|
raise SystemExit(f"the embedding pass reached {saved.get('rows')} of {total} needed")
|
||||||
|
|
||||||
|
conn = _client()
|
||||||
|
conn.delete_collection(collection)
|
||||||
|
conn.create_collection(
|
||||||
|
collection_name=collection,
|
||||||
|
vectors_config={
|
||||||
|
"dense": models.VectorParams(size=qio.DENSE_DIM, distance=models.Distance.COSINE)
|
||||||
|
},
|
||||||
|
hnsw_config=models.HnswConfigDiff(
|
||||||
|
m=qio.HNSW_M,
|
||||||
|
ef_construct=qio.HNSW_EF_CONSTRUCT,
|
||||||
|
full_scan_threshold=qio.FULL_SCAN_THRESHOLD_KB,
|
||||||
|
),
|
||||||
|
# 0 disables indexing for the upload (config.rs:253-259); the real
|
||||||
|
# threshold goes on afterwards.
|
||||||
|
optimizers_config=models.OptimizersConfigDiff(
|
||||||
|
indexing_threshold=0, default_segment_number=SEGMENTS
|
||||||
|
),
|
||||||
|
quantization_config=None,
|
||||||
|
shard_number=1,
|
||||||
|
replication_factor=1,
|
||||||
|
)
|
||||||
|
conn.create_payload_index(collection, "doc_id", field_schema=models.PayloadSchemaType.KEYWORD)
|
||||||
|
|
||||||
|
point_ids = docs["point_id"].to_numpy()
|
||||||
|
doc_ids = list(docs["doc_id"])
|
||||||
|
started = time.time()
|
||||||
|
for start in range(0, total, UPLOAD_BATCH):
|
||||||
|
stop = min(start + UPLOAD_BATCH, total)
|
||||||
|
conn.upsert(
|
||||||
|
collection,
|
||||||
|
points=[
|
||||||
|
models.PointStruct(
|
||||||
|
id=int(point_ids[i]),
|
||||||
|
vector={"dense": dense[i].tolist()},
|
||||||
|
payload={"doc_id": doc_ids[i]},
|
||||||
|
)
|
||||||
|
for i in range(start, stop)
|
||||||
|
],
|
||||||
|
wait=False,
|
||||||
|
)
|
||||||
|
if stop % (UPLOAD_BATCH * 200) == 0 or stop == total:
|
||||||
|
rate = stop / max(time.time() - started, 1e-9)
|
||||||
|
print(f" {stop}/{total} {rate:.0f} docs/s", flush=True)
|
||||||
|
upload_seconds = time.time() - started
|
||||||
|
|
||||||
|
# `wait=False` returns before a batch is applied, so the count is the proof
|
||||||
|
# that nothing was dropped, and it has to be true before indexing starts.
|
||||||
|
deadline = time.time() + 1800
|
||||||
|
while (conn.get_collection(collection).points_count or 0) < total:
|
||||||
|
if time.time() > deadline:
|
||||||
|
raise SystemExit(
|
||||||
|
f"only {conn.get_collection(collection).points_count} of {total} points landed"
|
||||||
|
)
|
||||||
|
time.sleep(10)
|
||||||
|
|
||||||
|
conn.update_collection(
|
||||||
|
collection,
|
||||||
|
optimizers_config=models.OptimizersConfigDiff(
|
||||||
|
indexing_threshold=qio.INDEXING_THRESHOLD_KB
|
||||||
|
),
|
||||||
|
)
|
||||||
|
indexed = time.time()
|
||||||
|
stats = _wait_green(conn, collection, total)
|
||||||
|
_write(
|
||||||
|
E7 / ("ingest.json" if rows == "all" else f"ingest-{rows}.json"),
|
||||||
|
{
|
||||||
|
"collection": collection,
|
||||||
|
"container": CONTAINER,
|
||||||
|
"memory_limit": _limit(),
|
||||||
|
"documents": total,
|
||||||
|
"segments": SEGMENTS,
|
||||||
|
"vectors": "dense only, no sparse prefetch",
|
||||||
|
"upload_seconds": round(upload_seconds, 1),
|
||||||
|
"index_seconds": round(time.time() - indexed, 1),
|
||||||
|
**stats,
|
||||||
|
},
|
||||||
|
)
|
||||||
|
|
||||||
|
|
||||||
|
SEGMENTS = 7
|
||||||
|
|
||||||
|
|
||||||
|
def _wait_green(conn, collection: str, expected: int, wait_seconds: int = 21600) -> dict:
|
||||||
|
"""Green, every point present, every vector indexed, and the count settled.
|
||||||
|
|
||||||
|
Failing on a deadline rather than looping forever, because this runs
|
||||||
|
unattended and a stuck optimizer should end the night with an error rather
|
||||||
|
than with a script that is still sleeping in the morning.
|
||||||
|
"""
|
||||||
|
from qdrant_client import models
|
||||||
|
|
||||||
|
deadline = time.time() + wait_seconds
|
||||||
|
settled, previous = 0, -1
|
||||||
|
while time.time() < deadline:
|
||||||
|
info = conn.get_collection(collection)
|
||||||
|
indexed = info.indexed_vectors_count or 0
|
||||||
|
settled = settled + 1 if indexed == previous else 0
|
||||||
|
previous = indexed
|
||||||
|
if (
|
||||||
|
info.status == models.CollectionStatus.GREEN
|
||||||
|
and info.points_count == expected
|
||||||
|
and indexed >= expected
|
||||||
|
and settled >= 3
|
||||||
|
):
|
||||||
|
# The configuration is recorded with the counts, so a later run can
|
||||||
|
# show it measured the graph and placement it says it measured.
|
||||||
|
return {
|
||||||
|
"points_count": info.points_count,
|
||||||
|
"indexed_vectors_count": indexed,
|
||||||
|
"status": str(info.status),
|
||||||
|
"segments_count": info.segments_count,
|
||||||
|
"config": json.loads(info.config.model_dump_json()),
|
||||||
|
}
|
||||||
|
print(f" indexing {indexed}/{expected} {info.status}", flush=True)
|
||||||
|
time.sleep(30)
|
||||||
|
raise SystemExit(f"{collection} did not settle within {wait_seconds}s")
|
||||||
|
|
||||||
|
|
||||||
|
def warm(label: str = "warm", depth: str = "200", collection: str = COLLECTION) -> None:
|
||||||
|
"""One pass of the query set at the cells' candidate depth, timed.
|
||||||
|
|
||||||
|
The depth matters: a pass at `limit=10` never exercises the rescore path a
|
||||||
|
cell measures, so it would warm the wrong pages. The timing is written to
|
||||||
|
an artifact rather than printed, because a number that lives only in a
|
||||||
|
terminal cannot be checked against anything later.
|
||||||
|
"""
|
||||||
|
from qdrant_client import models
|
||||||
|
|
||||||
|
conn = _client()
|
||||||
|
vectors = np.load(QDENSE)
|
||||||
|
per_query = []
|
||||||
|
started = time.time()
|
||||||
|
for vector in vectors:
|
||||||
|
at = time.time()
|
||||||
|
conn.query_points(
|
||||||
|
collection,
|
||||||
|
query=vector.tolist(),
|
||||||
|
using="dense",
|
||||||
|
limit=int(depth),
|
||||||
|
search_params=models.SearchParams(hnsw_ef=qio.BASELINE_HNSW_EF),
|
||||||
|
)
|
||||||
|
per_query.append(time.time() - at)
|
||||||
|
total = time.time() - started
|
||||||
|
ordered = sorted(per_query)
|
||||||
|
_write(
|
||||||
|
E7 / f"pass-{label}.json",
|
||||||
|
{
|
||||||
|
"label": label,
|
||||||
|
"collection": collection,
|
||||||
|
"queries": len(vectors),
|
||||||
|
"depth": int(depth),
|
||||||
|
"hnsw_ef": qio.BASELINE_HNSW_EF,
|
||||||
|
"total_seconds": round(total, 3),
|
||||||
|
"mean_ms": round(1000 * total / len(vectors), 3),
|
||||||
|
"p50_ms": round(1000 * ordered[len(ordered) // 2], 3),
|
||||||
|
"p95_ms": round(1000 * ordered[int(len(ordered) * 0.95)], 3),
|
||||||
|
"max_ms": round(1000 * ordered[-1], 3),
|
||||||
|
"memory_limit": _limit(),
|
||||||
|
},
|
||||||
|
)
|
||||||
|
print(f"{label}: {len(vectors)} queries in {total:.1f}s at depth {depth}")
|
||||||
|
|
||||||
|
|
||||||
|
# --------------------------------------------------------------------- memory
|
||||||
|
|
||||||
|
|
||||||
|
def mem(label: str = "steady") -> None:
|
||||||
|
"""Named measurements, never one footprint.
|
||||||
|
|
||||||
|
Container RSS and the cgroup counter answer different questions: RSS is
|
||||||
|
what the process holds, `memory.current` adds the page cache the mmapped
|
||||||
|
vectors are read through, and that is the number the limit acts on.
|
||||||
|
"""
|
||||||
|
stats = _sh(
|
||||||
|
"docker", "stats", "--no-stream", "--format", "{{.MemUsage}}|{{.MemPerc}}", CONTAINER
|
||||||
|
)
|
||||||
|
# `memory.events` and the refault counters in `memory.stat` say whether the
|
||||||
|
# limit reclaimed anything, and `io.stat` says whether the reclaim turned
|
||||||
|
# into real block reads. A run that shows an OOM kill or sustained high
|
||||||
|
# pressure is dropped rather than read as a slow tier.
|
||||||
|
inside = {
|
||||||
|
key: _in_container(f"cat /sys/fs/cgroup/{key}")
|
||||||
|
for key in (
|
||||||
|
"memory.current",
|
||||||
|
"memory.peak",
|
||||||
|
"memory.max",
|
||||||
|
"memory.swap.current",
|
||||||
|
"memory.events",
|
||||||
|
"memory.events.local",
|
||||||
|
"io.stat",
|
||||||
|
)
|
||||||
|
}
|
||||||
|
stat = _in_container(
|
||||||
|
"grep -E '^(file|inactive_file|active_file|anon|slab|pagetables|sock|"
|
||||||
|
"workingset_refault_file|workingset_activate_file|pgmajfault|pgscan|pgsteal) '"
|
||||||
|
" /sys/fs/cgroup/memory.stat"
|
||||||
|
)
|
||||||
|
inside["memory.stat"] = stat
|
||||||
|
payload = {
|
||||||
|
"label": label,
|
||||||
|
"at": time.strftime("%Y-%m-%dT%H:%M:%S%z"),
|
||||||
|
"container": CONTAINER,
|
||||||
|
"docker_memory_limit": _limit(),
|
||||||
|
"docker_stats_mem_usage": stats,
|
||||||
|
"cgroup": inside,
|
||||||
|
# PID 1 is the entrypoint shell, so the server's own resident set has
|
||||||
|
# to be found by name rather than read off the init process.
|
||||||
|
"qdrant_rss_bytes": int(_in_container(
|
||||||
|
"for p in /proc/[0-9]*; do "
|
||||||
|
"if [ \"$(cat $p/comm 2>/dev/null)\" = qdrant ]; then "
|
||||||
|
"awk '/^VmRSS/{print $2*1024}' $p/status; fi; done"
|
||||||
|
) or 0),
|
||||||
|
"storage_bytes": int(_in_container("du -s --block-size=1 /qdrant/storage | cut -f1")),
|
||||||
|
"storage_apparent_bytes": int(_in_container("du -sb /qdrant/storage | cut -f1")),
|
||||||
|
"storage_breakdown": _in_container(
|
||||||
|
"du -sb /qdrant/storage/collections/*/*/* 2>/dev/null", allow_empty=True
|
||||||
|
),
|
||||||
|
# Residency is measured, not inferred from the placement label: the file
|
||||||
|
# page cache the cgroup holds, against what the vector storage occupies
|
||||||
|
# on disk. That ratio is what says a limit fits or does not.
|
||||||
|
"resident": _residency(stat),
|
||||||
|
"host": _host(),
|
||||||
|
}
|
||||||
|
path = E7 / f"memory-{label}.json"
|
||||||
|
_write(path, payload)
|
||||||
|
print(json.dumps(payload["cgroup"], indent=2))
|
||||||
|
return payload
|
||||||
|
|
||||||
|
|
||||||
|
# Qdrant keeps the originals and the quantized copy in separate files inside
|
||||||
|
# one directory per segment, so the structures the claims scope to can be sized
|
||||||
|
# from the filesystem: `matrix.dat` is the float32 originals, `quantized.data`
|
||||||
|
# the quantized copy, `vector_index-dense` the HNSW graph.
|
||||||
|
STRUCTURES = {
|
||||||
|
"originals": "segments/*/vector_storage-dense/matrix.dat",
|
||||||
|
"quantized": "segments/*/vector_storage-dense/quantized.data",
|
||||||
|
"graph": "segments/*/vector_index-dense",
|
||||||
|
"payload": "segments/*/payload_storage",
|
||||||
|
"id_tracker": "segments/*/id_tracker.mappings",
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def _residency(stat: str) -> dict:
|
||||||
|
"""File page cache the cgroup holds, against what each structure occupies
|
||||||
|
on disk. A `cached` original that is not in `file` was evicted anyway, so
|
||||||
|
the rule reads off this rather than off the placement label.
|
||||||
|
|
||||||
|
The counters come from the caller's single read of `memory.stat`. Reading
|
||||||
|
it twice produced an artifact quoting one counter at two values, four
|
||||||
|
refaults apart, which reads as a discrepancy rather than as a live counter.
|
||||||
|
"""
|
||||||
|
cache = {line.split()[0]: int(line.split()[1]) for line in stat.splitlines()}
|
||||||
|
root = "/qdrant/storage/collections/*/*"
|
||||||
|
# Apparent size and allocated blocks, because Qdrant preallocates payload
|
||||||
|
# storage sparsely: 242 MB apparent against 14.5 MB on disk at 100k points.
|
||||||
|
# The footprint claim uses blocks; the cache comparison uses the dense
|
||||||
|
# vector files, where the two agree.
|
||||||
|
on_disk, allocated = {}, {}
|
||||||
|
for name, pattern in STRUCTURES.items():
|
||||||
|
for label, flag, into in (("apparent", "-scb", on_disk), ("blocks", "-sc --block-size=1", allocated)):
|
||||||
|
out = _in_container(
|
||||||
|
f"du {flag} {root}/{pattern} 2>/dev/null | tail -1 | cut -f1", allow_empty=True
|
||||||
|
)
|
||||||
|
into[name] = int(out) if out.isdigit() else 0
|
||||||
|
total = sum(allocated.values())
|
||||||
|
blocks = int(_in_container("du -s --block-size=1 /qdrant/storage | cut -f1"))
|
||||||
|
return {
|
||||||
|
"file_cache_bytes": cache.get("file", 0),
|
||||||
|
"active_file_bytes": cache.get("active_file", 0),
|
||||||
|
"inactive_file_bytes": cache.get("inactive_file", 0),
|
||||||
|
"workingset_refault_file": cache.get("workingset_refault_file", 0),
|
||||||
|
"pgmajfault": cache.get("pgmajfault", 0),
|
||||||
|
"apparent_bytes": on_disk,
|
||||||
|
"on_disk_bytes": allocated,
|
||||||
|
"on_disk_total_bytes": total,
|
||||||
|
# Against the whole storage footprint rather than the five structures,
|
||||||
|
# because the cgroup's file cache also holds the WAL and the segment
|
||||||
|
# metadata, which would push a per-structure ratio above 1.
|
||||||
|
"storage_blocks_bytes": blocks,
|
||||||
|
"share_of_storage_cached": round(cache.get("file", 0) / blocks, 4) if blocks else None,
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
def _in_container(command: str, allow_empty: bool = False) -> str:
|
||||||
|
"""A silently empty reading looks like zero block reads, which is the one
|
||||||
|
wrong answer this experiment cannot afford, so a failed read raises."""
|
||||||
|
out = subprocess.run(
|
||||||
|
["docker", "exec", CONTAINER, "sh", "-c", command], capture_output=True, text=True
|
||||||
|
)
|
||||||
|
if not allow_empty and (out.returncode != 0 or not out.stdout.strip()):
|
||||||
|
raise SystemExit(f"reading {command!r} in {CONTAINER} failed: {out.stderr.strip()}")
|
||||||
|
return out.stdout.strip()
|
||||||
|
|
||||||
|
|
||||||
|
def _limit() -> str:
|
||||||
|
return _sh("docker", "inspect", "-f", "{{.HostConfig.Memory}}/{{.HostConfig.MemorySwap}}", CONTAINER)
|
||||||
|
|
||||||
|
|
||||||
|
def _host() -> dict:
|
||||||
|
"""The machine the numbers are true of, recorded with them."""
|
||||||
|
swap = _sh("sysctl", "-n", "vm.swapusage")
|
||||||
|
device = _sh("df", "-h", str(ROOT)).splitlines()[-1]
|
||||||
|
return {
|
||||||
|
"cpu": _sh("sysctl", "-n", "machdep.cpu.brand_string"),
|
||||||
|
# Reclaim behaviour depends on the kernel and on whether swap exists,
|
||||||
|
# so both are recorded with every reading rather than assumed.
|
||||||
|
"vm_kernel": _sh("docker", "run", "--rm", "alpine", "uname", "-a"),
|
||||||
|
"docker_version": _sh("docker", "version", "--format", "{{.Server.Version}}"),
|
||||||
|
"vm_swap_bytes": int(
|
||||||
|
_sh("docker", "run", "--rm", "alpine", "awk", "/^SwapTotal:/{print $2*1024}",
|
||||||
|
"/proc/meminfo")
|
||||||
|
),
|
||||||
|
"vm_page_cache_bytes": _vm_cache(),
|
||||||
|
"cores": int(_sh("sysctl", "-n", "hw.ncpu")),
|
||||||
|
"memory_bytes": int(_sh("sysctl", "-n", "hw.memsize")),
|
||||||
|
"host_swap": swap,
|
||||||
|
"docker_vm_memory_bytes": int(_sh("docker", "info", "--format", "{{.MemTotal}}")),
|
||||||
|
"storage_device": device,
|
||||||
|
"image": IMAGE,
|
||||||
|
}
|
||||||
|
|
||||||
|
|
||||||
|
TASKS = {
|
||||||
|
"cold": cold,
|
||||||
|
"corpus": corpus,
|
||||||
|
"embed": embed,
|
||||||
|
"queries": queries,
|
||||||
|
"up": up,
|
||||||
|
"ingest": ingest,
|
||||||
|
"warm": warm,
|
||||||
|
"mem": mem,
|
||||||
|
}
|
||||||
|
|
||||||
|
if __name__ == "__main__":
|
||||||
|
if len(sys.argv) < 2 or sys.argv[1] not in TASKS:
|
||||||
|
raise SystemExit(f"usage: python e7.py [{' | '.join(TASKS)}] [arg]")
|
||||||
|
TASKS[sys.argv[1]](*sys.argv[2:])
|
||||||
@@ -0,0 +1,606 @@
|
|||||||
|
{
|
||||||
|
"e7a": {
|
||||||
|
"cells": [
|
||||||
|
{
|
||||||
|
"oversampling": null,
|
||||||
|
"rescore": null,
|
||||||
|
"storage": "float32"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": null,
|
||||||
|
"rescore": false,
|
||||||
|
"storage": "int8"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 1.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "int8"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 2.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "int8"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 4.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "int8"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": null,
|
||||||
|
"rescore": false,
|
||||||
|
"storage": "turbo_bits4"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 1.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "turbo_bits4"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 2.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "turbo_bits4"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 4.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "turbo_bits4"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": null,
|
||||||
|
"rescore": false,
|
||||||
|
"storage": "turbo_bits1"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 1.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "turbo_bits1"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 2.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "turbo_bits1"
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"oversampling": 4.0,
|
||||||
|
"rescore": true,
|
||||||
|
"storage": "turbo_bits1"
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"count": 13,
|
||||||
|
"decision_rule": "smallest storage class whose held-out nDCG@10 is within 0.01 of float32 and whose exact top-10 retention is within 0.02; at that class the lowest oversampling clearing both. Selection on one query half, reporting on the other. If no cell clears, the rule returns nothing and the article routes the reader to a larger class, more candidate depth, or an accepted loss.",
|
||||||
|
"oversampling": [
|
||||||
|
1.0,
|
||||||
|
2.0,
|
||||||
|
4.0
|
||||||
|
],
|
||||||
|
"query_split": {
|
||||||
|
"report": [
|
||||||
|
"INEX_LD-2009039",
|
||||||
|
"INEX_LD-2009062",
|
||||||
|
"INEX_LD-2009063",
|
||||||
|
"INEX_LD-2009074",
|
||||||
|
"INEX_LD-2009115",
|
||||||
|
"INEX_LD-2010014",
|
||||||
|
"INEX_LD-2010019",
|
||||||
|
"INEX_LD-2010020",
|
||||||
|
"INEX_LD-2010043",
|
||||||
|
"INEX_LD-2010057",
|
||||||
|
"INEX_LD-2010069",
|
||||||
|
"INEX_LD-2010100",
|
||||||
|
"INEX_LD-2010106",
|
||||||
|
"INEX_LD-20120111",
|
||||||
|
"INEX_LD-20120122",
|
||||||
|
"INEX_LD-20120131",
|
||||||
|
"INEX_LD-20120211",
|
||||||
|
"INEX_LD-20120221",
|
||||||
|
"INEX_LD-20120321",
|
||||||
|
"INEX_LD-20120411",
|
||||||
|
"INEX_LD-20120412",
|
||||||
|
"INEX_LD-20120422",
|
||||||
|
"INEX_LD-20120431",
|
||||||
|
"INEX_LD-20120511",
|
||||||
|
"INEX_LD-20120512",
|
||||||
|
"INEX_LD-20120522",
|
||||||
|
"INEX_LD-20120532",
|
||||||
|
"INEX_LD-2012301",
|
||||||
|
"INEX_LD-2012303",
|
||||||
|
"INEX_LD-2012315",
|
||||||
|
"INEX_LD-2012317",
|
||||||
|
"INEX_LD-2012321",
|
||||||
|
"INEX_LD-2012331",
|
||||||
|
"INEX_LD-2012335",
|
||||||
|
"INEX_LD-2012337",
|
||||||
|
"INEX_LD-2012345",
|
||||||
|
"INEX_LD-2012353",
|
||||||
|
"INEX_LD-2012354",
|
||||||
|
"INEX_LD-2012359",
|
||||||
|
"INEX_LD-2012365",
|
||||||
|
"INEX_LD-2012371",
|
||||||
|
"INEX_LD-2012373",
|
||||||
|
"INEX_LD-2012381",
|
||||||
|
"INEX_LD-2012383",
|
||||||
|
"INEX_LD-2012387",
|
||||||
|
"INEX_XER-108",
|
||||||
|
"INEX_XER-110",
|
||||||
|
"INEX_XER-113",
|
||||||
|
"INEX_XER-115",
|
||||||
|
"INEX_XER-117",
|
||||||
|
"INEX_XER-118",
|
||||||
|
"INEX_XER-119",
|
||||||
|
"INEX_XER-121",
|
||||||
|
"INEX_XER-123",
|
||||||
|
"INEX_XER-127",
|
||||||
|
"INEX_XER-130",
|
||||||
|
"INEX_XER-132",
|
||||||
|
"INEX_XER-134",
|
||||||
|
"INEX_XER-135",
|
||||||
|
"INEX_XER-139",
|
||||||
|
"INEX_XER-140",
|
||||||
|
"INEX_XER-141",
|
||||||
|
"INEX_XER-143",
|
||||||
|
"INEX_XER-144",
|
||||||
|
"INEX_XER-147",
|
||||||
|
"INEX_XER-62",
|
||||||
|
"INEX_XER-63",
|
||||||
|
"INEX_XER-67",
|
||||||
|
"INEX_XER-72",
|
||||||
|
"INEX_XER-74",
|
||||||
|
"INEX_XER-79",
|
||||||
|
"INEX_XER-86",
|
||||||
|
"INEX_XER-91",
|
||||||
|
"INEX_XER-94",
|
||||||
|
"INEX_XER-95",
|
||||||
|
"QALD2_te-11",
|
||||||
|
"QALD2_te-12",
|
||||||
|
"QALD2_te-14",
|
||||||
|
"QALD2_te-2",
|
||||||
|
"QALD2_te-21",
|
||||||
|
"QALD2_te-35",
|
||||||
|
"QALD2_te-40",
|
||||||
|
"QALD2_te-43",
|
||||||
|
"QALD2_te-45",
|
||||||
|
"QALD2_te-46",
|
||||||
|
"QALD2_te-48",
|
||||||
|
"QALD2_te-49",
|
||||||
|
"QALD2_te-5",
|
||||||
|
"QALD2_te-51",
|
||||||
|
"QALD2_te-53",
|
||||||
|
"QALD2_te-59",
|
||||||
|
"QALD2_te-63",
|
||||||
|
"QALD2_te-66",
|
||||||
|
"QALD2_te-72",
|
||||||
|
"QALD2_te-76",
|
||||||
|
"QALD2_te-82",
|
||||||
|
"QALD2_te-9",
|
||||||
|
"QALD2_te-90",
|
||||||
|
"QALD2_te-91",
|
||||||
|
"QALD2_te-92",
|
||||||
|
"QALD2_te-93",
|
||||||
|
"QALD2_te-99",
|
||||||
|
"QALD2_tr-1",
|
||||||
|
"QALD2_tr-15",
|
||||||
|
"QALD2_tr-18",
|
||||||
|
"QALD2_tr-25",
|
||||||
|
"QALD2_tr-26",
|
||||||
|
"QALD2_tr-28",
|
||||||
|
"QALD2_tr-29",
|
||||||
|
"QALD2_tr-3",
|
||||||
|
"QALD2_tr-32",
|
||||||
|
"QALD2_tr-35",
|
||||||
|
"QALD2_tr-38",
|
||||||
|
"QALD2_tr-40",
|
||||||
|
"QALD2_tr-42",
|
||||||
|
"QALD2_tr-43",
|
||||||
|
"QALD2_tr-47",
|
||||||
|
"QALD2_tr-49",
|
||||||
|
"QALD2_tr-52",
|
||||||
|
"QALD2_tr-53",
|
||||||
|
"QALD2_tr-59",
|
||||||
|
"QALD2_tr-61",
|
||||||
|
"QALD2_tr-62",
|
||||||
|
"QALD2_tr-64",
|
||||||
|
"QALD2_tr-68",
|
||||||
|
"QALD2_tr-69",
|
||||||
|
"QALD2_tr-82",
|
||||||
|
"QALD2_tr-85",
|
||||||
|
"QALD2_tr-87",
|
||||||
|
"SemSearch_ES-1",
|
||||||
|
"SemSearch_ES-100",
|
||||||
|
"SemSearch_ES-102",
|
||||||
|
"SemSearch_ES-107",
|
||||||
|
"SemSearch_ES-108",
|
||||||
|
"SemSearch_ES-118",
|
||||||
|
"SemSearch_ES-119",
|
||||||
|
"SemSearch_ES-120",
|
||||||
|
"SemSearch_ES-123",
|
||||||
|
"SemSearch_ES-124",
|
||||||
|
"SemSearch_ES-125",
|
||||||
|
"SemSearch_ES-127",
|
||||||
|
"SemSearch_ES-128",
|
||||||
|
"SemSearch_ES-129",
|
||||||
|
"SemSearch_ES-130",
|
||||||
|
"SemSearch_ES-135",
|
||||||
|
"SemSearch_ES-139",
|
||||||
|
"SemSearch_ES-14",
|
||||||
|
"SemSearch_ES-16",
|
||||||
|
"SemSearch_ES-17",
|
||||||
|
"SemSearch_ES-19",
|
||||||
|
"SemSearch_ES-20",
|
||||||
|
"SemSearch_ES-23",
|
||||||
|
"SemSearch_ES-24",
|
||||||
|
"SemSearch_ES-29",
|
||||||
|
"SemSearch_ES-3",
|
||||||
|
"SemSearch_ES-32",
|
||||||
|
"SemSearch_ES-38",
|
||||||
|
"SemSearch_ES-4",
|
||||||
|
"SemSearch_ES-41",
|
||||||
|
"SemSearch_ES-5",
|
||||||
|
"SemSearch_ES-50",
|
||||||
|
"SemSearch_ES-52",
|
||||||
|
"SemSearch_ES-56",
|
||||||
|
"SemSearch_ES-58",
|
||||||
|
"SemSearch_ES-60",
|
||||||
|
"SemSearch_ES-71",
|
||||||
|
"SemSearch_ES-72",
|
||||||
|
"SemSearch_ES-74",
|
||||||
|
"SemSearch_ES-77",
|
||||||
|
"SemSearch_ES-83",
|
||||||
|
"SemSearch_ES-84",
|
||||||
|
"SemSearch_ES-85",
|
||||||
|
"SemSearch_ES-86",
|
||||||
|
"SemSearch_ES-89",
|
||||||
|
"SemSearch_ES-91",
|
||||||
|
"SemSearch_ES-95",
|
||||||
|
"SemSearch_ES-96",
|
||||||
|
"SemSearch_ES-97",
|
||||||
|
"SemSearch_LS-11",
|
||||||
|
"SemSearch_LS-14",
|
||||||
|
"SemSearch_LS-16",
|
||||||
|
"SemSearch_LS-18",
|
||||||
|
"SemSearch_LS-2",
|
||||||
|
"SemSearch_LS-20",
|
||||||
|
"SemSearch_LS-26",
|
||||||
|
"SemSearch_LS-29",
|
||||||
|
"SemSearch_LS-3",
|
||||||
|
"SemSearch_LS-32",
|
||||||
|
"SemSearch_LS-34",
|
||||||
|
"SemSearch_LS-35",
|
||||||
|
"SemSearch_LS-41",
|
||||||
|
"SemSearch_LS-46",
|
||||||
|
"SemSearch_LS-50",
|
||||||
|
"SemSearch_LS-8",
|
||||||
|
"TREC_Entity-10",
|
||||||
|
"TREC_Entity-11",
|
||||||
|
"TREC_Entity-12",
|
||||||
|
"TREC_Entity-16",
|
||||||
|
"TREC_Entity-20",
|
||||||
|
"TREC_Entity-9"
|
||||||
|
],
|
||||||
|
"seed": 42,
|
||||||
|
"select": [
|
||||||
|
"INEX_LD-2009022",
|
||||||
|
"INEX_LD-2009053",
|
||||||
|
"INEX_LD-2009061",
|
||||||
|
"INEX_LD-2010004",
|
||||||
|
"INEX_LD-2010037",
|
||||||
|
"INEX_LD-20120121",
|
||||||
|
"INEX_LD-20120231",
|
||||||
|
"INEX_LD-20120232",
|
||||||
|
"INEX_LD-20120311",
|
||||||
|
"INEX_LD-20120312",
|
||||||
|
"INEX_LD-20120331",
|
||||||
|
"INEX_LD-20120332",
|
||||||
|
"INEX_LD-20120421",
|
||||||
|
"INEX_LD-20120521",
|
||||||
|
"INEX_LD-20120531",
|
||||||
|
"INEX_LD-2012305",
|
||||||
|
"INEX_LD-2012309",
|
||||||
|
"INEX_LD-2012311",
|
||||||
|
"INEX_LD-2012313",
|
||||||
|
"INEX_LD-2012318",
|
||||||
|
"INEX_LD-2012319",
|
||||||
|
"INEX_LD-2012323",
|
||||||
|
"INEX_LD-2012325",
|
||||||
|
"INEX_LD-2012327",
|
||||||
|
"INEX_LD-2012329",
|
||||||
|
"INEX_LD-2012333",
|
||||||
|
"INEX_LD-2012339",
|
||||||
|
"INEX_LD-2012341",
|
||||||
|
"INEX_LD-2012349",
|
||||||
|
"INEX_LD-2012355",
|
||||||
|
"INEX_LD-2012357",
|
||||||
|
"INEX_LD-2012361",
|
||||||
|
"INEX_LD-2012367",
|
||||||
|
"INEX_LD-2012369",
|
||||||
|
"INEX_LD-2012372",
|
||||||
|
"INEX_LD-2012377",
|
||||||
|
"INEX_LD-2012385",
|
||||||
|
"INEX_LD-2012389",
|
||||||
|
"INEX_LD-2012390",
|
||||||
|
"INEX_XER-106",
|
||||||
|
"INEX_XER-109",
|
||||||
|
"INEX_XER-114",
|
||||||
|
"INEX_XER-116",
|
||||||
|
"INEX_XER-122",
|
||||||
|
"INEX_XER-124",
|
||||||
|
"INEX_XER-128",
|
||||||
|
"INEX_XER-129",
|
||||||
|
"INEX_XER-133",
|
||||||
|
"INEX_XER-136",
|
||||||
|
"INEX_XER-138",
|
||||||
|
"INEX_XER-60",
|
||||||
|
"INEX_XER-64",
|
||||||
|
"INEX_XER-65",
|
||||||
|
"INEX_XER-81",
|
||||||
|
"INEX_XER-87",
|
||||||
|
"INEX_XER-88",
|
||||||
|
"INEX_XER-96",
|
||||||
|
"INEX_XER-98",
|
||||||
|
"INEX_XER-99",
|
||||||
|
"QALD2_te-1",
|
||||||
|
"QALD2_te-100",
|
||||||
|
"QALD2_te-13",
|
||||||
|
"QALD2_te-17",
|
||||||
|
"QALD2_te-22",
|
||||||
|
"QALD2_te-24",
|
||||||
|
"QALD2_te-25",
|
||||||
|
"QALD2_te-27",
|
||||||
|
"QALD2_te-28",
|
||||||
|
"QALD2_te-3",
|
||||||
|
"QALD2_te-31",
|
||||||
|
"QALD2_te-33",
|
||||||
|
"QALD2_te-39",
|
||||||
|
"QALD2_te-42",
|
||||||
|
"QALD2_te-44",
|
||||||
|
"QALD2_te-55",
|
||||||
|
"QALD2_te-57",
|
||||||
|
"QALD2_te-58",
|
||||||
|
"QALD2_te-6",
|
||||||
|
"QALD2_te-60",
|
||||||
|
"QALD2_te-64",
|
||||||
|
"QALD2_te-65",
|
||||||
|
"QALD2_te-67",
|
||||||
|
"QALD2_te-75",
|
||||||
|
"QALD2_te-77",
|
||||||
|
"QALD2_te-8",
|
||||||
|
"QALD2_te-80",
|
||||||
|
"QALD2_te-81",
|
||||||
|
"QALD2_te-84",
|
||||||
|
"QALD2_te-88",
|
||||||
|
"QALD2_te-89",
|
||||||
|
"QALD2_te-95",
|
||||||
|
"QALD2_te-97",
|
||||||
|
"QALD2_te-98",
|
||||||
|
"QALD2_tr-10",
|
||||||
|
"QALD2_tr-11",
|
||||||
|
"QALD2_tr-13",
|
||||||
|
"QALD2_tr-16",
|
||||||
|
"QALD2_tr-17",
|
||||||
|
"QALD2_tr-21",
|
||||||
|
"QALD2_tr-24",
|
||||||
|
"QALD2_tr-30",
|
||||||
|
"QALD2_tr-31",
|
||||||
|
"QALD2_tr-34",
|
||||||
|
"QALD2_tr-36",
|
||||||
|
"QALD2_tr-4",
|
||||||
|
"QALD2_tr-41",
|
||||||
|
"QALD2_tr-45",
|
||||||
|
"QALD2_tr-50",
|
||||||
|
"QALD2_tr-51",
|
||||||
|
"QALD2_tr-54",
|
||||||
|
"QALD2_tr-55",
|
||||||
|
"QALD2_tr-57",
|
||||||
|
"QALD2_tr-58",
|
||||||
|
"QALD2_tr-6",
|
||||||
|
"QALD2_tr-65",
|
||||||
|
"QALD2_tr-70",
|
||||||
|
"QALD2_tr-71",
|
||||||
|
"QALD2_tr-74",
|
||||||
|
"QALD2_tr-75",
|
||||||
|
"QALD2_tr-77",
|
||||||
|
"QALD2_tr-78",
|
||||||
|
"QALD2_tr-79",
|
||||||
|
"QALD2_tr-8",
|
||||||
|
"QALD2_tr-80",
|
||||||
|
"QALD2_tr-81",
|
||||||
|
"QALD2_tr-83",
|
||||||
|
"QALD2_tr-84",
|
||||||
|
"QALD2_tr-89",
|
||||||
|
"QALD2_tr-9",
|
||||||
|
"QALD2_tr-91",
|
||||||
|
"SemSearch_ES-10",
|
||||||
|
"SemSearch_ES-101",
|
||||||
|
"SemSearch_ES-104",
|
||||||
|
"SemSearch_ES-106",
|
||||||
|
"SemSearch_ES-11",
|
||||||
|
"SemSearch_ES-111",
|
||||||
|
"SemSearch_ES-114",
|
||||||
|
"SemSearch_ES-115",
|
||||||
|
"SemSearch_ES-13",
|
||||||
|
"SemSearch_ES-132",
|
||||||
|
"SemSearch_ES-136",
|
||||||
|
"SemSearch_ES-15",
|
||||||
|
"SemSearch_ES-18",
|
||||||
|
"SemSearch_ES-2",
|
||||||
|
"SemSearch_ES-21",
|
||||||
|
"SemSearch_ES-25",
|
||||||
|
"SemSearch_ES-26",
|
||||||
|
"SemSearch_ES-30",
|
||||||
|
"SemSearch_ES-33",
|
||||||
|
"SemSearch_ES-36",
|
||||||
|
"SemSearch_ES-39",
|
||||||
|
"SemSearch_ES-45",
|
||||||
|
"SemSearch_ES-47",
|
||||||
|
"SemSearch_ES-49",
|
||||||
|
"SemSearch_ES-59",
|
||||||
|
"SemSearch_ES-6",
|
||||||
|
"SemSearch_ES-61",
|
||||||
|
"SemSearch_ES-7",
|
||||||
|
"SemSearch_ES-75",
|
||||||
|
"SemSearch_ES-76",
|
||||||
|
"SemSearch_ES-78",
|
||||||
|
"SemSearch_ES-80",
|
||||||
|
"SemSearch_ES-82",
|
||||||
|
"SemSearch_ES-88",
|
||||||
|
"SemSearch_ES-9",
|
||||||
|
"SemSearch_ES-90",
|
||||||
|
"SemSearch_ES-98",
|
||||||
|
"SemSearch_LS-1",
|
||||||
|
"SemSearch_LS-10",
|
||||||
|
"SemSearch_LS-12",
|
||||||
|
"SemSearch_LS-13",
|
||||||
|
"SemSearch_LS-21",
|
||||||
|
"SemSearch_LS-22",
|
||||||
|
"SemSearch_LS-24",
|
||||||
|
"SemSearch_LS-25",
|
||||||
|
"SemSearch_LS-30",
|
||||||
|
"SemSearch_LS-31",
|
||||||
|
"SemSearch_LS-33",
|
||||||
|
"SemSearch_LS-36",
|
||||||
|
"SemSearch_LS-37",
|
||||||
|
"SemSearch_LS-38",
|
||||||
|
"SemSearch_LS-39",
|
||||||
|
"SemSearch_LS-4",
|
||||||
|
"SemSearch_LS-42",
|
||||||
|
"SemSearch_LS-43",
|
||||||
|
"SemSearch_LS-44",
|
||||||
|
"SemSearch_LS-49",
|
||||||
|
"SemSearch_LS-6",
|
||||||
|
"SemSearch_LS-7",
|
||||||
|
"SemSearch_LS-9",
|
||||||
|
"TREC_Entity-1",
|
||||||
|
"TREC_Entity-14",
|
||||||
|
"TREC_Entity-15",
|
||||||
|
"TREC_Entity-18",
|
||||||
|
"TREC_Entity-19",
|
||||||
|
"TREC_Entity-2",
|
||||||
|
"TREC_Entity-4",
|
||||||
|
"TREC_Entity-5",
|
||||||
|
"TREC_Entity-6",
|
||||||
|
"TREC_Entity-7"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
"retention_definition": "|top-10 the cell returned, intersected with the top-10 of an exact=True float32 search on the same query| / 10, measured on the list the reader receives, which is after rescore where rescore is on. Ties inside the exact top-10 are kept as the server ordered them, since the intersection does not depend on their order.",
|
||||||
|
"storage_classes": [
|
||||||
|
"float32",
|
||||||
|
"int8",
|
||||||
|
"turbo_bits4",
|
||||||
|
"turbo_bits1"
|
||||||
|
],
|
||||||
|
"tolerance": {
|
||||||
|
"exact_top10_retention": 0.02,
|
||||||
|
"ndcg_at_10": 0.01
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"e7b": {
|
||||||
|
"cells": [
|
||||||
|
{
|
||||||
|
"control": true,
|
||||||
|
"limit": "12g",
|
||||||
|
"originals": "cached",
|
||||||
|
"placement": "cached_pinned",
|
||||||
|
"quantized": "pinned",
|
||||||
|
"regime": "fits",
|
||||||
|
"rescore": false
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"control": false,
|
||||||
|
"limit": "12g",
|
||||||
|
"originals": "cached",
|
||||||
|
"placement": "cached_pinned",
|
||||||
|
"quantized": "pinned",
|
||||||
|
"regime": "fits",
|
||||||
|
"rescore": true
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"control": true,
|
||||||
|
"limit": "4g",
|
||||||
|
"originals": "cached",
|
||||||
|
"placement": "cached_pinned",
|
||||||
|
"quantized": "pinned",
|
||||||
|
"regime": "exceeds",
|
||||||
|
"rescore": false
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"control": false,
|
||||||
|
"limit": "4g",
|
||||||
|
"originals": "cached",
|
||||||
|
"placement": "cached_pinned",
|
||||||
|
"quantized": "pinned",
|
||||||
|
"regime": "exceeds",
|
||||||
|
"rescore": true
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"control": false,
|
||||||
|
"limit": "4g",
|
||||||
|
"originals": "cold",
|
||||||
|
"placement": "cold_pinned",
|
||||||
|
"quantized": "pinned",
|
||||||
|
"regime": "exceeds",
|
||||||
|
"rescore": true
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"control": false,
|
||||||
|
"limit": "4g",
|
||||||
|
"originals": "cold",
|
||||||
|
"placement": "cold_cached",
|
||||||
|
"quantized": "cached",
|
||||||
|
"regime": "exceeds",
|
||||||
|
"rescore": true
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"cold_start_cells": [
|
||||||
|
{
|
||||||
|
"control": false,
|
||||||
|
"limit": "4g",
|
||||||
|
"originals": "cold",
|
||||||
|
"placement": "cold_pinned",
|
||||||
|
"quantized": "pinned",
|
||||||
|
"regime": "exceeds",
|
||||||
|
"rescore": true
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"control": false,
|
||||||
|
"limit": "4g",
|
||||||
|
"originals": "cold",
|
||||||
|
"placement": "cold_cached",
|
||||||
|
"quantized": "cached",
|
||||||
|
"regime": "exceeds",
|
||||||
|
"rescore": true
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"cold_start_count": 2,
|
||||||
|
"count": 6,
|
||||||
|
"limits": {
|
||||||
|
"exceeds": "4g",
|
||||||
|
"fits": "12g"
|
||||||
|
},
|
||||||
|
"negative_control": "the rescore=False rows. Moving originals between cached and cold with no reread should not move latency; if it does, the cold rows carry no claim.",
|
||||||
|
"per_cell_protocol": [
|
||||||
|
"stop the container",
|
||||||
|
"sync, drop the VM page cache, verify it fell to its floor",
|
||||||
|
"start a fresh container at the cell's limit",
|
||||||
|
"wait for green",
|
||||||
|
"apply the cell's storage class and placements, wait for green again",
|
||||||
|
"one fixed warm-up pass at the cell's depth",
|
||||||
|
"the measured pass",
|
||||||
|
"record memory, io.stat and timings, then stop"
|
||||||
|
],
|
||||||
|
"repeats": 3,
|
||||||
|
"reported_arm": "warmed. Every cell starts from a controlled cache state and takes the same fixed warm-up pass before its measured pass. Settings are not randomized inside one long-lived container: under a tight limit the previous cell's pages decide which of this cell's pages survive.",
|
||||||
|
"reported_statistic": "paired relative change within a cell pair, with p50, p95 and the spread across independent starts. Absolute milliseconds ship as evidence for one stated machine, never as a target a reader compares against.",
|
||||||
|
"runs_total": 18
|
||||||
|
},
|
||||||
|
"held_fixed": {
|
||||||
|
"candidate_depth": 200,
|
||||||
|
"hnsw_ef": 128,
|
||||||
|
"metrics_at": 10,
|
||||||
|
"originals_reread_per_query": {
|
||||||
|
"1.0": 200,
|
||||||
|
"2.0": 400,
|
||||||
|
"4.0": 800
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"registered": "pre-run, section 8 forbids additions after this file is written"
|
||||||
|
}
|
||||||
@@ -0,0 +1,7 @@
|
|||||||
|
{
|
||||||
|
"host_purge_ran": false,
|
||||||
|
"host_swap_after": "total = 6144.00M used = 5241.19M free = 902.81M (encrypted)",
|
||||||
|
"limit": "12g",
|
||||||
|
"vm_cache_after_bytes": 80240640,
|
||||||
|
"vm_cache_before_bytes": 10802790400
|
||||||
|
}
|
||||||
@@ -0,0 +1,7 @@
|
|||||||
|
{
|
||||||
|
"host_purge_ran": false,
|
||||||
|
"host_swap_after": "total = 6144.00M used = 5007.69M free = 1136.31M (encrypted)",
|
||||||
|
"limit": "4g",
|
||||||
|
"vm_cache_after_bytes": 80736256,
|
||||||
|
"vm_cache_before_bytes": 8133787648
|
||||||
|
}
|
||||||
@@ -0,0 +1,20 @@
|
|||||||
|
{
|
||||||
|
"avg_len": 33.3019,
|
||||||
|
"avg_raw_tokens": 51.3299,
|
||||||
|
"corpus": "dbpedia-full",
|
||||||
|
"doc_id_sha256": "b3939fdfe1cead242b7ff890cf6017207e6a689ae3dce96cbe28e724807a96b5",
|
||||||
|
"docs": 4635922,
|
||||||
|
"field_recipe": "title + \" \" + text",
|
||||||
|
"license": "CC BY-SA 3.0",
|
||||||
|
"load_seconds": 20.9,
|
||||||
|
"max_relevance": 2,
|
||||||
|
"qrels": 43515,
|
||||||
|
"queries": 400,
|
||||||
|
"relevant_per_query": 38.215,
|
||||||
|
"source": {
|
||||||
|
"bytes": 639285131,
|
||||||
|
"file": "dbpedia-entity.zip",
|
||||||
|
"sha256": "e4c13080b5399a19e02b04c908c485f8997ac9e265a06ef5f9f28c3f1134c472",
|
||||||
|
"url": "https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/dbpedia-entity.zip"
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,188 @@
|
|||||||
|
embedding 4635922 of 4635922 from row 0
|
||||||
|
25600/4635922 346 docs/s 222 min left
|
||||||
|
51200/4635922 281 docs/s 272 min left
|
||||||
|
76800/4635922 241 docs/s 315 min left
|
||||||
|
102400/4635922 232 docs/s 326 min left
|
||||||
|
128000/4635922 225 docs/s 334 min left
|
||||||
|
153600/4635922 221 docs/s 338 min left
|
||||||
|
179200/4635922 218 docs/s 341 min left
|
||||||
|
204800/4635922 216 docs/s 342 min left
|
||||||
|
230400/4635922 215 docs/s 342 min left
|
||||||
|
250000/4635922 214 docs/s 342 min left
|
||||||
|
275600/4635922 213 docs/s 341 min left
|
||||||
|
301200/4635922 211 docs/s 342 min left
|
||||||
|
326800/4635922 210 docs/s 343 min left
|
||||||
|
352400/4635922 209 docs/s 341 min left
|
||||||
|
378000/4635922 209 docs/s 340 min left
|
||||||
|
403600/4635922 209 docs/s 337 min left
|
||||||
|
429200/4635922 209 docs/s 335 min left
|
||||||
|
454800/4635922 209 docs/s 333 min left
|
||||||
|
480400/4635922 209 docs/s 331 min left
|
||||||
|
500000/4635922 209 docs/s 330 min left
|
||||||
|
525600/4635922 209 docs/s 328 min left
|
||||||
|
551200/4635922 209 docs/s 326 min left
|
||||||
|
576800/4635922 209 docs/s 324 min left
|
||||||
|
602400/4635922 209 docs/s 322 min left
|
||||||
|
628000/4635922 209 docs/s 320 min left
|
||||||
|
653600/4635922 209 docs/s 318 min left
|
||||||
|
679200/4635922 208 docs/s 316 min left
|
||||||
|
704800/4635922 208 docs/s 314 min left
|
||||||
|
730400/4635922 208 docs/s 313 min left
|
||||||
|
750000/4635922 208 docs/s 311 min left
|
||||||
|
775600/4635922 208 docs/s 309 min left
|
||||||
|
801200/4635922 208 docs/s 307 min left
|
||||||
|
826800/4635922 208 docs/s 305 min left
|
||||||
|
852400/4635922 208 docs/s 304 min left
|
||||||
|
878000/4635922 208 docs/s 302 min left
|
||||||
|
903600/4635922 208 docs/s 300 min left
|
||||||
|
929200/4635922 208 docs/s 298 min left
|
||||||
|
954800/4635922 208 docs/s 295 min left
|
||||||
|
980400/4635922 208 docs/s 293 min left
|
||||||
|
1000000/4635922 208 docs/s 291 min left
|
||||||
|
1025600/4635922 210 docs/s 287 min left
|
||||||
|
1051200/4635922 212 docs/s 282 min left
|
||||||
|
1076800/4635922 214 docs/s 277 min left
|
||||||
|
1102400/4635922 216 docs/s 273 min left
|
||||||
|
1128000/4635922 218 docs/s 268 min left
|
||||||
|
1153600/4635922 220 docs/s 264 min left
|
||||||
|
1179200/4635922 221 docs/s 260 min left
|
||||||
|
1204800/4635922 223 docs/s 256 min left
|
||||||
|
1230400/4635922 225 docs/s 253 min left
|
||||||
|
1250000/4635922 226 docs/s 250 min left
|
||||||
|
1275600/4635922 228 docs/s 246 min left
|
||||||
|
1301200/4635922 229 docs/s 243 min left
|
||||||
|
1326800/4635922 231 docs/s 239 min left
|
||||||
|
1352400/4635922 232 docs/s 236 min left
|
||||||
|
1378000/4635922 234 docs/s 233 min left
|
||||||
|
1403600/4635922 235 docs/s 229 min left
|
||||||
|
1429200/4635922 236 docs/s 226 min left
|
||||||
|
1454800/4635922 237 docs/s 223 min left
|
||||||
|
1480400/4635922 239 docs/s 220 min left
|
||||||
|
1500000/4635922 240 docs/s 218 min left
|
||||||
|
1525600/4635922 241 docs/s 215 min left
|
||||||
|
1551200/4635922 242 docs/s 212 min left
|
||||||
|
1576800/4635922 243 docs/s 210 min left
|
||||||
|
1602400/4635922 244 docs/s 207 min left
|
||||||
|
1628000/4635922 245 docs/s 204 min left
|
||||||
|
1653600/4635922 246 docs/s 202 min left
|
||||||
|
1679200/4635922 247 docs/s 199 min left
|
||||||
|
1704800/4635922 249 docs/s 197 min left
|
||||||
|
1730400/4635922 250 docs/s 194 min left
|
||||||
|
1750000/4635922 250 docs/s 192 min left
|
||||||
|
1775600/4635922 251 docs/s 190 min left
|
||||||
|
1801200/4635922 252 docs/s 188 min left
|
||||||
|
1826800/4635922 253 docs/s 185 min left
|
||||||
|
1852400/4635922 254 docs/s 183 min left
|
||||||
|
1878000/4635922 255 docs/s 181 min left
|
||||||
|
1903600/4635922 255 docs/s 178 min left
|
||||||
|
1929200/4635922 256 docs/s 176 min left
|
||||||
|
1954800/4635922 257 docs/s 174 min left
|
||||||
|
1980400/4635922 258 docs/s 172 min left
|
||||||
|
2000000/4635922 258 docs/s 170 min left
|
||||||
|
2025600/4635922 259 docs/s 168 min left
|
||||||
|
2051200/4635922 260 docs/s 166 min left
|
||||||
|
2076800/4635922 261 docs/s 164 min left
|
||||||
|
2102400/4635922 262 docs/s 161 min left
|
||||||
|
2128000/4635922 262 docs/s 159 min left
|
||||||
|
2153600/4635922 263 docs/s 157 min left
|
||||||
|
2179200/4635922 264 docs/s 155 min left
|
||||||
|
2204800/4635922 265 docs/s 153 min left
|
||||||
|
2230400/4635922 265 docs/s 151 min left
|
||||||
|
2250000/4635922 266 docs/s 149 min left
|
||||||
|
2275600/4635922 267 docs/s 147 min left
|
||||||
|
2301200/4635922 267 docs/s 145 min left
|
||||||
|
2326800/4635922 268 docs/s 144 min left
|
||||||
|
2352400/4635922 269 docs/s 142 min left
|
||||||
|
2378000/4635922 270 docs/s 140 min left
|
||||||
|
2403600/4635922 270 docs/s 138 min left
|
||||||
|
2429200/4635922 271 docs/s 136 min left
|
||||||
|
2454800/4635922 272 docs/s 134 min left
|
||||||
|
2480400/4635922 272 docs/s 132 min left
|
||||||
|
2500000/4635922 273 docs/s 131 min left
|
||||||
|
2525600/4635922 273 docs/s 129 min left
|
||||||
|
2551200/4635922 274 docs/s 127 min left
|
||||||
|
2576800/4635922 275 docs/s 125 min left
|
||||||
|
2602400/4635922 275 docs/s 123 min left
|
||||||
|
2628000/4635922 276 docs/s 121 min left
|
||||||
|
2653600/4635922 276 docs/s 120 min left
|
||||||
|
2679200/4635922 277 docs/s 118 min left
|
||||||
|
2704800/4635922 277 docs/s 116 min left
|
||||||
|
2730400/4635922 278 docs/s 114 min left
|
||||||
|
2750000/4635922 278 docs/s 113 min left
|
||||||
|
2775600/4635922 279 docs/s 111 min left
|
||||||
|
2801200/4635922 279 docs/s 109 min left
|
||||||
|
2826800/4635922 280 docs/s 108 min left
|
||||||
|
2852400/4635922 280 docs/s 106 min left
|
||||||
|
2878000/4635922 281 docs/s 104 min left
|
||||||
|
2903600/4635922 281 docs/s 103 min left
|
||||||
|
2929200/4635922 282 docs/s 101 min left
|
||||||
|
2954800/4635922 282 docs/s 99 min left
|
||||||
|
2980400/4635922 283 docs/s 98 min left
|
||||||
|
3000000/4635922 283 docs/s 96 min left
|
||||||
|
3025600/4635922 284 docs/s 95 min left
|
||||||
|
3051200/4635922 284 docs/s 93 min left
|
||||||
|
3076800/4635922 285 docs/s 91 min left
|
||||||
|
3102400/4635922 285 docs/s 90 min left
|
||||||
|
3128000/4635922 285 docs/s 88 min left
|
||||||
|
3153600/4635922 286 docs/s 86 min left
|
||||||
|
3179200/4635922 286 docs/s 85 min left
|
||||||
|
3204800/4635922 287 docs/s 83 min left
|
||||||
|
3230400/4635922 287 docs/s 82 min left
|
||||||
|
3250000/4635922 287 docs/s 80 min left
|
||||||
|
3275600/4635922 288 docs/s 79 min left
|
||||||
|
3301200/4635922 288 docs/s 77 min left
|
||||||
|
3326800/4635922 289 docs/s 76 min left
|
||||||
|
3352400/4635922 289 docs/s 74 min left
|
||||||
|
3378000/4635922 289 docs/s 72 min left
|
||||||
|
3403600/4635922 290 docs/s 71 min left
|
||||||
|
3429200/4635922 290 docs/s 69 min left
|
||||||
|
3454800/4635922 291 docs/s 68 min left
|
||||||
|
3480400/4635922 291 docs/s 66 min left
|
||||||
|
3500000/4635922 291 docs/s 65 min left
|
||||||
|
3525600/4635922 292 docs/s 63 min left
|
||||||
|
3551200/4635922 292 docs/s 62 min left
|
||||||
|
3576800/4635922 292 docs/s 60 min left
|
||||||
|
3602400/4635922 293 docs/s 59 min left
|
||||||
|
3628000/4635922 293 docs/s 57 min left
|
||||||
|
3653600/4635922 293 docs/s 56 min left
|
||||||
|
3679200/4635922 294 docs/s 54 min left
|
||||||
|
3704800/4635922 294 docs/s 53 min left
|
||||||
|
3730400/4635922 294 docs/s 51 min left
|
||||||
|
3750000/4635922 295 docs/s 50 min left
|
||||||
|
3775600/4635922 295 docs/s 49 min left
|
||||||
|
3801200/4635922 295 docs/s 47 min left
|
||||||
|
3826800/4635922 296 docs/s 46 min left
|
||||||
|
3852400/4635922 296 docs/s 44 min left
|
||||||
|
3878000/4635922 296 docs/s 43 min left
|
||||||
|
3903600/4635922 296 docs/s 41 min left
|
||||||
|
3929200/4635922 297 docs/s 40 min left
|
||||||
|
3954800/4635922 297 docs/s 38 min left
|
||||||
|
3980400/4635922 297 docs/s 37 min left
|
||||||
|
4000000/4635922 297 docs/s 36 min left
|
||||||
|
4025600/4635922 298 docs/s 34 min left
|
||||||
|
4051200/4635922 298 docs/s 33 min left
|
||||||
|
4076800/4635922 298 docs/s 31 min left
|
||||||
|
4102400/4635922 299 docs/s 30 min left
|
||||||
|
4128000/4635922 299 docs/s 28 min left
|
||||||
|
4153600/4635922 299 docs/s 27 min left
|
||||||
|
4179200/4635922 299 docs/s 25 min left
|
||||||
|
4204800/4635922 300 docs/s 24 min left
|
||||||
|
4230400/4635922 300 docs/s 23 min left
|
||||||
|
4250000/4635922 300 docs/s 21 min left
|
||||||
|
4275600/4635922 300 docs/s 20 min left
|
||||||
|
4301200/4635922 300 docs/s 19 min left
|
||||||
|
4326800/4635922 301 docs/s 17 min left
|
||||||
|
4352400/4635922 301 docs/s 16 min left
|
||||||
|
4378000/4635922 301 docs/s 14 min left
|
||||||
|
4403600/4635922 301 docs/s 13 min left
|
||||||
|
4429200/4635922 302 docs/s 11 min left
|
||||||
|
4454800/4635922 302 docs/s 10 min left
|
||||||
|
4480400/4635922 302 docs/s 9 min left
|
||||||
|
4500000/4635922 302 docs/s 7 min left
|
||||||
|
4525600/4635922 302 docs/s 6 min left
|
||||||
|
4551200/4635922 303 docs/s 5 min left
|
||||||
|
4576800/4635922 303 docs/s 3 min left
|
||||||
|
4602400/4635922 303 docs/s 2 min left
|
||||||
|
4628000/4635922 303 docs/s 0 min left
|
||||||
|
4635922/4635922 303 docs/s 0 min left
|
||||||
|
4635922/4635922 303 docs/s 0 min left
|
||||||
@@ -0,0 +1,68 @@
|
|||||||
|
{
|
||||||
|
"collection": "dbpedia_full",
|
||||||
|
"config": {
|
||||||
|
"hnsw_config": {
|
||||||
|
"ef_construct": 100,
|
||||||
|
"full_scan_threshold": 10,
|
||||||
|
"inline_storage": null,
|
||||||
|
"m": 16,
|
||||||
|
"max_indexing_threads": 0,
|
||||||
|
"memory": null,
|
||||||
|
"on_disk": false,
|
||||||
|
"payload_m": null
|
||||||
|
},
|
||||||
|
"metadata": null,
|
||||||
|
"optimizer_config": {
|
||||||
|
"default_segment_number": 7,
|
||||||
|
"deleted_threshold": 0.2,
|
||||||
|
"flush_interval_sec": 5,
|
||||||
|
"indexing_threshold": 1,
|
||||||
|
"max_optimization_threads": null,
|
||||||
|
"max_segment_size": null,
|
||||||
|
"memmap_threshold": null,
|
||||||
|
"prevent_unoptimized": null,
|
||||||
|
"vacuum_min_vector_number": 1000
|
||||||
|
},
|
||||||
|
"params": {
|
||||||
|
"on_disk_payload": true,
|
||||||
|
"payload": null,
|
||||||
|
"read_fan_out_delay_ms": null,
|
||||||
|
"read_fan_out_factor": null,
|
||||||
|
"replication_factor": 1,
|
||||||
|
"shard_number": 1,
|
||||||
|
"sharding_method": null,
|
||||||
|
"sparse_vectors": null,
|
||||||
|
"vectors": {
|
||||||
|
"dense": {
|
||||||
|
"datatype": null,
|
||||||
|
"distance": "Cosine",
|
||||||
|
"hnsw_config": null,
|
||||||
|
"memory": null,
|
||||||
|
"multivector_config": null,
|
||||||
|
"on_disk": null,
|
||||||
|
"quantization_config": null,
|
||||||
|
"size": 384
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"write_consistency_factor": 1
|
||||||
|
},
|
||||||
|
"quantization_config": null,
|
||||||
|
"strict_mode_config": null,
|
||||||
|
"wal_config": {
|
||||||
|
"wal_capacity_mb": 32,
|
||||||
|
"wal_retain_closed": 1,
|
||||||
|
"wal_segments_ahead": 0
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"documents": 4635922,
|
||||||
|
"index_seconds": 510.6,
|
||||||
|
"indexed_vectors_count": 4635922,
|
||||||
|
"memory_limit": "12884901888/12884901888",
|
||||||
|
"points_count": 4635922,
|
||||||
|
"segments": 7,
|
||||||
|
"segments_count": 7,
|
||||||
|
"status": "green",
|
||||||
|
"upload_seconds": 730.1,
|
||||||
|
"vectors": "dense only, no sparse prefetch"
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:53:15-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=16474841088 wbytes=26204676096 rios=1045608 wios=88271 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10460831744",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 6441\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 6441\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12884901888",
|
||||||
|
"memory.stat": "anon 2076409856\nfile 7073300480\npagetables 26554368\nsock 0\ninactive_file 6648156160\nactive_file 425160704\nslab 100942120\nworkingset_refault_file 1826999\nworkingset_activate_file 1826999\npgscan 3451776\npgsteal 3451772\npgmajfault 3178214",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "3.549GiB / 12GiB|29.58%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13341.50M free = 994.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 412Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 67e6b33a62b5 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7917817856,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "built-12g",
|
||||||
|
"qdrant_rss_bytes": 9061425152,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 425648128,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372590356,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7073845248,
|
||||||
|
"inactive_file_bytes": 6648213504,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372670464,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222093312,
|
||||||
|
"pgmajfault": 3178218,
|
||||||
|
"share_of_storage_cached": 0.8054,
|
||||||
|
"storage_blocks_bytes": 8782569472,
|
||||||
|
"workingset_refault_file": 1827000
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028718606,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928054029\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n0\t/qdrant/storage/collections/dbpedia_full/0/temp_segments\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782569472
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-13T11:54:41-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8931938304 wbytes=4069478400 rios=649516 wios=3776 dbytes=0 dios=0",
|
||||||
|
"memory.current": "13245964288",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "15032385536",
|
||||||
|
"memory.peak": "13326028800",
|
||||||
|
"memory.stat": "anon 2585387008\nfile 10532507648\npagetables 35008512\nsock 0\ninactive_file 4682813440\nactive_file 5849452544\nslab 78499184\nworkingset_refault_file 1482007\nworkingset_activate_file 452132\npgscan 500672\npgsteal 500672\npgmajfault 560546",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "15032385536/15032385536",
|
||||||
|
"docker_stats_mem_usage": "8.027GiB / 14GiB|57.33%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 12288.00M used = 11033.38M free = 1254.62M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 474Gi 415Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 05ab0b2e6660 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 12074684416,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7a-float32-cleared",
|
||||||
|
"qdrant_rss_bytes": 14239510528,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 5849452544,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 10532507648,
|
||||||
|
"inactive_file_bytes": 4682813440,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 560546,
|
||||||
|
"share_of_storage_cached": 0.7807,
|
||||||
|
"storage_blocks_bytes": 13490339840,
|
||||||
|
"workingset_refault_file": 1482007
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13800402057,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233394\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n4474504068\t/qdrant/storage/collections/dbpedia_full/0/temp_segments\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 13490339840
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T09:48:12-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10256691200 wbytes=69632 rios=149894 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11869360128",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11870068736",
|
||||||
|
"memory.stat": "anon 3712905216\nfile 7950614528\npagetables 25513984\nsock 0\ninactive_file 362151936\nactive_file 7588474880\nslab 21910024\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 77034",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.72GiB / 12GiB|89.30%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 6170.19M free = 997.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux beed86568724 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8103276544,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7a-float32",
|
||||||
|
"qdrant_rss_bytes": 11587944448,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7588474880,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7950614528,
|
||||||
|
"inactive_file_bytes": 362151936,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 77034,
|
||||||
|
"share_of_storage_cached": 0.7514,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T09:48:55-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10269560832 wbytes=73728 rios=152722 wios=72 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11885273088",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11898286080",
|
||||||
|
"memory.stat": "anon 3689017344\nfile 7963025408\npagetables 25587712\nsock 0\ninactive_file 373702656\nactive_file 7589335040\nslab 21943640\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 79846",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.72GiB / 12GiB|89.35%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 6162.19M free = 1005.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 950a395cc5b5 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8115593216,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7a-int8",
|
||||||
|
"qdrant_rss_bytes": 11575943168,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7589335040,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7963025408,
|
||||||
|
"inactive_file_bytes": 373702656,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 79846,
|
||||||
|
"share_of_storage_cached": 0.7526,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T09:58:00-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=49712668672 wbytes=21424852992 rios=3674629 wios=30402 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10245935104",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 24800\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 24800\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12884901888",
|
||||||
|
"memory.stat": "anon 2249072640\nfile 7687196672\npagetables 32268288\nsock 0\ninactive_file 5472317440\nactive_file 2214891520\nslab 43701488\nworkingset_refault_file 8790070\nworkingset_activate_file 7978011\npgscan 12450881\npgsteal 12425180\npgmajfault 4017114",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "4.445GiB / 12GiB|37.05%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5144.25M free = 999.75M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0fab91539649 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7866281984,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7a-turbo_bits1",
|
||||||
|
"qdrant_rss_bytes": 9878896640,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 2214891520,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7687196672,
|
||||||
|
"inactive_file_bytes": 5472317440,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4017114,
|
||||||
|
"share_of_storage_cached": 0.8464,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 8790070
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897968,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n0\t/qdrant/storage/collections/dbpedia_full/0/temp_segments\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T09:53:59-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=32671367168 wbytes=12407025664 rios=1883148 wios=18258 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10466279424",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 15789\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 15789\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12884901888",
|
||||||
|
"memory.stat": "anon 2826752000\nfile 7300222976\npagetables 29528064\nsock 0\ninactive_file 4252594176\nactive_file 3047641088\nslab 46413440\nworkingset_refault_file 5006691\nworkingset_activate_file 4194653\npgscan 7580097\npgsteal 7559449\npgmajfault 2036208",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "5.786GiB / 12GiB|48.22%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4930.62M free = 1213.38M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 19fe30e61c1e 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7455289344,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7a-turbo_bits4",
|
||||||
|
"qdrant_rss_bytes": 10079137792,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 3047641088,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 377878781,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 927184400
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7300222976,
|
||||||
|
"inactive_file_bytes": 4252594176,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 377946112,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 927195136
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9154539520,
|
||||||
|
"pgmajfault": 2036208,
|
||||||
|
"share_of_storage_cached": 0.7514,
|
||||||
|
"storage_blocks_bytes": 9715032064,
|
||||||
|
"workingset_refault_file": 5006691
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9959132809,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9858468192\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n0\t/qdrant/storage/collections/dbpedia_full/0/temp_segments\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9715032064
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T10:29:56-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8782598144 wbytes=73728 rios=139153 wios=68 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4291010560",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7377\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7377\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294971392",
|
||||||
|
"memory.stat": "anon 2009546752\nfile 2200793088\npagetables 22323200\nsock 0\ninactive_file 1457876992\nactive_file 742924288\nslab 21987168\nworkingset_refault_file 5714\nworkingset_activate_file 1548\npgscan 2085672\npgsteal 1419863\npgmajfault 77169",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.638GiB / 4GiB|65.95%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 5559.06M free = 1608.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux d20e54f9dad7 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2353307648,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 4177567744,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 742924288,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2200793088,
|
||||||
|
"inactive_file_bytes": 1457876992,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 77169,
|
||||||
|
"share_of_storage_cached": 0.2423,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5714
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T10:29:43-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8479764480 wbytes=73728 rios=65914 wios=68 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4195508224",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7039\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7039\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 1956294656\nfile 2164076544\npagetables 20865024\nsock 0\ninactive_file 1424146432\nactive_file 739938304\nslab 20254960\nworkingset_refault_file 5455\nworkingset_activate_file 1548\npgscan 2020648\npgsteal 1354888\npgmajfault 3877",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.58GiB / 4GiB|64.51%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 5559.06M free = 1608.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 3deb51a0c773 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2317074432,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 4087693312,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 739938304,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2164076544,
|
||||||
|
"inactive_file_bytes": 1424146432,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 3877,
|
||||||
|
"share_of_storage_cached": 0.2383,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5455
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T10:29:03-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10024951808 wbytes=73728 rios=442289 wios=68 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4293861376",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 8941\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 8941\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294979584",
|
||||||
|
"memory.stat": "anon 2003898368\nfile 2213277696\npagetables 22310912\nsock 0\ninactive_file 1473507328\nactive_file 739778560\nslab 21952944\nworkingset_refault_file 309585\nworkingset_activate_file 74874\npgscan 2385673\npgsteal 1720274\npgmajfault 380430",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.626GiB / 4GiB|65.65%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 5567.06M free = 1600.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux a6c5d8d80bea 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2365698048,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4199993344,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 739778560,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2213277696,
|
||||||
|
"inactive_file_bytes": 1473507328,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 380430,
|
||||||
|
"share_of_storage_cached": 0.2437,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 309585
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T10:28:39-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8480149504 wbytes=73728 rios=65910 wios=68 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4194832384",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7034\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7034\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 1956851712\nfile 2168242176\npagetables 20844544\nsock 0\ninactive_file 1433980928\nactive_file 734269440\nslab 20249504\nworkingset_refault_file 5502\nworkingset_activate_file 1592\npgscan 2019017\npgsteal 1353967\npgmajfault 3873",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.57GiB / 4GiB|64.25%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 5567.06M free = 1600.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 1675c5955a73 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2321514496,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4092805120,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 734269440,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2168242176,
|
||||||
|
"inactive_file_bytes": 1433980928,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 3873,
|
||||||
|
"share_of_storage_cached": 0.2387,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5502
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:19:20-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:16 rbytes=90112 wbytes=0 rios=1 wios=0 dbytes=0 dios=0\n254:0 rbytes=11462758400 wbytes=65536 rios=793396 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294684672",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11044\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11045\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294971392",
|
||||||
|
"memory.stat": "anon 1985462272\nfile 2227970048\npagetables 22405120\nsock 0\ninactive_file 1443024896\nactive_file 784953344\nslab 21789040\nworkingset_refault_file 660653\nworkingset_activate_file 426017\npgscan 2738324\npgsteal 2067989\npgmajfault 731613",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.656GiB / 4GiB|66.39%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4957.81M free = 1186.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 9f14e2ab7cbe 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2380017664,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cold_cached-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4195459072,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 784953344,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2227970048,
|
||||||
|
"inactive_file_bytes": 1443024896,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 731613,
|
||||||
|
"share_of_storage_cached": 0.2453,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 660653
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897984,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:18:41-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8482238464 wbytes=61440 rios=66047 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294705152",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7094\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7094\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2120843264\nfile 2128613376\npagetables 21155840\nsock 0\ninactive_file 1347940352\nactive_file 780681216\nslab 20182232\nworkingset_refault_file 5628\nworkingset_activate_file 1583\npgscan 2034452\npgsteal 1364405\npgmajfault 4054",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.742GiB / 4GiB|68.54%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5005.81M free = 1138.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0ba26a7357e0 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2219958272,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cold_cached-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4215115776,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 780681216,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2128613376,
|
||||||
|
"inactive_file_bytes": 1347940352,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4054,
|
||||||
|
"share_of_storage_cached": 0.2344,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5628
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897984,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:16:59-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=11463585792 wbytes=65536 rios=793636 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4292771840",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11033\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11033\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294979584",
|
||||||
|
"memory.stat": "anon 1990160384\nfile 2219790336\npagetables 22409216\nsock 0\ninactive_file 1435213824\nactive_file 784584704\nslab 21515816\nworkingset_refault_file 547071\nworkingset_activate_file 424870\npgscan 2747274\npgsteal 2070050\npgmajfault 731989",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.661GiB / 4GiB|66.53%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5353.12M free = 790.88M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux fd1907767ca3 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2373402624,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cold_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4190040064,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 784584704,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2219790336,
|
||||||
|
"inactive_file_bytes": 1435213824,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 731989,
|
||||||
|
"share_of_storage_cached": 0.2444,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 547071
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897984,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:16:19-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8481538048 wbytes=61440 rios=65914 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294942720",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7062\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7062\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2110078976\nfile 2146643968\npagetables 21135360\nsock 0\ninactive_file 1365549056\nactive_file 781103104\nslab 15232192\nworkingset_refault_file 707\nworkingset_activate_file 72\npgscan 2036554\npgsteal 1359712\npgmajfault 4045",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.727GiB / 4GiB|68.18%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5369.12M free = 774.88M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 17472dc58a37 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2298400768,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-exceeds-cold_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4220092416,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 781103104,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2146643968,
|
||||||
|
"inactive_file_bytes": 1365549056,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4045,
|
||||||
|
"share_of_storage_cached": 0.2364,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 707
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897984,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:17:59-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8759492608 wbytes=65536 rios=138732 wios=67 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10280218624",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10288066560",
|
||||||
|
"memory.stat": "anon 2186485760\nfile 7992082432\npagetables 22401024\nsock 0\ninactive_file 363327488\nactive_file 7628767232\nslab 22011872\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 76795",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.236GiB / 12GiB|76.96%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5353.12M free = 790.88M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux a56020289151 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8144973824,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-fits-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 10081677312,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7628767232,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7992082432,
|
||||||
|
"inactive_file_bytes": 363327488,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 76795,
|
||||||
|
"share_of_storage_cached": 0.88,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:17:46-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8458805248 wbytes=61440 rios=65600 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10023751680",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10024837120",
|
||||||
|
"memory.stat": "anon 2288869376\nfile 7691853824\npagetables 21131264\nsock 0\ninactive_file 63799296\nactive_file 7628066816\nslab 20331312\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3679",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.276GiB / 12GiB|77.30%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5353.12M free = 790.88M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux b5702e69b2f8 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7783325696,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-fits-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 9905184768,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7628066816,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7691853824,
|
||||||
|
"inactive_file_bytes": 63799296,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 3679,
|
||||||
|
"share_of_storage_cached": 0.847,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T10:30:50-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:16 rbytes=90112 wbytes=0 rios=1 wios=0 dbytes=0 dios=0\n254:0 rbytes=8757706752 wbytes=73728 rios=138247 wios=69 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10250059776",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10251448320",
|
||||||
|
"memory.stat": "anon 2138161152\nfile 7990386688\npagetables 22278144\nsock 0\ninactive_file 361312256\nactive_file 7629086720\nslab 21999152\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 76310",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.208GiB / 12GiB|76.73%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 5471.06M free = 1696.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux ff2fed08fae5 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8142684160,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-fits-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 10052431872,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7629086720,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7990386688,
|
||||||
|
"inactive_file_bytes": 361312256,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 76310,
|
||||||
|
"share_of_storage_cached": 0.8798,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T10:30:37-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:16 rbytes=90112 wbytes=0 rios=1 wios=0 dbytes=0 dios=0\n254:0 rbytes=8457277440 wbytes=73728 rios=65576 wios=69 dbytes=0 dios=0",
|
||||||
|
"memory.current": "9895563264",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "9997934592",
|
||||||
|
"memory.stat": "anon 2099884032\nfile 7690416128\npagetables 20828160\nsock 0\ninactive_file 63795200\nactive_file 7626633216\nslab 20266000\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3660",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.156GiB / 12GiB|76.30%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 7168.00M used = 5471.06M free = 1696.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 09eb5a3bf539 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7842996224,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r0-fits-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 9714491392,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7626633216,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7690416128,
|
||||||
|
"inactive_file_bytes": 63795200,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 3660,
|
||||||
|
"share_of_storage_cached": 0.8468,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:24:04-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8783015936 wbytes=65536 rios=139155 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294221824",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7526\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7526\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2039607296\nfile 2175115264\npagetables 22446080\nsock 0\ninactive_file 1406328832\nactive_file 768794624\nslab 18863912\nworkingset_refault_file 651\nworkingset_activate_file 49\npgscan 2093261\npgsteal 1426153\npgmajfault 77194",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.689GiB / 4GiB|67.24%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4458.69M free = 1685.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux fd2176dd61fe 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2327498752,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 4180922368,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 768794624,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2175115264,
|
||||||
|
"inactive_file_bytes": 1406328832,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 77194,
|
||||||
|
"share_of_storage_cached": 0.2395,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 651
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:23:51-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8482066432 wbytes=61440 rios=65968 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294742016",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7020\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7020\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2093633536\nfile 2159927296\npagetables 21073920\nsock 0\ninactive_file 1392046080\nactive_file 767889408\nslab 17199616\nworkingset_refault_file 640\nworkingset_activate_file 49\npgscan 2023629\npgsteal 1356522\npgmajfault 4072",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.702GiB / 4GiB|67.54%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4482.69M free = 1661.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux f564a033cc44 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2250362880,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 4219158528,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 767889408,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2159927296,
|
||||||
|
"inactive_file_bytes": 1392046080,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4072,
|
||||||
|
"share_of_storage_cached": 0.2378,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 640
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:26:56-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=11464536064 wbytes=65536 rios=793827 wios=67 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294418432",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11247\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11247\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2008100864\nfile 2202079232\npagetables 22392832\nsock 0\ninactive_file 1371222016\nactive_file 830865408\nslab 21930176\nworkingset_refault_file 661317\nworkingset_activate_file 427550\npgscan 2733197\npgsteal 2074606\npgmajfault 732185",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.723GiB / 4GiB|68.08%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4412.56M free = 1731.44M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux f67850a49929 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2350804992,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4191002624,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 830865408,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2202079232,
|
||||||
|
"inactive_file_bytes": 1371222016,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 732185,
|
||||||
|
"share_of_storage_cached": 0.2425,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 661317
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:26:16-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8481579008 wbytes=61440 rios=65883 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294721536",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7115\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7115\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2110464000\nfile 2140872704\npagetables 21110784\nsock 0\ninactive_file 1313353728\nactive_file 827510784\nslab 20310320\nworkingset_refault_file 5655\nworkingset_activate_file 1598\npgscan 2019405\npgsteal 1361136\npgmajfault 4047",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.776GiB / 4GiB|69.39%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4420.56M free = 1723.44M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 76e5b91222ce 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2227290112,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4212252672,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 827510784,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2140872704,
|
||||||
|
"inactive_file_bytes": 1313353728,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4047,
|
||||||
|
"share_of_storage_cached": 0.2357,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5655
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:25:29-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=11461951488 wbytes=65536 rios=793237 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4292726784",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 10792\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 10792\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 1987080192\nfile 2225283072\npagetables 22396928\nsock 0\ninactive_file 1430634496\nactive_file 794656768\nslab 21947712\nworkingset_refault_file 660581\nworkingset_activate_file 426159\npgscan 2730323\npgsteal 2068426\npgmajfault 731467",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.666GiB / 4GiB|66.64%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4465.56M free = 1678.44M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 3c821106ad66 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2374778880,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cold_cached-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4192649216,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 794656768,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2225283072,
|
||||||
|
"inactive_file_bytes": 1430634496,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 731467,
|
||||||
|
"share_of_storage_cached": 0.245,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 660581
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897935,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:24:48-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8482009088 wbytes=61440 rios=66029 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294709248",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7018\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7018\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2087534592\nfile 2163761152\npagetables 21102592\nsock 0\ninactive_file 1373097984\nactive_file 790671360\nslab 20338600\nworkingset_refault_file 5654\nworkingset_activate_file 1557\npgscan 2017363\npgsteal 1355768\npgmajfault 4045",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.72GiB / 4GiB|68.00%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4481.56M free = 1662.44M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 6d06a7d7090f 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2249637888,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cold_cached-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4214501376,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 790671360,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2163761152,
|
||||||
|
"inactive_file_bytes": 1373097984,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4045,
|
||||||
|
"share_of_storage_cached": 0.2383,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5654
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897935,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:23:06-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=6137393152 wbytes=65536 rios=456015 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294426624",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 4906\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 4906\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2002849792\nfile 2197925888\npagetables 22372352\nsock 0\ninactive_file 1854275584\nactive_file 343658496\nslab 21803944\nworkingset_refault_file 236087\nworkingset_activate_file 91175\npgscan 1198262\npgsteal 774743\npgmajfault 425095",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.272GiB / 4GiB|56.79%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4586.69M free = 1557.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 773b83d6b41a 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2352373760,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cold_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4187295744,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 343658496,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2197925888,
|
||||||
|
"inactive_file_bytes": 1854275584,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 425095,
|
||||||
|
"share_of_storage_cached": 0.242,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 236087
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898001,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233368\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:22:36-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=4413460480 wbytes=61440 rios=35434 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294459392",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 2487\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 2487\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2108198912\nfile 2160152576\npagetables 13127680\nsock 0\ninactive_file 377298944\nactive_file 1782861824\nslab 10985656\nworkingset_refault_file 5776\nworkingset_activate_file 3474\npgscan 786564\npgsteal 363070\npgmajfault 4451",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.647GiB / 4GiB|91.18%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4602.69M free = 1541.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 7a359fa96e2b 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2250420224,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-exceeds-cold_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4197773312,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1782861824,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2160152576,
|
||||||
|
"inactive_file_bytes": 377298944,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 4451,
|
||||||
|
"share_of_storage_cached": 0.2379,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 5776
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898001,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233368\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:27:28-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8759730176 wbytes=65536 rios=138743 wios=67 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10269888512",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10270662656",
|
||||||
|
"memory.stat": "anon 2171289600\nfile 7992320000\npagetables 22360064\nsock 0\ninactive_file 363352064\nactive_file 7628980224\nslab 21982728\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 76802",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.225GiB / 12GiB|76.88%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4842.19M free = 1301.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0f4272b16cec 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8141656064,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-fits-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 10087272448,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7628980224,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7992320000,
|
||||||
|
"inactive_file_bytes": 363352064,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 76802,
|
||||||
|
"share_of_storage_cached": 0.88,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:27:14-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8459091968 wbytes=61440 rios=65606 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10021699584",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10022797312",
|
||||||
|
"memory.stat": "anon 2286534656\nfile 7692140544\npagetables 21118976\nsock 0\ninactive_file 63799296\nactive_file 7628353536\nslab 20331864\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3681",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.274GiB / 12GiB|77.28%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4538.56M free = 1605.44M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 6073c653e6c0 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7841923072,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-fits-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 9902899200,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7628353536,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7692140544,
|
||||||
|
"inactive_file_bytes": 63799296,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 3681,
|
||||||
|
"share_of_storage_cached": 0.847,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:21:53-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8757555200 wbytes=65536 rios=138243 wios=67 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10307506176",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10308386816",
|
||||||
|
"memory.stat": "anon 2207035392\nfile 7990153216\npagetables 22433792\nsock 0\ninactive_file 361320448\nactive_file 7628845056\nslab 22010544\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 76305",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.262GiB / 12GiB|77.18%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4448.62M free = 1695.38M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 983c6fd6c05d 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8142917632,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-fits-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 10121105408,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7628845056,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7990153216,
|
||||||
|
"inactive_file_bytes": 361320448,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 76305,
|
||||||
|
"share_of_storage_cached": 0.8798,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:21:40-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8458887168 wbytes=61440 rios=65604 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10030456832",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10031058944",
|
||||||
|
"memory.stat": "anon 2295136256\nfile 7691943936\npagetables 21131264\nsock 0\ninactive_file 63811584\nactive_file 7628144640\nslab 20331760\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3682",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.282GiB / 12GiB|77.35%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4456.62M free = 1687.38M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 7dd0db57120f 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7845171200,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r1-fits-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 9911496704,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7628144640,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7691943936,
|
||||||
|
"inactive_file_bytes": 63811584,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 3682,
|
||||||
|
"share_of_storage_cached": 0.847,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897986,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233351\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:31:45-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=11246317568 wbytes=151552 rios=730909 wios=146 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294656000",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 17904\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 17904\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2421444608\nfile 1752395776\npagetables 23048192\nsock 0\ninactive_file 145674240\nactive_file 1606733824\nslab 21114984\nworkingset_refault_file 601089\nworkingset_activate_file 522278\npgscan 2776926\npgsteal 2049192\npgmajfault 675406",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.863GiB / 4GiB|96.57%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4938.50M free = 1205.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 420Gi 54% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0d4d5c5f824f 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1902641152,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 4107620352,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1606733824,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 766959520,
|
||||||
|
"id_tracker": 111924516,
|
||||||
|
"originals": 13224302632,
|
||||||
|
"payload": 1701193532,
|
||||||
|
"quantized": 482136032
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1752395776,
|
||||||
|
"inactive_file_bytes": 145674240,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 767094784,
|
||||||
|
"id_tracker": 111931392,
|
||||||
|
"originals": 13224374272,
|
||||||
|
"payload": 1241194496,
|
||||||
|
"quantized": 482156544
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 15826751488,
|
||||||
|
"pgmajfault": 675406,
|
||||||
|
"share_of_storage_cached": 0.1042,
|
||||||
|
"storage_blocks_bytes": 16813047808,
|
||||||
|
"workingset_refault_file": 601089
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 17363064499,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n17262399864\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 16813047808
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:31:16-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8529674240 wbytes=147456 rios=67945 wios=145 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294922240",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 12803\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 12803\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2555334656\nfile 1696169984\npagetables 21671936\nsock 0\ninactive_file 91287552\nactive_file 1604874240\nslab 19498912\nworkingset_refault_file 8179\nworkingset_activate_file 685\npgscan 2124446\npgsteal 1396722\npgmajfault 9516",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.913GiB / 4GiB|97.84%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4946.50M free = 1197.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 420Gi 54% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 1a3a824361b0 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1844080640,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 4180836352,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1604874240,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 766959520,
|
||||||
|
"id_tracker": 111924516,
|
||||||
|
"originals": 13224302632,
|
||||||
|
"payload": 1701193532,
|
||||||
|
"quantized": 482136032
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1696169984,
|
||||||
|
"inactive_file_bytes": 91287552,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 767094784,
|
||||||
|
"id_tracker": 111931392,
|
||||||
|
"originals": 13224374272,
|
||||||
|
"payload": 1241194496,
|
||||||
|
"quantized": 482156544
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 15826751488,
|
||||||
|
"pgmajfault": 9516,
|
||||||
|
"share_of_storage_cached": 0.1009,
|
||||||
|
"storage_blocks_bytes": 16813047808,
|
||||||
|
"workingset_refault_file": 8179
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 17363064499,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n17262399864\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 16813047808
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:28:18-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=11463409664 wbytes=65536 rios=793537 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4293500928",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11183\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11183\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294971392",
|
||||||
|
"memory.stat": "anon 1992343552\nfile 2215645184\npagetables 22425600\nsock 0\ninactive_file 1394475008\nactive_file 821178368\nslab 21931040\nworkingset_refault_file 660992\nworkingset_activate_file 426990\npgscan 2741651\npgsteal 2071021\npgmajfault 731856",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.7GiB / 4GiB|67.50%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4841.38M free = 1302.62M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux a9f05ea213f0 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2366033920,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4188913664,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 821178368,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2215645184,
|
||||||
|
"inactive_file_bytes": 1394475008,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 731856,
|
||||||
|
"share_of_storage_cached": 0.244,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 660992
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:27:40-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8481820672 wbytes=61440 rios=65919 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294189056",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7095\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7095\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2111139840\nfile 2140119040\npagetables 21131264\nsock 0\ninactive_file 1322356736\nactive_file 817770496\nslab 20323376\nworkingset_refault_file 5666\nworkingset_activate_file 1573\npgscan 2031699\npgsteal 1361381\npgmajfault 4046",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.767GiB / 4GiB|69.18%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4857.38M free = 1286.62M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 427Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux f2e70bf54304 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2288828416,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4214136832,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 817770496,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2140119040,
|
||||||
|
"inactive_file_bytes": 1322356736,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668311552,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521297920,
|
||||||
|
"pgmajfault": 4046,
|
||||||
|
"share_of_storage_cached": 0.2356,
|
||||||
|
"storage_blocks_bytes": 9081786368,
|
||||||
|
"workingset_refault_file": 5666
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325897937,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233302\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081786368
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:33:17-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=6000640000 wbytes=192512 rios=867410 wios=164 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294451200",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 6201\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 6201\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 2251223040\nfile 1890131968\npagetables 25120768\nsock 0\ninactive_file 1802006528\nactive_file 88141824\nslab 24991904\nworkingset_refault_file 496519\nworkingset_activate_file 232286\npgscan 815987\npgsteal 797223\npgmajfault 857153",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.311GiB / 4GiB|57.77%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5298.06M free = 845.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0c2ca5bc9fde 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2039889920,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cold_cached-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4133597184,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 88141824,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 469887243,
|
||||||
|
"id_tracker": 68876602,
|
||||||
|
"originals": 8138026024,
|
||||||
|
"payload": 1286676640,
|
||||||
|
"quantized": 296698864
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1890131968,
|
||||||
|
"inactive_file_bytes": 1802006528,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 470032384,
|
||||||
|
"id_tracker": 68894720,
|
||||||
|
"originals": 8138088448,
|
||||||
|
"payload": 763936768,
|
||||||
|
"quantized": 296710144
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9737662464,
|
||||||
|
"pgmajfault": 857153,
|
||||||
|
"share_of_storage_cached": 0.1823,
|
||||||
|
"storage_blocks_bytes": 10369810432,
|
||||||
|
"workingset_refault_file": 496519
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10999317478,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10898652845\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10369810432
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:32:28-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=2530975744 wbytes=188416 rios=20767 wios=163 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4061974528",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4062756864",
|
||||||
|
"memory.stat": "anon 2362589184\nfile 1680011264\npagetables 9814016\nsock 0\ninactive_file 74067968\nactive_file 1605955584\nslab 7230800\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 8993",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.713GiB / 4GiB|92.83%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4930.50M free = 1213.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux fb3d0d028afc 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1767231488,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cold_cached-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 3957100544,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1605955584,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 469887243,
|
||||||
|
"id_tracker": 68876602,
|
||||||
|
"originals": 8138026024,
|
||||||
|
"payload": 1286676640,
|
||||||
|
"quantized": 296698864
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1680011264,
|
||||||
|
"inactive_file_bytes": 74067968,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 470032384,
|
||||||
|
"id_tracker": 68894720,
|
||||||
|
"originals": 8138088448,
|
||||||
|
"payload": 763936768,
|
||||||
|
"quantized": 296710144
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9737662464,
|
||||||
|
"pgmajfault": 8993,
|
||||||
|
"share_of_storage_cached": 0.162,
|
||||||
|
"storage_blocks_bytes": 10369810432,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10999317478,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10898652845\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10369810432
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:29:52-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=6122807296 wbytes=16146432 rios=897400 wios=110 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294467584",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 6400\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 6400\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 2237771776\nfile 1901932544\npagetables 25362432\nsock 0\ninactive_file 319139840\nactive_file 1582809088\nslab 24741856\nworkingset_refault_file 503931\nworkingset_activate_file 503931\npgscan 818304\npgsteal 818264\npgmajfault 883148",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.702GiB / 4GiB|92.55%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4915.94M free = 1228.06M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 44e0ed00d3ae 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2051260416,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cold_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4124405760,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1582809088,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 469886151,
|
||||||
|
"id_tracker": 68876570,
|
||||||
|
"originals": 8138026008,
|
||||||
|
"payload": 974951902,
|
||||||
|
"quantized": 296698864
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1901932544,
|
||||||
|
"inactive_file_bytes": 319139840,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 469966848,
|
||||||
|
"id_tracker": 68878336,
|
||||||
|
"originals": 8138072064,
|
||||||
|
"payload": 763789312,
|
||||||
|
"quantized": 296710144
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9737416704,
|
||||||
|
"pgmajfault": 883148,
|
||||||
|
"share_of_storage_cached": 0.1834,
|
||||||
|
"storage_blocks_bytes": 10368856064,
|
||||||
|
"workingset_refault_file": 503931
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10637021184,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10536356551\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10368856064
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:29:06-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=2625429504 wbytes=16142336 rios=43824 wios=109 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294746112",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 205\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 205\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2633695232\nfile 1641394176\npagetables 10620928\nsock 0\ninactive_file 61407232\nactive_file 1579999232\nslab 7095048\nworkingset_refault_file 251\nworkingset_activate_file 251\npgscan 26240\npgsteal 26201\npgmajfault 27691",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.943GiB / 4GiB|98.56%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4842.44M free = 1301.56M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux bcdf1bf9f9c8 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1728286720,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-exceeds-cold_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4259876864,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1579999232,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 469886151,
|
||||||
|
"id_tracker": 68876570,
|
||||||
|
"originals": 8138026008,
|
||||||
|
"payload": 974951902,
|
||||||
|
"quantized": 296698864
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1641394176,
|
||||||
|
"inactive_file_bytes": 61407232,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 469966848,
|
||||||
|
"id_tracker": 68878336,
|
||||||
|
"originals": 8138072064,
|
||||||
|
"payload": 763789312,
|
||||||
|
"quantized": 296710144
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9737416704,
|
||||||
|
"pgmajfault": 27691,
|
||||||
|
"share_of_storage_cached": 0.1583,
|
||||||
|
"storage_blocks_bytes": 10368856064,
|
||||||
|
"workingset_refault_file": 251
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10637021184,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10536356551\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10368856064
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:31:05-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9369870336 wbytes=96555008 rios=279291 wios=342 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11882651648",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12378984448",
|
||||||
|
"memory.stat": "anon 3595206656\nfile 7955361792\npagetables 27168768\nsock 0\ninactive_file 988704768\nactive_file 6966673408\nslab 25110096\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 220982",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.15GiB / 12GiB|84.54%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4946.50M free = 1197.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 420Gi 54% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 2558ace4db2d 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8104775680,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-fits-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 11422490624,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 6966673408,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 766959520,
|
||||||
|
"id_tracker": 111924516,
|
||||||
|
"originals": 13224302632,
|
||||||
|
"payload": 1701193532,
|
||||||
|
"quantized": 482136032
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7955361792,
|
||||||
|
"inactive_file_bytes": 988704768,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 767094784,
|
||||||
|
"id_tracker": 111931392,
|
||||||
|
"originals": 13224374272,
|
||||||
|
"payload": 1241194496,
|
||||||
|
"quantized": 482156544
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 15826751488,
|
||||||
|
"pgmajfault": 220982,
|
||||||
|
"share_of_storage_cached": 0.4732,
|
||||||
|
"storage_blocks_bytes": 16813047808,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 17363064499,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n17262399864\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 16813047808
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:30:52-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9069232128 wbytes=96555008 rios=206169 wios=342 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11906453504",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12378984448",
|
||||||
|
"memory.stat": "anon 3662778368\nfile 7655182336\npagetables 25686016\nsock 0\ninactive_file 689217536\nactive_file 6965977088\nslab 23456824\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 147876",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.45GiB / 12GiB|87.05%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4970.50M free = 1173.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 420Gi 54% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 1e0b5989c5ca 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 7804895232,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-fits-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 11190497280,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 6965977088,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 766959520,
|
||||||
|
"id_tracker": 111924516,
|
||||||
|
"originals": 13224302632,
|
||||||
|
"payload": 1701193532,
|
||||||
|
"quantized": 482136032
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7655182336,
|
||||||
|
"inactive_file_bytes": 689217536,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 767094784,
|
||||||
|
"id_tracker": 111931392,
|
||||||
|
"originals": 13224374272,
|
||||||
|
"payload": 1241194496,
|
||||||
|
"quantized": 482156544
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 15826751488,
|
||||||
|
"pgmajfault": 147876,
|
||||||
|
"share_of_storage_cached": 0.4553,
|
||||||
|
"storage_blocks_bytes": 16813047808,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 17363064499,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n17262399864\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 16813047808
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:34:30-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10228068352 wbytes=48316416 rios=373809 wios=213 dbytes=0 dios=0",
|
||||||
|
"memory.current": "12257730560",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12258926592",
|
||||||
|
"memory.stat": "anon 2843312128\nfile 9129181184\npagetables 31809536\nsock 0\ninactive_file 1335222272\nactive_file 7793975296\nslab 31665088\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 309818",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.17GiB / 12GiB|84.77%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5066.06M free = 1077.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 472Gi 424Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 5e2565614bec 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 9278640128,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-fits-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 11870273536,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7793975296,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 9129181184,
|
||||||
|
"inactive_file_bytes": 1335222272,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 309818,
|
||||||
|
"share_of_storage_cached": 0.7054,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:34:07-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9268322304 wbytes=48316416 rios=139757 wios=213 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11862618112",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11889295360",
|
||||||
|
"memory.stat": "anon 3551621120\nfile 8169893888\npagetables 25157632\nsock 0\ninactive_file 376561664\nactive_file 7793344512\nslab 23052552\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 75782",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.7GiB / 12GiB|89.14%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5154.06M free = 989.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 472Gi 424Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux f61a5cf6b83e 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8319619072,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r2-fits-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 11548925952,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7793344512,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 8169893888,
|
||||||
|
"inactive_file_bytes": 376561664,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 75782,
|
||||||
|
"share_of_storage_cached": 0.6312,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:41:44-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9440206848 wbytes=102400 rios=175813 wios=101 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4252073984",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 10243\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 10243\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294971392",
|
||||||
|
"memory.stat": "anon 2270191616\nfile 1871237120\npagetables 23834624\nsock 0\ninactive_file 570605568\nactive_file 1300643840\nslab 22728728\nworkingset_refault_file 38562\nworkingset_activate_file 76\npgscan 2285004\npgsteal 1579720\npgmajfault 111649",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.429GiB / 4GiB|85.72%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 8192.00M used = 7540.81M free = 651.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 471Gi 422Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 49fdf688b8f3 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2020888576,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 4081127424,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1300643840,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1871237120,
|
||||||
|
"inactive_file_bytes": 570605568,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 111649,
|
||||||
|
"share_of_storage_cached": 0.1446,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 38562
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:41:31-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9009016832 wbytes=98304 rios=70829 wios=100 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294623232",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 9476\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 9476\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2402967552\nfile 1845088256\npagetables 22482944\nsock 0\ninactive_file 545226752\nactive_file 1299869696\nslab 21049072\nworkingset_refault_file 6640\nworkingset_activate_file 76\npgscan 2186252\npgsteal 1480968\npgmajfault 6784",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.49GiB / 4GiB|87.25%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 8192.00M used = 7548.81M free = 643.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 471Gi 422Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 3b70c372c308 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1994485760,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 4171747328,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1299869696,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1845088256,
|
||||||
|
"inactive_file_bytes": 545226752,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 6784,
|
||||||
|
"share_of_storage_cached": 0.1426,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 6640
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:43:05-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=12307185664 wbytes=102400 rios=875841 wios=101 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294545408",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 15541\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 15541\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2218999808\nfile 1946333184\npagetables 29716480\nsock 0\ninactive_file 732876800\nactive_file 1213468672\nslab 29640032\nworkingset_refault_file 578085\nworkingset_activate_file 484820\npgscan 2969808\npgsteal 2261900\npgmajfault 812215",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.318GiB / 4GiB|82.94%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 8192.00M used = 7356.81M free = 835.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 471Gi 422Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux bb884ac46cf8 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2095804416,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4137635840,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1213468672,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1946333184,
|
||||||
|
"inactive_file_bytes": 732876800,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 812215,
|
||||||
|
"share_of_storage_cached": 0.1504,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 578085
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:42:22-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9008939008 wbytes=98304 rios=70922 wios=100 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294578176",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 9369\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 9369\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2301386752\nfile 1896902656\npagetables 22376448\nsock 0\ninactive_file 685248512\nactive_file 1211662336\nslab 21046048\nworkingset_refault_file 6636\nworkingset_activate_file 50\npgscan 2176208\npgsteal 1468300\npgmajfault 6846",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.361GiB / 4GiB|84.03%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 8192.00M used = 7396.81M free = 795.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 471Gi 422Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux c44d412d1446 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2047619072,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4120289280,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1211662336,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1896902656,
|
||||||
|
"inactive_file_bytes": 685248512,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 6846,
|
||||||
|
"share_of_storage_cached": 0.1466,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 6636
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:44:31-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9645674496 wbytes=122880 rios=790768 wios=112 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294287360",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11736\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11736\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 2100649984\nfile 2087043072\npagetables 24936448\nsock 0\ninactive_file 1346678784\nactive_file 740376576\nslab 24514904\nworkingset_refault_file 509454\nworkingset_activate_file 397502\npgscan 2068818\npgsteal 1632968\npgmajfault 745588",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.746GiB / 4GiB|68.65%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5333.19M free = 810.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 952917fb5dfc 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2229211136,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cold_cached-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4169093120,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 740376576,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 469716611,
|
||||||
|
"id_tracker": 68876594,
|
||||||
|
"originals": 8138026020,
|
||||||
|
"payload": 1113496230,
|
||||||
|
"quantized": 296698864
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2087043072,
|
||||||
|
"inactive_file_bytes": 1346678784,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 469843968,
|
||||||
|
"id_tracker": 68890624,
|
||||||
|
"originals": 8138084352,
|
||||||
|
"payload": 763850752,
|
||||||
|
"quantized": 296710144
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9737379840,
|
||||||
|
"pgmajfault": 745588,
|
||||||
|
"share_of_storage_cached": 0.2013,
|
||||||
|
"storage_blocks_bytes": 10369105920,
|
||||||
|
"workingset_refault_file": 509454
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10790150632,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10689485999\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10369105920
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:43:51-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=6621249536 wbytes=118784 rios=52704 wios=111 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294881280",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 6100\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 6100\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2205724672\nfile 2052308992\npagetables 17641472\nsock 0\ninactive_file 66269184\nactive_file 1986027520\nslab 15954824\nworkingset_refault_file 5023\nworkingset_activate_file 99\npgscan 1338392\npgsteal 902777\npgmajfault 7217",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.936GiB / 4GiB|98.40%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5381.19M free = 762.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 469Gi 426Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 437bd3b97d90 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2132467712,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cold_cached-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4216647680,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1986027520,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 469716611,
|
||||||
|
"id_tracker": 68876594,
|
||||||
|
"originals": 8138026020,
|
||||||
|
"payload": 1113496230,
|
||||||
|
"quantized": 296698864
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2052308992,
|
||||||
|
"inactive_file_bytes": 66269184,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 469843968,
|
||||||
|
"id_tracker": 68890624,
|
||||||
|
"originals": 8138084352,
|
||||||
|
"payload": 763850752,
|
||||||
|
"quantized": 296710144
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 9737379840,
|
||||||
|
"pgmajfault": 7217,
|
||||||
|
"share_of_storage_cached": 0.1979,
|
||||||
|
"storage_blocks_bytes": 10369105920,
|
||||||
|
"workingset_refault_file": 5023
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10790150632,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10689485999\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10369105920
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:45:38-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:16 rbytes=90112 wbytes=0 rios=1 wios=0 dbytes=0 dios=0\n254:0 rbytes=2780078080 wbytes=77824 rios=363059 wios=74 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294131712",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 73\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 73\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294975488",
|
||||||
|
"memory.stat": "anon 2160287744\nfile 1975189504\npagetables 22413312\nsock 0\ninactive_file 1466703872\nactive_file 508502016\nslab 21886464\nworkingset_refault_file 26\nworkingset_activate_file 26\npgscan 9216\npgsteal 9185\npgmajfault 355962",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.634GiB / 4GiB|65.85%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5311.00M free = 833.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux bbba0fd1726b 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2124775424,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cold_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4096765952,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 508502016,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412217023,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 892048478,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1975189504,
|
||||||
|
"inactive_file_bytes": 1466703872,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412299264,
|
||||||
|
"id_tracker": 60272640,
|
||||||
|
"originals": 7120818176,
|
||||||
|
"payload": 668327936,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521338880,
|
||||||
|
"pgmajfault": 355962,
|
||||||
|
"share_of_storage_cached": 0.2175,
|
||||||
|
"storage_blocks_bytes": 9081892864,
|
||||||
|
"workingset_refault_file": 26
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9362644155,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9261979522\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081892864
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:45:14-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=1338195968 wbytes=73728 rios=11315 wios=73 dbytes=0 dios=0",
|
||||||
|
"memory.current": "2879418368",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "2880131072",
|
||||||
|
"memory.stat": "anon 2300669952\nfile 571215872\npagetables 7237632\nsock 0\ninactive_file 63926272\nactive_file 507301888\nslab 4065048\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 4213",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.622GiB / 4GiB|65.54%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5189.94M free = 954.06M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 3d6724c5764b 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 658612224,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-exceeds-cold_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 2796277760,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 507301888,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412217023,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 892048478,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 571215872,
|
||||||
|
"inactive_file_bytes": 63926272,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412299264,
|
||||||
|
"id_tracker": 60272640,
|
||||||
|
"originals": 7120818176,
|
||||||
|
"payload": 668327936,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521338880,
|
||||||
|
"pgmajfault": 4213,
|
||||||
|
"share_of_storage_cached": 0.0629,
|
||||||
|
"storage_blocks_bytes": 9081892864,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9362644155,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9261979522\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081892864
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:42:10-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9282019328 wbytes=102400 rios=142886 wios=101 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10761428992",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10778869760",
|
||||||
|
"memory.stat": "anon 2448105472\nfile 8183128064\npagetables 23830528\nsock 0\ninactive_file 389357568\nactive_file 7793786880\nslab 22731280\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 78903",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.66GiB / 12GiB|80.50%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 8192.00M used = 7420.81M free = 771.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 471Gi 422Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 99ae193c152e 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8332771328,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-fits-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 10529103872,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7793786880,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 8183128064,
|
||||||
|
"inactive_file_bytes": 389357568,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 78903,
|
||||||
|
"share_of_storage_cached": 0.6323,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:41:58-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8981749760 wbytes=98304 rios=69839 wios=100 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10471215104",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "10472239104",
|
||||||
|
"memory.stat": "anon 2542915584\nfile 7883317248\npagetables 22474752\nsock 0\ninactive_file 90173440\nactive_file 7793156096\nslab 21054832\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 5872",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "9.669GiB / 12GiB|80.57%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 8192.00M used = 7428.81M free = 763.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 471Gi 422Gi 53% 2.9M 4.4G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 89b66b5533af 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8033292288,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-fits-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 10324656128,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7793156096,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 584859719,
|
||||||
|
"id_tracker": 86095666,
|
||||||
|
"originals": 10172525604,
|
||||||
|
"payload": 1244666996,
|
||||||
|
"quantized": 370873328
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7883317248,
|
||||||
|
"inactive_file_bytes": 90173440,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 584982528,
|
||||||
|
"id_tracker": 86102016,
|
||||||
|
"originals": 10172592128,
|
||||||
|
"payload": 954757120,
|
||||||
|
"quantized": 370888704
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 12169322496,
|
||||||
|
"pgmajfault": 5872,
|
||||||
|
"share_of_storage_cached": 0.6091,
|
||||||
|
"storage_blocks_bytes": 12942737408,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 13295656848,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n13194992213\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 12942737408
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:46:45-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10535018496 wbytes=32256000 rios=249294 wios=179 dbytes=0 dios=0",
|
||||||
|
"memory.current": "12390580224",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12514254848",
|
||||||
|
"memory.stat": "anon 2636283904\nfile 9551831040\npagetables 28594176\nsock 0\ninactive_file 790384640\nactive_file 8761462784\nslab 28542752\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 178903",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.8GiB / 12GiB|90.02%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5239.00M free = 905.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 13c7a63b1e71 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 9693270016,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-fits-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 12094488576,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 8761462784,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 527360677,
|
||||||
|
"id_tracker": 77486122,
|
||||||
|
"originals": 9155275808,
|
||||||
|
"payload": 1161763572,
|
||||||
|
"quantized": 333786096
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 9551831040,
|
||||||
|
"inactive_file_bytes": 790384640,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 527470592,
|
||||||
|
"id_tracker": 77492224,
|
||||||
|
"originals": 9155334144,
|
||||||
|
"payload": 859299840,
|
||||||
|
"quantized": 333799424
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10953396224,
|
||||||
|
"pgmajfault": 178903,
|
||||||
|
"share_of_storage_cached": 0.8195,
|
||||||
|
"storage_blocks_bytes": 11655950336,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 12027767363,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n11927102728\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 11655950336
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:46:26-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10015944704 wbytes=32256000 rios=122828 wios=179 dbytes=0 dios=0",
|
||||||
|
"memory.current": "12282454016",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "12336689152",
|
||||||
|
"memory.stat": "anon 3175301120\nfile 9033216000\npagetables 25853952\nsock 0\ninactive_file 272396288\nactive_file 8760832000\nslab 24590616\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 52453",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "11.18GiB / 12GiB|93.20%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5239.00M free = 905.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux de1d3eecb53e 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 9175101440,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r3-fits-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 12115386368,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 8760832000,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 527360677,
|
||||||
|
"id_tracker": 77486122,
|
||||||
|
"originals": 9155275808,
|
||||||
|
"payload": 1161763572,
|
||||||
|
"quantized": 333786096
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 9033216000,
|
||||||
|
"inactive_file_bytes": 272396288,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 527470592,
|
||||||
|
"id_tracker": 77492224,
|
||||||
|
"originals": 9155334144,
|
||||||
|
"payload": 859299840,
|
||||||
|
"quantized": 333799424
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10953396224,
|
||||||
|
"pgmajfault": 52453,
|
||||||
|
"share_of_storage_cached": 0.775,
|
||||||
|
"storage_blocks_bytes": 11655950336,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 12027767363,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n11927102728\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 11655950336
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:51:58-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8782868480 wbytes=65536 rios=139210 wios=67 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4277497856",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7583\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7583\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2053459968\nfile 2141310976\npagetables 22523904\nsock 0\ninactive_file 1397370880\nactive_file 743948288\nslab 21987456\nworkingset_refault_file 5740\nworkingset_activate_file 1524\npgscan 2101403\npgsteal 1434370\npgmajfault 77181",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.682GiB / 4GiB|67.05%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5015.69M free = 1128.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux e329e922cf94 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2284077056,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 4159270912,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 743948288,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2141310976,
|
||||||
|
"inactive_file_bytes": 1397370880,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 77181,
|
||||||
|
"share_of_storage_cached": 0.2358,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 5740
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898029,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233394\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:51:45-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8481980416 wbytes=61440 rios=66030 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294750208",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7032\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7032\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2118565888\nfile 2132963328\npagetables 21151744\nsock 0\ninactive_file 1389891584\nactive_file 743079936\nslab 20318552\nworkingset_refault_file 5699\nworkingset_activate_file 1519\npgscan 2030107\npgsteal 1363084\npgmajfault 4080",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.705GiB / 4GiB|67.61%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5023.69M free = 1120.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux c91f3963abbb 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2212175872,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 4214054912,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 743079936,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2132963328,
|
||||||
|
"inactive_file_bytes": 1389891584,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 4080,
|
||||||
|
"share_of_storage_cached": 0.2349,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 5699
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898029,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233394\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:52:51-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=11467579392 wbytes=65536 rios=794575 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294545408",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11165\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11165\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294979584",
|
||||||
|
"memory.stat": "anon 2020790272\nfile 2188779520\npagetables 22401024\nsock 0\ninactive_file 1370345472\nactive_file 818442240\nslab 21515776\nworkingset_refault_file 549998\nworkingset_activate_file 426424\npgscan 2755201\npgsteal 2078596\npgmajfault 732889",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.723GiB / 4GiB|68.09%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 4967.69M free = 1176.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0af142a7eda3 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2330525696,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4187234304,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 818442240,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2188779520,
|
||||||
|
"inactive_file_bytes": 1370345472,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 732889,
|
||||||
|
"share_of_storage_cached": 0.241,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 549998
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898029,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233394\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:52:13-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8482004992 wbytes=61440 rios=65991 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294692864",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 7090\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 7090\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2116395008\nfile 2139693056\npagetables 21127168\nsock 0\ninactive_file 1324466176\nactive_file 815235072\nslab 15338552\nworkingset_refault_file 784\nworkingset_activate_file 110\npgscan 2037825\npgsteal 1361510\npgmajfault 4070",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.765GiB / 4GiB|69.13%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5007.69M free = 1136.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 98b343bc966a 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2277519360,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4216688640,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 815235072,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2139693056,
|
||||||
|
"inactive_file_bytes": 1324466176,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 4070,
|
||||||
|
"share_of_storage_cached": 0.2356,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 784
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898029,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233394\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:51:01-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=4994097152 wbytes=65536 rios=421361 wios=66 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4291899392",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 2945\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 2945\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 2007617536\nfile 2184331264\npagetables 22409216\nsock 0\ninactive_file 1978347520\nactive_file 205996032\nslab 21915792\nworkingset_refault_file 102679\nworkingset_activate_file 102372\npgscan 517311\npgsteal 498925\npgmajfault 398061",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.154GiB / 4GiB|53.84%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5031.69M free = 1112.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 85582ba73907 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2325725184,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cold_cached-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4181147648,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 205996032,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2184331264,
|
||||||
|
"inactive_file_bytes": 1978347520,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 398061,
|
||||||
|
"share_of_storage_cached": 0.2405,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 102679
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898040,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233407\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:50:34-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=3378069504 wbytes=61440 rios=27123 wios=65 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294565888",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 553\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 553\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2104778752\nfile 2167926784\npagetables 11169792\nsock 0\ninactive_file 1963053056\nactive_file 204886016\nslab 8673160\nworkingset_refault_file 1399\nworkingset_activate_file 1112\npgscan 126847\npgsteal 108527\npgmajfault 3912",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "2.171GiB / 4GiB|54.26%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5031.69M free = 1112.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux e42a4ca104a7 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2246799360,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cold_cached-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4261888000,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 204886016,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412216750,
|
||||||
|
"id_tracker": 60267026,
|
||||||
|
"originals": 7120776212,
|
||||||
|
"payload": 857412396,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2167926784,
|
||||||
|
"inactive_file_bytes": 1963053056,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412282880,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120814080,
|
||||||
|
"payload": 668315648,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521302016,
|
||||||
|
"pgmajfault": 3912,
|
||||||
|
"share_of_storage_cached": 0.2387,
|
||||||
|
"storage_blocks_bytes": 9081790464,
|
||||||
|
"workingset_refault_file": 1399
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9325898040,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9225233407\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9081790464
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:48:55-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8320675840 wbytes=32235520 rios=1147677 wios=160 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4292820992",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 11177\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 11177\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 2491838464\nfile 1663668224\npagetables 29253632\nsock 0\ninactive_file 641318912\nactive_file 1022361600\nslab 27409720\nworkingset_refault_file 725307\nworkingset_activate_file 657361\npgscan 1664505\npgsteal 1385155\npgmajfault 1124153",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.4GiB / 4GiB|85.00%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5168.19M free = 975.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 3030d60b85b2 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1806327808,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cold_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 4118597632,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1022361600,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 527190318,
|
||||||
|
"id_tracker": 77486122,
|
||||||
|
"originals": 9155275808,
|
||||||
|
"payload": 1127127490,
|
||||||
|
"quantized": 333786096
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1663668224,
|
||||||
|
"inactive_file_bytes": 641318912,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 527298560,
|
||||||
|
"id_tracker": 77492224,
|
||||||
|
"originals": 9155334144,
|
||||||
|
"payload": 859279360,
|
||||||
|
"quantized": 333799424
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10953203712,
|
||||||
|
"pgmajfault": 1124153,
|
||||||
|
"share_of_storage_cached": 0.1427,
|
||||||
|
"storage_blocks_bytes": 11655667712,
|
||||||
|
"workingset_refault_file": 725307
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 11984533555,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n11883868922\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 11655667712
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:48:04-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=3947642880 wbytes=32231424 rios=80321 wios=159 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4130287616",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 3704\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 3704\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 2834104320\nfile 1207242752\npagetables 13914112\nsock 0\ninactive_file 186462208\nactive_file 1020788736\nslab 10424048\nworkingset_refault_file 8773\nworkingset_activate_file 3387\npgscan 707449\npgsteal 428099\npgmajfault 55923",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.671GiB / 4GiB|91.78%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5264.19M free = 879.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 5a0b758a8ffb 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1349980160,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-exceeds-cold_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 4003790848,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1020788736,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 527190318,
|
||||||
|
"id_tracker": 77486122,
|
||||||
|
"originals": 9155275808,
|
||||||
|
"payload": 1127127490,
|
||||||
|
"quantized": 333786096
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 1207242752,
|
||||||
|
"inactive_file_bytes": 186462208,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 527298560,
|
||||||
|
"id_tracker": 77492224,
|
||||||
|
"originals": 9155334144,
|
||||||
|
"payload": 859279360,
|
||||||
|
"quantized": 333799424
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10953203712,
|
||||||
|
"pgmajfault": 55923,
|
||||||
|
"share_of_storage_cached": 0.1036,
|
||||||
|
"storage_blocks_bytes": 11655667712,
|
||||||
|
"workingset_refault_file": 8773
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 11984533555,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n11883868922\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 11655667712
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:49:52-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=3674181632 wbytes=114688 rios=100120 wios=103 dbytes=0 dios=0",
|
||||||
|
"memory.current": "5223645184",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "5257310208",
|
||||||
|
"memory.stat": "anon 2224742400\nfile 2912473088\npagetables 12627968\nsock 0\ninactive_file 364568576\nactive_file 2547920896\nslab 10632600\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 78930",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "4.525GiB / 12GiB|37.71%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5263.69M free = 880.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux c13a2c0c29cb 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 3053355008,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-fits-cached_pinned-rescoreFalse-after",
|
||||||
|
"qdrant_rss_bytes": 5059887104,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 2547920896,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412217569,
|
||||||
|
"id_tracker": 60267050,
|
||||||
|
"originals": 7120776224,
|
||||||
|
"payload": 995956724,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2912473088,
|
||||||
|
"inactive_file_bytes": 364568576,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412332032,
|
||||||
|
"id_tracker": 60280832,
|
||||||
|
"originals": 7120826368,
|
||||||
|
"payload": 668381184,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521441280,
|
||||||
|
"pgmajfault": 78930,
|
||||||
|
"share_of_storage_cached": 0.3207,
|
||||||
|
"storage_blocks_bytes": 9082216448,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9479198931,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9378534296\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9082216448
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:49:39-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=3373473792 wbytes=110592 rios=26966 wios=102 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4950409216",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "4951408640",
|
||||||
|
"memory.stat": "anon 2316075008\nfile 2612224000\npagetables 11321344\nsock 0\ninactive_file 64946176\nactive_file 2547290112\nslab 8953800\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 5792",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "4.55GiB / 12GiB|37.91%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5193.19M free = 950.81M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 468Gi 428Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux eac7be36f076 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 2692235264,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-fits-cached_pinned-rescoreFalse-before",
|
||||||
|
"qdrant_rss_bytes": 4851527680,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 2547290112,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 412217569,
|
||||||
|
"id_tracker": 60267050,
|
||||||
|
"originals": 7120776224,
|
||||||
|
"payload": 995956724,
|
||||||
|
"quantized": 259611632
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2612224000,
|
||||||
|
"inactive_file_bytes": 64946176,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 412332032,
|
||||||
|
"id_tracker": 60280832,
|
||||||
|
"originals": 7120826368,
|
||||||
|
"payload": 668381184,
|
||||||
|
"quantized": 259620864
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8521441280,
|
||||||
|
"pgmajfault": 5792,
|
||||||
|
"share_of_storage_cached": 0.2876,
|
||||||
|
"storage_blocks_bytes": 9082216448,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9479198931,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n9378534296\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 9082216448
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:47:17-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10344095744 wbytes=114688 rios=202684 wios=107 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11844239360",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11845382144",
|
||||||
|
"memory.stat": "anon 2342232064\nfile 9360908288\npagetables 27332608\nsock 0\ninactive_file 599457792\nactive_file 8761466880\nslab 27253928\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 132296",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.47GiB / 12GiB|87.27%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5151.00M free = 993.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 8982e442ee29 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 9502748672,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-fits-cached_pinned-rescoreTrue-after",
|
||||||
|
"qdrant_rss_bytes": 11609567232,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 8761466880,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 527360677,
|
||||||
|
"id_tracker": 77486122,
|
||||||
|
"originals": 9155275808,
|
||||||
|
"payload": 1161763572,
|
||||||
|
"quantized": 333786096
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 9360908288,
|
||||||
|
"inactive_file_bytes": 599457792,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 527470592,
|
||||||
|
"id_tracker": 77492224,
|
||||||
|
"originals": 9155334144,
|
||||||
|
"payload": 859299840,
|
||||||
|
"quantized": 333799424
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10953396224,
|
||||||
|
"pgmajfault": 132296,
|
||||||
|
"share_of_storage_cached": 0.8031,
|
||||||
|
"storage_blocks_bytes": 11655950336,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 12027767363,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n11927102728\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 11655950336
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T11:46:59-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9825021952 wbytes=110592 rios=76218 wios=106 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11353972736",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11354836992",
|
||||||
|
"memory.stat": "anon 2462515200\nfile 8842293248\npagetables 24039424\nsock 0\ninactive_file 81469440\nactive_file 8760836096\nslab 23254896\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 5846",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.5GiB / 12GiB|87.49%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 6144.00M used = 5191.00M free = 953.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 470Gi 425Gi 53% 2.9M 4.5G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 0ea7b6f53af5 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8984416256,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "e7b-r4-fits-cached_pinned-rescoreTrue-before",
|
||||||
|
"qdrant_rss_bytes": 11211661312,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 8760836096,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 527360677,
|
||||||
|
"id_tracker": 77486122,
|
||||||
|
"originals": 9155275808,
|
||||||
|
"payload": 1161763572,
|
||||||
|
"quantized": 333786096
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 8842293248,
|
||||||
|
"inactive_file_bytes": 81469440,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 527470592,
|
||||||
|
"id_tracker": 77492224,
|
||||||
|
"originals": 9155334144,
|
||||||
|
"payload": 859299840,
|
||||||
|
"quantized": 333799424
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10953396224,
|
||||||
|
"pgmajfault": 5846,
|
||||||
|
"share_of_storage_cached": 0.7586,
|
||||||
|
"storage_blocks_bytes": 11655950336,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 12027767363,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n11927102728\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 11655950336
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:30:57-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8120369152 wbytes=65536 rios=62964 wios=69 dbytes=0 dios=0",
|
||||||
|
"memory.current": "9715916800",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "10737418240",
|
||||||
|
"memory.peak": "9717006336",
|
||||||
|
"memory.stat": "anon 2060644352\nfile 7613034496\npagetables 20570112\nsock 0\ninactive_file 63799296\nactive_file 7549247488\nslab 20085656\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3878",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "10737418240/10737418240",
|
||||||
|
"docker_stats_mem_usage": "8.989GiB / 10GiB|89.89%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 12829.12M free = 1506.88M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 1f38fa7d00f3 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8431112192,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "loaded-10g-cold",
|
||||||
|
"qdrant_rss_bytes": 9636495360,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549734912,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7613579264,
|
||||||
|
"inactive_file_bytes": 63856640,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 3882,
|
||||||
|
"share_of_storage_cached": 0.8669,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,53 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T00:43:32-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=15623823360 wbytes=26211254272 rios=2058869 wios=93772 dbytes=0 dios=0",
|
||||||
|
"memory.current": "8537165824",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 17227\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "10737418240",
|
||||||
|
"memory.peak": "10739765248",
|
||||||
|
"memory.stat": "file 5572902912\ninactive_file 5131849728\nactive_file 441065472\nworkingset_refault_file 3602055\nworkingset_activate_file 3602055\npgscan 5825984\npgsteal 5825966\npgmajfault 4247233",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "10737418240/10737418240",
|
||||||
|
"docker_stats_mem_usage": "3.171GiB / 10GiB|31.71%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 12749.38M free = 1586.62M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 504Gi 383Gi 57% 2.9M 4.0G 0% /System/Volumes/Data"
|
||||||
|
},
|
||||||
|
"label": "loaded-10g",
|
||||||
|
"qdrant_rss_bytes": 7520587776,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 441065472,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 5572902912,
|
||||||
|
"inactive_file_bytes": 5131849728,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 4247233,
|
||||||
|
"share_of_storage_cached": 0.6345,
|
||||||
|
"storage_blocks_bytes": 8782725120,
|
||||||
|
"workingset_refault_file": 3602055
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n0\t/qdrant/storage/collections/dbpedia_full/0/temp_segments\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782725120
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T03:15:56-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9918926848 wbytes=65536 rios=76702 wios=70 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11497574400",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11706806272",
|
||||||
|
"memory.stat": "anon 3733946368\nfile 7612809216\npagetables 24043520\nsock 0\ninactive_file 63827968\nactive_file 7548993536\nslab 20107368\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3890",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.65GiB / 12GiB|88.73%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13797.81M free = 538.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 473Gi 415Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux bf21974752d9 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8430641152,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "loaded-12g-int8",
|
||||||
|
"qdrant_rss_bytes": 11309801472,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549480960,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7613353984,
|
||||||
|
"inactive_file_bytes": 63885312,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 3894,
|
||||||
|
"share_of_storage_cached": 0.7195,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:30:07-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8120369152 wbytes=69632 rios=62964 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "9581424640",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "9652662272",
|
||||||
|
"memory.stat": "anon 1867128832\nfile 7613034496\npagetables 20312064\nsock 0\ninactive_file 63799296\nactive_file 7549247488\nslab 20049488\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3878",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "8.863GiB / 12GiB|73.86%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13087.69M free = 1248.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 8afd0c27c7a2 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8430972928,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "loaded-12g",
|
||||||
|
"qdrant_rss_bytes": 9442979840,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549734912,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7613579264,
|
||||||
|
"inactive_file_bytes": 63856640,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 3882,
|
||||||
|
"share_of_storage_cached": 0.8669,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,53 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:04:04-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=580653056 wbytes=32768 rios=5494 wios=62 dbytes=0 dios=0",
|
||||||
|
"memory.current": "1995710464",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "2092564480",
|
||||||
|
"memory.stat": "file 1544192\ninactive_file 663552\nactive_file 892928\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 3806",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "1.857GiB / 4GiB|46.41%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13444.94M free = 891.06M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 412Gi 54% 2.9M 4.3G 0% /System/Volumes/Data"
|
||||||
|
},
|
||||||
|
"label": "loaded-4g-cold",
|
||||||
|
"qdrant_rss_bytes": 9492459520,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1261568,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2387968,
|
||||||
|
"inactive_file_bytes": 1138688,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 3810,
|
||||||
|
"share_of_storage_cached": 0.0003,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,53 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:25:31-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8121778176 wbytes=69632 rios=63134 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4177817600",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 6363\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "file 2360201216\ninactive_file 433057792\nactive_file 1927151616\nworkingset_refault_file 409\nworkingset_activate_file 1\npgscan 1969995\npgsteal 1282961\npgmajfault 3891",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.486GiB / 4GiB|87.15%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 13312.00M used = 11965.00M free = 1347.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data"
|
||||||
|
},
|
||||||
|
"label": "loaded-4g-truecold",
|
||||||
|
"qdrant_rss_bytes": 4094152704,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1927651328,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2360803328,
|
||||||
|
"inactive_file_bytes": 433160192,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 3896,
|
||||||
|
"share_of_storage_cached": 0.2688,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 423
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T03:18:46-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=9920589824 wbytes=65536 rios=76840 wios=69 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4293636096",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 13548\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 13548\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294967296",
|
||||||
|
"memory.stat": "anon 3776155648\nfile 472166400\npagetables 24182784\nsock 0\ninactive_file 152727552\nactive_file 319361024\nslab 19524184\nworkingset_refault_file 158\nworkingset_activate_file 72\npgscan 2774142\npgsteal 2042585\npgmajfault 6743",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.856GiB / 4GiB|96.40%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13561.81M free = 774.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 473Gi 415Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux dcb2530c033b 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1289768960,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "loaded-4g",
|
||||||
|
"qdrant_rss_bytes": 4265353216,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 319361024,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 472166400,
|
||||||
|
"inactive_file_bytes": 152727552,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 6743,
|
||||||
|
"share_of_storage_cached": 0.0446,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 158
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:31:06-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8150450176 wbytes=69632 rios=70060 wios=70 dbytes=0 dios=0",
|
||||||
|
"memory.current": "9658400768",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "10737418240",
|
||||||
|
"memory.peak": "9729081344",
|
||||||
|
"memory.stat": "anon 1918103552\nfile 7642697728\npagetables 21835776\nsock 0\ninactive_file 92856320\nactive_file 7549857792\nslab 21445224\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 10959",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "10737418240/10737418240",
|
||||||
|
"docker_stats_mem_usage": "8.909GiB / 10GiB|89.09%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13386.50M free = 949.50M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 8921df22abee 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8460210176,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "steady-10g-cold",
|
||||||
|
"qdrant_rss_bytes": 9525358592,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549857792,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7642697728,
|
||||||
|
"inactive_file_bytes": 92856320,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 10959,
|
||||||
|
"share_of_storage_cached": 0.8702,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,53 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T00:44:13-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=17602916352 wbytes=26211254272 rios=2542046 wios=93772 dbytes=0 dios=0",
|
||||||
|
"memory.current": "10530430976",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 17227\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "10737418240",
|
||||||
|
"memory.peak": "10739765248",
|
||||||
|
"memory.stat": "file 7552147456\ninactive_file 7111094272\nactive_file 441065472\nworkingset_refault_file 4081500\nworkingset_activate_file 4081500\npgscan 5825984\npgsteal 5825966\npgmajfault 4730447",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "10737418240/10737418240",
|
||||||
|
"docker_stats_mem_usage": "3.183GiB / 10GiB|31.83%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 13312.00M used = 11836.44M free = 1475.56M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 504Gi 384Gi 57% 2.9M 4.0G 0% /System/Volumes/Data"
|
||||||
|
},
|
||||||
|
"label": "steady-10g",
|
||||||
|
"qdrant_rss_bytes": 9552195584,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 441065472,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7552147456,
|
||||||
|
"inactive_file_bytes": 7111094272,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 4730447,
|
||||||
|
"share_of_storage_cached": 0.8599,
|
||||||
|
"storage_blocks_bytes": 8782725120,
|
||||||
|
"workingset_refault_file": 4081500
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n0\t/qdrant/storage/collections/dbpedia_full/0/temp_segments\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782725120
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T03:16:13-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10218315776 wbytes=69632 rios=149547 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "11811143680",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "11827380224",
|
||||||
|
"memory.stat": "anon 3688378368\nfile 7911780352\npagetables 25485312\nsock 0\ninactive_file 362192896\nactive_file 7549599744\nslab 21781400\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 76720",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "10.66GiB / 12GiB|88.84%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 15360.00M used = 13921.06M free = 1438.94M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 473Gi 414Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux f81b12b59ea5 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8729489408,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "steady-12g-int8",
|
||||||
|
"qdrant_rss_bytes": 11564855296,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549599744,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7911780352,
|
||||||
|
"inactive_file_bytes": 362192896,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 76720,
|
||||||
|
"share_of_storage_cached": 0.7477,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:30:16-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8150450176 wbytes=69632 rios=70060 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "9651261440",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "9652662272",
|
||||||
|
"memory.stat": "anon 1902845952\nfile 7642697728\npagetables 21782528\nsock 0\ninactive_file 92856320\nactive_file 7549853696\nslab 21466448\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 10959",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "8.902GiB / 12GiB|74.18%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13204.44M free = 1131.56M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux c6474585ffd1 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8459935744,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "steady-12g",
|
||||||
|
"qdrant_rss_bytes": 9510113280,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549853696,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7642697728,
|
||||||
|
"inactive_file_bytes": 92856320,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 10959,
|
||||||
|
"share_of_storage_cached": 0.8702,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,53 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:04:28-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=610328576 wbytes=32768 rios=12616 wios=62 dbytes=0 dios=0",
|
||||||
|
"memory.current": "2047660032",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "2092564480",
|
||||||
|
"memory.stat": "file 31219712\ninactive_file 29851648\nactive_file 1380352\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 10816",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "1.878GiB / 4GiB|46.96%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 12288.00M used = 11912.69M free = 375.31M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 414Gi 54% 2.9M 4.3G 0% /System/Volumes/Data"
|
||||||
|
},
|
||||||
|
"label": "steady-4g-cold",
|
||||||
|
"qdrant_rss_bytes": 9533726720,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1380352,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 31219712,
|
||||||
|
"inactive_file_bytes": 29851648,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 10816,
|
||||||
|
"share_of_storage_cached": 0.0036,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,53 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:28:14-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=32967028736 wbytes=69632 rios=6128598 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4293996544",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 37888\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "file 2443411456\ninactive_file 514768896\nactive_file 1928650752\nworkingset_refault_file 6065505\nworkingset_activate_file 5191542\npgscan 8022027\npgsteal 7334984\npgmajfault 6076024",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.519GiB / 4GiB|87.97%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 13312.00M used = 11781.00M free = 1531.00M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data"
|
||||||
|
},
|
||||||
|
"label": "steady-4g-truecold",
|
||||||
|
"qdrant_rss_bytes": 4225097728,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 1928650752,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 2443427840,
|
||||||
|
"inactive_file_bytes": 514785280,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 6076024,
|
||||||
|
"share_of_storage_cached": 0.2782,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 6065509
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T03:18:59-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10268712960 wbytes=69632 rios=161581 wios=70 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294234112",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 14702\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 14702\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 3665833984\nfile 520237056\npagetables 25595904\nsock 0\ninactive_file 199344128\nactive_file 320905216\nslab 21174256\nworkingset_refault_file 12310\nworkingset_activate_file 12052\npgscan 2847550\npgsteal 2115993\npgmajfault 91680",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.813GiB / 4GiB|95.32%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13473.81M free = 862.19M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 473Gi 415Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 80d32684889c 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1362006016,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "steady-4g",
|
||||||
|
"qdrant_rss_bytes": 4215480320,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 320905216,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 520237056,
|
||||||
|
"inactive_file_bytes": 199344128,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 91680,
|
||||||
|
"share_of_storage_cached": 0.0492,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 12310
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T02:30:23-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=8150450176 wbytes=69632 rios=70060 wios=71 dbytes=0 dios=0",
|
||||||
|
"memory.current": "9649995776",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 0\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "12884901888",
|
||||||
|
"memory.peak": "9653133312",
|
||||||
|
"memory.stat": "anon 1894522880\nfile 7642697728\npagetables 21782528\nsock 0\ninactive_file 92856320\nactive_file 7549853696\nslab 21424232\nworkingset_refault_file 0\nworkingset_activate_file 0\npgscan 0\npgsteal 0\npgmajfault 10959",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "12884901888/12884901888",
|
||||||
|
"docker_stats_mem_usage": "8.9GiB / 12GiB|74.17%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13164.44M free = 1171.56M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 475Gi 413Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux b429aa5c96d0 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 8460009472,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "warmed-12g",
|
||||||
|
"qdrant_rss_bytes": 9501790208,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 7549853696,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372750835,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 7642697728,
|
||||||
|
"inactive_file_bytes": 92856320,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372830208,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668340224,
|
||||||
|
"quantized": 0
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 8222261248,
|
||||||
|
"pgmajfault": 10959,
|
||||||
|
"share_of_storage_cached": 0.8702,
|
||||||
|
"storage_blocks_bytes": 8782721024,
|
||||||
|
"workingset_refault_file": 0
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 9028870893,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n8928206316\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 8782721024
|
||||||
|
}
|
||||||
@@ -0,0 +1,58 @@
|
|||||||
|
{
|
||||||
|
"at": "2026-08-12T03:19:12-0400",
|
||||||
|
"cgroup": {
|
||||||
|
"io.stat": "254:0 rbytes=10568192000 wbytes=69632 rios=234687 wios=70 dbytes=0 dios=0",
|
||||||
|
"memory.current": "4294631424",
|
||||||
|
"memory.events": "low 0\nhigh 0\nmax 15807\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.events.local": "low 0\nhigh 0\nmax 15807\noom 0\noom_kill 0\noom_group_kill 0",
|
||||||
|
"memory.max": "4294967296",
|
||||||
|
"memory.peak": "4294983680",
|
||||||
|
"memory.stat": "anon 3651706880\nfile 532504576\npagetables 25579520\nsock 0\ninactive_file 211570688\nactive_file 320946176\nslab 21176984\nworkingset_refault_file 85705\nworkingset_activate_file 85447\npgscan 2917950\npgsteal 2186393\npgmajfault 165053",
|
||||||
|
"memory.swap.current": "0"
|
||||||
|
},
|
||||||
|
"container": "e7-qdrant",
|
||||||
|
"docker_memory_limit": "4294967296/4294967296",
|
||||||
|
"docker_stats_mem_usage": "3.802GiB / 4GiB|95.04%",
|
||||||
|
"host": {
|
||||||
|
"cores": 15,
|
||||||
|
"cpu": "Apple M5 Pro",
|
||||||
|
"docker_version": "29.6.2",
|
||||||
|
"docker_vm_memory_bytes": 16747134976,
|
||||||
|
"host_swap": "total = 14336.00M used = 13289.75M free = 1046.25M (encrypted)",
|
||||||
|
"image": "qdrant/qdrant:v1.19.0",
|
||||||
|
"memory_bytes": 25769803776,
|
||||||
|
"storage_device": "/dev/disk3s5 926Gi 473Gi 415Gi 54% 2.9M 4.3G 0% /System/Volumes/Data",
|
||||||
|
"vm_kernel": "Linux 9a08d76cf0e6 6.12.76-linuxkit #1 SMP Sat Jul 11 11:18:11 UTC 2026 aarch64 Linux",
|
||||||
|
"vm_page_cache_bytes": 1374101504,
|
||||||
|
"vm_swap_bytes": 1073737728
|
||||||
|
},
|
||||||
|
"label": "warmed-4g",
|
||||||
|
"qdrant_rss_bytes": 4213583872,
|
||||||
|
"resident": {
|
||||||
|
"active_file_bytes": 320946176,
|
||||||
|
"apparent_bytes": {
|
||||||
|
"graph": 372498112,
|
||||||
|
"id_tracker": 60267034,
|
||||||
|
"originals": 7120776216,
|
||||||
|
"payload": 857412510,
|
||||||
|
"quantized": 1798737736
|
||||||
|
},
|
||||||
|
"file_cache_bytes": 532504576,
|
||||||
|
"inactive_file_bytes": 211570688,
|
||||||
|
"on_disk_bytes": {
|
||||||
|
"graph": 372576256,
|
||||||
|
"id_tracker": 60268544,
|
||||||
|
"originals": 7120822272,
|
||||||
|
"payload": 668332032,
|
||||||
|
"quantized": 1798750208
|
||||||
|
},
|
||||||
|
"on_disk_total_bytes": 10020749312,
|
||||||
|
"pgmajfault": 165053,
|
||||||
|
"share_of_storage_cached": 0.0503,
|
||||||
|
"storage_blocks_bytes": 10581270528,
|
||||||
|
"workingset_refault_file": 85705
|
||||||
|
},
|
||||||
|
"storage_apparent_bytes": 10827366529,
|
||||||
|
"storage_breakdown": "15\t/qdrant/storage/collections/dbpedia_full/0/applied_seq.json\n103\t/qdrant/storage/collections/dbpedia_full/0/newest_clocks.json\n87\t/qdrant/storage/collections/dbpedia_full/0/replica_state.json\n10726701896\t/qdrant/storage/collections/dbpedia_full/0/segments\n21\t/qdrant/storage/collections/dbpedia_full/0/shard_config.json\n100663314\t/qdrant/storage/collections/dbpedia_full/0/wal",
|
||||||
|
"storage_bytes": 10581270528
|
||||||
|
}
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
{
|
||||||
|
"collection": "dbpedia_full",
|
||||||
|
"depth": 200,
|
||||||
|
"hnsw_ef": 128,
|
||||||
|
"label": "cold1-4g-int8",
|
||||||
|
"max_ms": 72.688,
|
||||||
|
"mean_ms": 20.549,
|
||||||
|
"memory_limit": "4294967296/4294967296",
|
||||||
|
"p50_ms": 18.538,
|
||||||
|
"p95_ms": 33.24,
|
||||||
|
"queries": 400,
|
||||||
|
"total_seconds": 8.22
|
||||||
|
}
|
||||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user