krzysztof/landing_page
1
0
Fork 0
mirror of https://github.com/qdrant/landing_page.git synced 2026-09-28 07:28:30 +02:00
Code Issues Packages Projects Releases Wiki Activity

* docs(fastembed.md): add throughput comparison chart and mention quantized models in "Under the Hood" section

Browse Source
This commit is contained in:
NirantK
2023-10-19 21:05:54 +05:30
parent a6109102b2
commit a43fd3a089
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
qdrant-landing/content/articles/fastembed.md
+2
View File
@@ -97,6 +97,8 @@ FastEmbed is built for inference speed, without sacrificing (too much) performan
We use `BAAI/bge-small-en-v1.5` as our DefaultEmbedding, hence we've chosen that for comparison:
![](/articles_data/fastembed/throughput.png)
## Under the Hood
**Quantized Models**: We quantize the models for CPU (and Mac Metal) – giving you the best buck for your compute model. Our default model is so small, you can run this in AWS Lambda if you’d like!