new: replace images

This commit is contained in:
George Panchuk
2022-07-13 12:49:27 +03:00
parent f191dd9f76
commit d1a587629e
@@ -53,11 +53,11 @@ Then our pipeline will look like this:
For instance, we can do it with the [CLIP](https://huggingface.co/sentence-transformers/clip-ViT-B-32-multilingual-v1) model.
{{< figure src=https://storage.googleapis.com/demo-dataset-quality-public/article/category_vs_image.png caption="Category vs. Image" >}}
{{< figure src=https://storage.googleapis.com/demo-dataset-quality-public/article/outliers_category_vs_image.png caption="Category vs. Image" >}}
We can also calculate embeddings for titles instead of images, or even for both of them to find more outliers.
{{< figure src=https://storage.googleapis.com/demo-dataset-quality-public/article/category_vs_name_and_image.png caption="Category vs. Title and Image" >}}
{{< figure src=https://storage.googleapis.com/demo-dataset-quality-public/article/outliers_category_vs_name_and_image.png caption="Category vs. Title and Image" >}}
As you can see, different approaches can find new outliers, or the same ones.
Stacking several techniques or even the same techniques with different models may provide a better result.
@@ -70,7 +70,7 @@ Since pretrained models have only general knowledge about the data, they can sti
You might find yourself in a situation when the model focuses on non-important features, selects a lot of irrelevant items, and fails to find genuine outliers.
To mitigate this issue, you can perform a diversity search.
{{< figure src=https://storage.googleapis.com/demo-dataset-quality-public/article/diversity_search.png caption="Diversity search" >}}
{{< figure src=https://storage.googleapis.com/demo-dataset-quality-public/article/outliers_diversity_search.png caption="Diversity search" >}}
Diversity search utilizes the very same embeddings, and you can reuse them.
If your data is really huge and does not fit into a memory, vector search engines like [Qdrant](https://qdrant.tech/) might be helpful.