krzysztof/landing_page
1
0
Fork 0
mirror of https://github.com/qdrant/landing_page.git synced 2026-09-30 16:38:31 +02:00
Code Issues Packages Projects Releases Wiki Activity

docs: Dict options databricks.md (#837)

Browse Source 
* docs: Dict options databricks.md

* Updated _index.md
This commit is contained in:
Anush
2024-04-19 12:53:26 +05:30
committed by GitHub
parent 80cab20769
commit 6e7632bbac
2 changed files with 15 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files
qdrant-landing/content/documentation/examples/_index.md
+1
View File
@@ -20,6 +20,7 @@ is_empty: false
| [Hybrid Search on PDF Documents](../examples/hybrid-search-llamaindex-jinaai/) | Develop a Hybrid Search System for Product PDF Manuals | Qdrant, LlamaIndex, Jina AI
| [Blog-Reading RAG Chatbot](../examples/rag-chatbot-scaleway) | Develop a RAG-based Chatbot on Scaleway and with LangChain | Qdrant, LangChain, GPT-3.5
| [Movie Recommendation System](../examples/recommendation-system-ovhcloud/) | Build a Movie Recommendation System with LlamaIndex and With JinaAI | Qdrant |
| [Qdrant on Databricks](../examples/databricks/) | Learn how to use Qdrant on Databricks using the Spark connector | Qdrant, Databricks, Apache Spark |
## Notebooks
qdrant-landing/content/documentation/examples/databricks.md
+14 -19
View File
@@ -136,24 +136,19 @@ embeddings_df = spark.createDataFrame(data=embeddings, schema=schema)
- **Upload the dataframe to Qdrant:**
```python
embeddings_df.write.format("io.qdrant.spark.Qdrant").option(
"qdrant_url",
"<QDRANT_GRPC_URL>",
).option("api_key", "<QDRANT_API_KEY>").option(
"collection_name", "<QDRANT_COLLECTION_NAME>"
).option(
"vector_fields", "dense_vector"
).option(
"vector_names", "dense"
).option(
"sparse_vector_value_fields", "sparse_vector_values"
).option(
"sparse_vector_index_fields", "sparse_vector_indices"
).option(
"sparse_vector_names", "sparse"
).option(
"schema", embeddings_df.schema.json()
).mode(
options = {
"qdrant_url": "<QDRANT_GRPC_URL>",
"api_key": "<QDRANT_API_KEY>",
"collection_name": "<QDRANT_COLLECTION_NAME>",
"vector_fields": "dense_vector",
"vector_names": "dense",
"sparse_vector_value_fields": "sparse_vector_values",
"sparse_vector_index_fields": "sparse_vector_indices",
"sparse_vector_names": "sparse",
"schema": embeddings_df.schema.json(),
}
embeddings_df.write.format("io.qdrant.spark.Qdrant").options(**options).mode(
"append"
).save()
```
@@ -170,7 +165,7 @@ The command output you should see is similar to:
Command took 40.37 seconds -- by xxxxx90@xxxxxx.com at 4/17/2024, 12:13:28 PM on fastembed
```
### Gist
### Conclusion
That wraps up our tutorial! Feel free to explore more functionalities and experiments with different models, parameters, and features available in Databricks, Spark, and Qdrant.