diff --git a/qdrant-landing/content/documentation/data-management/_index.md b/qdrant-landing/content/documentation/data-management/_index.md new file mode 100644 index 000000000..26dc8fb99 --- /dev/null +++ b/qdrant-landing/content/documentation/data-management/_index.md @@ -0,0 +1,19 @@ +--- +title: Data Management +weight: 15 +--- + +## Data Management Integrations + +| Integration | Description | +| ------------------------------- | -------------------------------------------------------------------------------------------------- | +| [Airbyte](./airbyte/) | Data integration platform specialising in ELT pipelines. | +| [Airflow](./airflow/) | Platform designed for developing, scheduling, and monitoring batch-oriented workflows. | +| [Redpanda Connect](./redpanda/) | Declarative data-agnostic streaming service for efficient, stateless processing. | +| [Confluent](./confluent/) | Fully-managed data streaming platform with a cloud-native Apache Kafka engine. | +| [DLT](./dlt/) | Python library to simplify data loading processes between several sources and destinations. | +| [Fondant](./fondant/) | Framework for developing datasets, sharing reusable operations and data processing trees. | +| [MindsDB](./mindsdb/) | Platform to deploy, serve, and fine-tune models with numerous data source integrations. | +| [Apache NiFi](./nifi/) | Data ingestion platform to manage data transfer between different sources and destination systems. | +| [Apache Spark](./spark/) | A unified analytics engine for large-scale data processing. | +| [Unstructured](./unstructured/) | Python library with components for ingesting and pre-processing data from numerous sources. | diff --git a/qdrant-landing/content/documentation/frameworks/airbyte.md b/qdrant-landing/content/documentation/data-management/airbyte.md similarity index 81% rename from qdrant-landing/content/documentation/frameworks/airbyte.md rename to qdrant-landing/content/documentation/data-management/airbyte.md index 0620f3138..19839644e 100644 --- a/qdrant-landing/content/documentation/frameworks/airbyte.md +++ b/qdrant-landing/content/documentation/data-management/airbyte.md @@ -1,17 +1,16 @@ --- title: Airbyte -weight: 1000 -aliases: [ ../integrations/airbyte/ ] +aliases: [ ../integrations/airbyte/, ../frameworks/airbyte/ ] --- # Airbyte -[Airbyte](https://airbyte.com/) is an open-source data integration platform that helps you replicate your data -between different systems. It has a [growing list of connectors](https://docs.airbyte.io/integrations) that can -be used to ingest data from multiple sources. Building data pipelines is also crucial for managing the data in +[Airbyte](https://airbyte.com/) is an open-source data integration platform that helps you replicate your data +between different systems. It has a [growing list of connectors](https://docs.airbyte.io/integrations) that can +be used to ingest data from multiple sources. Building data pipelines is also crucial for managing the data in Qdrant, and Airbyte is a great tool for this purpose. -Airbyte may take care of the data ingestion from a selected source, while Qdrant will help you to build a search +Airbyte may take care of the data ingestion from a selected source, while Qdrant will help you to build a search engine on top of it. There are three supported modes of how the data can be ingested into Qdrant: * **Full Refresh Sync** @@ -24,15 +23,15 @@ You can read more about these modes in the [Airbyte documentation](https://docs. Before you start, make sure you have the following: -1. Airbyte instance, either [Open Source](https://airbyte.com/solutions/airbyte-open-source), - [Self-Managed](https://airbyte.com/solutions/airbyte-enterprise), or [Cloud](https://airbyte.com/solutions/airbyte-cloud). -2. Running instance of Qdrant. It has to be accessible by URL from the machine where Airbyte is running. +1. Airbyte instance, either [Open Source](https://airbyte.com/solutions/airbyte-open-source), + [Self-Managed](https://airbyte.com/solutions/airbyte-enterprise), or [Cloud](https://airbyte.com/solutions/airbyte-cloud). +2. Running instance of Qdrant. It has to be accessible by URL from the machine where Airbyte is running. You can follow the [installation guide](/documentation/guides/installation/) to set up Qdrant. ## Setting up Qdrant as a destination Once you have a running instance of Airbyte, you can set up Qdrant as a destination directly in the UI. -Airbyte's Qdrant destination is connected with a single collection in Qdrant. +Airbyte's Qdrant destination is connected with a single collection in Qdrant. ![Airbyte Qdrant destination](/documentation/frameworks/airbyte/qdrant-destination.png) @@ -51,7 +50,7 @@ models, including OpenAI and Cohere. ![Embeddings settings](/documentation/frameworks/airbyte/embedding.png) -Using some precomputed embeddings from your data source is also possible. In this case, you can pass the field +Using some precomputed embeddings from your data source is also possible. In this case, you can pass the field name containing the embeddings and their dimensionality. ![Precomputed embeddings settings](/documentation/frameworks/airbyte/precomputed-embedding.png) @@ -68,13 +67,13 @@ might be used as a destination. ## Setting up connection -Airbyte combines sources and destinations into a single entity called a connection. Once you have a destination -configured and a source, you can create a connection between them. It doesn't matter what source you use, as +Airbyte combines sources and destinations into a single entity called a connection. Once you have a destination +configured and a source, you can create a connection between them. It doesn't matter what source you use, as long as Airbyte supports it. The process is pretty straightforward, but depends on the source you use. ![Airbyte connection](/documentation/frameworks/airbyte/connection.png) ## Further Reading -- [Airbyte documentation](https://docs.airbyte.com/understanding-airbyte/connections/). -- [Source Code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-qdrant) +* [Airbyte documentation](https://docs.airbyte.com/understanding-airbyte/connections/). +* [Source Code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-qdrant) diff --git a/qdrant-landing/content/documentation/frameworks/airflow.md b/qdrant-landing/content/documentation/data-management/airflow.md similarity index 98% rename from qdrant-landing/content/documentation/frameworks/airflow.md rename to qdrant-landing/content/documentation/data-management/airflow.md index 50acb423d..f2591c50a 100644 --- a/qdrant-landing/content/documentation/frameworks/airflow.md +++ b/qdrant-landing/content/documentation/data-management/airflow.md @@ -1,6 +1,6 @@ --- title: Apache Airflow -weight: 2100 +aliases: [ ../frameworks/airflow/ ] --- # Apache Airflow diff --git a/qdrant-landing/content/documentation/frameworks/confluent.md b/qdrant-landing/content/documentation/data-management/confluent.md similarity index 99% rename from qdrant-landing/content/documentation/frameworks/confluent.md rename to qdrant-landing/content/documentation/data-management/confluent.md index 44ac2542a..6d58202ac 100644 --- a/qdrant-landing/content/documentation/frameworks/confluent.md +++ b/qdrant-landing/content/documentation/data-management/confluent.md @@ -1,6 +1,6 @@ --- -title: Confluent -weight: 3700 +title: Confluent Kafka +aliases: [ ../frameworks/confluent/ ] --- ![Confluent Logo](/documentation/frameworks/confluent/confluent-logo.png) diff --git a/qdrant-landing/content/documentation/frameworks/dlt.md b/qdrant-landing/content/documentation/data-management/dlt.md similarity index 98% rename from qdrant-landing/content/documentation/frameworks/dlt.md rename to qdrant-landing/content/documentation/data-management/dlt.md index 3535be35e..53f9a6ed1 100644 --- a/qdrant-landing/content/documentation/frameworks/dlt.md +++ b/qdrant-landing/content/documentation/data-management/dlt.md @@ -1,7 +1,6 @@ --- title: DLT -weight: 1300 -aliases: [ ../integrations/dlt/ ] +aliases: [ ../integrations/dlt/, ../frameworks/dlt/ ] --- # DLT(Data Load Tool) diff --git a/qdrant-landing/content/documentation/frameworks/fondant.md b/qdrant-landing/content/documentation/data-management/fondant.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/fondant.md rename to qdrant-landing/content/documentation/data-management/fondant.md index 90995cdc4..b21747f7c 100644 --- a/qdrant-landing/content/documentation/frameworks/fondant.md +++ b/qdrant-landing/content/documentation/data-management/fondant.md @@ -1,7 +1,6 @@ --- title: Fondant -weight: 1700 -aliases: [ ../integrations/fondant/ ] +aliases: [ ../integrations/fondant/, ../frameworks/fondant/ ] --- # Fondant diff --git a/qdrant-landing/content/documentation/frameworks/mindsdb.md b/qdrant-landing/content/documentation/data-management/mindsdb.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/mindsdb.md rename to qdrant-landing/content/documentation/data-management/mindsdb.md index 491b7b07a..17c75148d 100644 --- a/qdrant-landing/content/documentation/frameworks/mindsdb.md +++ b/qdrant-landing/content/documentation/data-management/mindsdb.md @@ -1,7 +1,6 @@ --- title: MindsDB -weight: 1100 -aliases: [ ../integrations/mindsdb/ ] +aliases: [ ../integrations/mindsdb/, ../frameworks/mindsdb/ ] --- # MindsDB diff --git a/qdrant-landing/content/documentation/frameworks/nifi.md b/qdrant-landing/content/documentation/data-management/nifi.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/nifi.md rename to qdrant-landing/content/documentation/data-management/nifi.md index 4464e4034..8281360fb 100644 --- a/qdrant-landing/content/documentation/frameworks/nifi.md +++ b/qdrant-landing/content/documentation/data-management/nifi.md @@ -1,6 +1,6 @@ --- title: Apache NiFi -weight: 3500 +aliases: [ ../frameworks/nifi/ ] --- # Apache NiFi diff --git a/qdrant-landing/content/documentation/data-management/redpanda.md b/qdrant-landing/content/documentation/data-management/redpanda.md new file mode 100644 index 000000000..4c583ee2f --- /dev/null +++ b/qdrant-landing/content/documentation/data-management/redpanda.md @@ -0,0 +1,47 @@ +--- +title: Redpanda Connect +--- + +[Redpanda Connect](https://www.redpanda.com/connect) is a declarative data-agnostic streaming service designed for efficient, stateless processing steps. It offers transaction-based resiliency with back pressure, ensuring at-least-once delivery when connecting to at-least-once sources with sinks, without the need to persist messages during transit. + +Connect pipelines are configured using a YAML file, which organizes components hierarchically. Each section represents a different component type, such as inputs, processors and outputs, and these can have nested child components and [dynamic values](https://docs.redpanda.com/redpanda-connect/configuration/interpolation/). + +The [Qdrant Output](https://docs.redpanda.com/redpanda-connect/components/outputs/qdrant/) component enables streaming vector data into Qdrant collections in your RedPanda pipelines. + +## Example + +An example configuration of the output once the inputs and processors are set, would look like: + +```yaml +input: + # https://docs.redpanda.com/redpanda-connect/components/inputs/about/ + +pipeline: + processors: + # https://docs.redpanda.com/redpanda-connect/components/processors/about/ + +output: + label: "qdrant-output" + qdrant: + max_in_flight: 64 + batching: + count: 8 + grpc_host: xyz-example.eu-central.aws.cloud.qdrant.io:6334 + api_token: "" + tls: + enabled: true + # skip_cert_verify: false + # enable_renegotiation: false + # root_cas: "" + # root_cas_file: "" + # client_certs: [] + collection_name: "" + id: root = uuid_v4() + vector_mapping: 'root = {"some_dense": this.vector, "some_sparse": {"indices": [23,325,532],"values": [0.352,0.532,0.532]}}' + payload_mapping: 'root = {"field": this.value, "field_2": 987}' +``` + +## Further Reading + +- [Getting started with Connect](https://docs.redpanda.com/redpanda-connect/guides/getting_started/) +- [Qdrant Output Reference](https://docs.redpanda.com/redpanda-connect/components/outputs/qdrant/) diff --git a/qdrant-landing/content/documentation/frameworks/spark.md b/qdrant-landing/content/documentation/data-management/spark.md similarity index 99% rename from qdrant-landing/content/documentation/frameworks/spark.md rename to qdrant-landing/content/documentation/data-management/spark.md index 79d1cb2c0..7f9626ece 100644 --- a/qdrant-landing/content/documentation/frameworks/spark.md +++ b/qdrant-landing/content/documentation/data-management/spark.md @@ -1,7 +1,6 @@ --- title: Apache Spark -weight: 1400 -aliases: [ ../integrations/spark/ ] +aliases: [ ../integrations/spark/, ../frameworks/spark/ ] --- # Apache Spark diff --git a/qdrant-landing/content/documentation/frameworks/unstructured.md b/qdrant-landing/content/documentation/data-management/unstructured.md similarity index 98% rename from qdrant-landing/content/documentation/frameworks/unstructured.md rename to qdrant-landing/content/documentation/data-management/unstructured.md index 3ddb71316..7d1a6f7e3 100644 --- a/qdrant-landing/content/documentation/frameworks/unstructured.md +++ b/qdrant-landing/content/documentation/data-management/unstructured.md @@ -1,6 +1,6 @@ --- title: Unstructured -weight: 1900 +aliases: [ ../frameworks/unstructured/ ] --- # Unstructured diff --git a/qdrant-landing/content/documentation/frameworks/_index.md b/qdrant-landing/content/documentation/frameworks/_index.md index a1c7933b5..72db038b2 100644 --- a/qdrant-landing/content/documentation/frameworks/_index.md +++ b/qdrant-landing/content/documentation/frameworks/_index.md @@ -3,45 +3,26 @@ title: Frameworks weight: 15 --- -| Frameworks | Description | +## Framework Integrations + +| Framework | Description | | ------------------------------------- | ---------------------------------------------------------------------------------------------------- | -| [Airbyte](./airbyte/) | Data integration platform specialising in ELT pipelines. | -| [Airflow](./airflow/) | Platform designed for developing, scheduling, and monitoring batch-oriented workflows. | -| [Apify](./apify/) | Platform to build web scrapers and automate web browser tasks. | | [AutoGen](./autogen/) | Framework from Microsoft building LLM applications using multiple conversational agents. | -| [Bubble](./bubble) | Development platform for application development with a no-code interface | -| [BuildShip](./buildship) | Low-code visual builder to create APIs, scheduled jobs, and backend workflows. | | [Canopy](./canopy/) | Framework from Pinecone for building RAG applications using LLMs and knowledge bases. | | [Cheshire Cat](./cheshire-cat/) | Framework to create personalized AI assistants using custom data. | -| [Confluent](./confluent/) | Fully-managed data streaming platform with a cloud-native Apache Kafka engine. | -| [DLT](./dlt/) | Python library to simplify data loading processes between several sources and destinations. | | [DocArray](./docarray/) | Python library for managing data in multi-modal AI applications. | -| [DocsGPT](./docsgpt/) | Tool for ingesting documentation sources and enabling conversations and queries. | | [DSPy](./dspy/) | Framework for algorithmically optimizing LM prompts and weights. | | [Fifty-One](./fifty-one/) | Toolkit for building high-quality datasets and computer vision models. | -| [Fondant](./fondant/) | Framework for developing datasets, sharing reusable operations and data processing trees. | | [Genkit](./genkit/) | Framework to build, deploy, and monitor production-ready AI-powered apps. | | [Haystack](./haystack/) | LLM orchestration framework to build customizable, production-ready LLM applications. | | [Langchain](./langchain/) | Python framework for building context-aware, reasoning applications using LLMs. | | [Langchain-Go](./langchain-go/) | Go framework for building context-aware, reasoning applications using LLMs. | | [Langchain4j](./langchain4j/) | Java framework for building context-aware, reasoning applications using LLMs. | | [LlamaIndex](./llama-index/) | A data framework for building LLM applications with modular integrations. | -| [Make](./make/) | Cloud platform to build low-code workflows by integrating various software applications. | | [MemGPT](./memgpt/) | System to build LLM agents with long term memory & custom tools | -| [MindsDB](./mindsdb/) | Platform to deploy, serve, and fine-tune models with numerous data source integrations. | -| [N8N](./n8n/) | Platform for node-based, low-code workflow automation. | -| [NiFi](./nifi/) | Data ingestion platform to manage data transfer between different sources and destination systems. | -| [OpenLIT](./openlit/) | Platform for OpenTelemetry-native Observability & Evals for LLMs and Vector Databases. | -| [OpenLLMetry](./openllmetry/) | Set of OpenTelemetry extensions to add Observability for your LLM application. | | [Pandas-AI](./pandas-ai/) | Python library to query/visualize your data (CSV, XLSX, PostgreSQL, etc.) in natural language | -| [Pipedream](./pipedream/) | Platform for connecting apps and developing event-driven automation. | -| [Portable.io](./portable/) | Cloud platform for developing and deploying ELT transformations. | -| [PrivateGPT](./privategpt/) | Tool to ask questions about your documents using local LLMs emphasising privacy. | -| [Rivet](./rivet/) | A visual programming environment for building AI agents with LLMs. | | [Semantic Router](./semantic-router/) | Python library to build a decision-making layer for AI applications using vector search. | -| [Spark](./spark/) | A unified analytics engine for large-scale data processing. | | [Spring AI](./spring-ai/) | Java AI framework for building with Spring design principles such as portability and modular design. | | [Testcontainers](./testcontainers/) | Set of frameworks for running containerized dependencies in tests. | | [txtai](./txtai/) | Python library for semantic search, LLM orchestration and language model workflows. | -| [Unstructured](./unstructured/) | Python library with components for ingesting and pre-processing data from numerous sources. | | [Vanna AI](./vanna-ai/) | Python RAG framework for SQL generation and querying. | diff --git a/qdrant-landing/content/documentation/frameworks/autogen.md b/qdrant-landing/content/documentation/frameworks/autogen.md index f2ad7eb38..50a8a26ba 100644 --- a/qdrant-landing/content/documentation/frameworks/autogen.md +++ b/qdrant-landing/content/documentation/frameworks/autogen.md @@ -1,6 +1,5 @@ --- title: Autogen -weight: 1200 aliases: [ ../integrations/autogen/ ] --- diff --git a/qdrant-landing/content/documentation/frameworks/canopy.md b/qdrant-landing/content/documentation/frameworks/canopy.md index 321915beb..78bf0c4f3 100644 --- a/qdrant-landing/content/documentation/frameworks/canopy.md +++ b/qdrant-landing/content/documentation/frameworks/canopy.md @@ -1,6 +1,5 @@ --- title: Pinecone Canopy -weight: 2500 --- # Pinecone Canopy diff --git a/qdrant-landing/content/documentation/frameworks/cheshire-cat.md b/qdrant-landing/content/documentation/frameworks/cheshire-cat.md index 1ccb91aef..389722ae5 100644 --- a/qdrant-landing/content/documentation/frameworks/cheshire-cat.md +++ b/qdrant-landing/content/documentation/frameworks/cheshire-cat.md @@ -1,6 +1,5 @@ --- title: Cheshire Cat -weight: 600 aliases: [ ../integrations/cheshire-cat/ ] --- @@ -25,6 +24,7 @@ CORE_PORT=1865 ``` Cheshire Cat takes great advantage of the following features of Qdrant: + * [Collection Aliases](../../concepts/collections/#collection-aliases) to manage the change from one embedder to another. * [Quantization](../../guides/quantization/) to obtain a good balance between speed, memory usage and quality of the results. * [Snapshots](../../concepts/snapshots/) to not miss any information. @@ -35,11 +35,12 @@ Cheshire Cat takes great advantage of the following features of Qdrant: ## How to use the Cheshire Cat ### Requirements + To run the Cheshire Cat, you need to have [Docker](https://docs.docker.com/engine/install/) and [docker-compose](https://docs.docker.com/compose/install/) already installed on your system. ```shell docker run --rm -it -p 1865:80 ghcr.io/cheshire-cat-ai/core:latest -``` +``` * Chat with the Cheshire Cat on [localhost:1865/admin](http://localhost:1865/admin). * You can also interact via REST API and try out the endpoints on [localhost:1865/docs](http://localhost:1865/docs) diff --git a/qdrant-landing/content/documentation/frameworks/docarray.md b/qdrant-landing/content/documentation/frameworks/docarray.md index 29ad1b245..022f868b6 100644 --- a/qdrant-landing/content/documentation/frameworks/docarray.md +++ b/qdrant-landing/content/documentation/frameworks/docarray.md @@ -1,16 +1,15 @@ --- title: DocArray -weight: 300 aliases: [ ../integrations/docarray/ ] --- # DocArray + You can use Qdrant natively in DocArray, where Qdrant serves as a high-performance document store to enable scalable vector search. DocArray is a library from Jina AI for nested, unstructured data in transit, including text, image, audio, video, 3D mesh, etc. It allows deep-learning engineers to efficiently process, embed, search, recommend, store, and transfer the data with a Pythonic API. - To install DocArray with Qdrant support, please do ```bash diff --git a/qdrant-landing/content/documentation/frameworks/dspy.md b/qdrant-landing/content/documentation/frameworks/dspy.md index 9d594e594..478fb7788 100644 --- a/qdrant-landing/content/documentation/frameworks/dspy.md +++ b/qdrant-landing/content/documentation/frameworks/dspy.md @@ -1,6 +1,5 @@ --- title: Stanford DSPy -weight: 1500 aliases: [ ../integrations/dspy/ ] --- diff --git a/qdrant-landing/content/documentation/frameworks/fifty-one.md b/qdrant-landing/content/documentation/frameworks/fifty-one.md index 9c7bde082..b0951affb 100644 --- a/qdrant-landing/content/documentation/frameworks/fifty-one.md +++ b/qdrant-landing/content/documentation/frameworks/fifty-one.md @@ -1,6 +1,5 @@ --- title: FiftyOne -weight: 600 aliases: [ ../integrations/fifty-one ] --- diff --git a/qdrant-landing/content/documentation/frameworks/genkit.md b/qdrant-landing/content/documentation/frameworks/genkit.md index 2f7e6eb8f..fe6a7b33b 100644 --- a/qdrant-landing/content/documentation/frameworks/genkit.md +++ b/qdrant-landing/content/documentation/frameworks/genkit.md @@ -1,6 +1,5 @@ --- title: Firebase Genkit -weight: 3400 --- # Firebase Genkit diff --git a/qdrant-landing/content/documentation/frameworks/haystack.md b/qdrant-landing/content/documentation/frameworks/haystack.md index 7f3c136e2..4245fdfb7 100644 --- a/qdrant-landing/content/documentation/frameworks/haystack.md +++ b/qdrant-landing/content/documentation/frameworks/haystack.md @@ -1,6 +1,5 @@ --- title: Haystack -weight: 400 aliases: - ../integrations/haystack/ - /documentation/overview/integrations/haystack/ @@ -8,10 +7,10 @@ aliases: # Haystack -[Haystack](https://haystack.deepset.ai/) serves as a comprehensive NLP framework, offering a modular methodology for constructing -cutting-edge generative AI, QA, and semantic knowledge base search systems. A critical element in contemporary NLP systems is an -efficient database for storing and retrieving extensive text data. Vector databases excel in this role, as they house vector -representations of text and implement effective methods for swift retrieval. Thus, we are happy to announce the integration +[Haystack](https://haystack.deepset.ai/) serves as a comprehensive NLP framework, offering a modular methodology for constructing +cutting-edge generative AI, QA, and semantic knowledge base search systems. A critical element in contemporary NLP systems is an +efficient database for storing and retrieving extensive text data. Vector databases excel in this role, as they house vector +representations of text and implement effective methods for swift retrieval. Thus, we are happy to announce the integration with Haystack - `QdrantDocumentStore`. This document store is unique, as it is maintained externally by the Qdrant team. The new document store comes as a separate package and can be updated independently of Haystack: @@ -20,7 +19,7 @@ The new document store comes as a separate package and can be updated independen pip install qdrant-haystack ``` -`QdrantDocumentStore` supports [all the configuration properties](/documentation/collections/#create-collection) available in +`QdrantDocumentStore` supports [all the configuration properties](/documentation/collections/#create-collection) available in the Qdrant Python client. If you want to customize the default configuration of the collection used under the hood, you can provide that settings when you create an instance of the `QdrantDocumentStore`. For example, if you'd like to enable the Scalar Quantization, you'd make that in the following way: @@ -47,4 +46,4 @@ document_store = QdrantDocumentStore( ## Further Reading - [Haystack Documentation](https://haystack.deepset.ai/integrations/qdrant-document-store) -- [Source Code](https://github.com/deepset-ai/haystack-core-integrations/tree/main/integrations/qdrant) \ No newline at end of file +- [Source Code](https://github.com/deepset-ai/haystack-core-integrations/tree/main/integrations/qdrant) diff --git a/qdrant-landing/content/documentation/frameworks/langchain-go.md b/qdrant-landing/content/documentation/frameworks/langchain-go.md index 21695dbb3..4ca587310 100644 --- a/qdrant-landing/content/documentation/frameworks/langchain-go.md +++ b/qdrant-landing/content/documentation/frameworks/langchain-go.md @@ -1,6 +1,5 @@ --- title: Langchain Go -weight: 2120 --- # Langchain Go @@ -30,38 +29,38 @@ Before you use the following code sample, customize the following values for you package main import ( - "log" - "net/url" + "log" + "net/url" - "github.com/tmc/langchaingo/embeddings" - "github.com/tmc/langchaingo/llms/openai" - "github.com/tmc/langchaingo/vectorstores/qdrant" + "github.com/tmc/langchaingo/embeddings" + "github.com/tmc/langchaingo/llms/openai" + "github.com/tmc/langchaingo/vectorstores/qdrant" ) func main() { - llm, err := openai.New() - if err != nil { - log.Fatal(err) - } + llm, err: = openai.New() + if err != nil { + log.Fatal(err) + } - e, err := embeddings.NewEmbedder(llm) - if err != nil { - log.Fatal(err) - } + e, err: = embeddings.NewEmbedder(llm) + if err != nil { + log.Fatal(err) + } - url, err := url.Parse("YOUR_QDRANT_REST_URL") - if err != nil { - log.Fatal(err) - } + url, err: = url.Parse("YOUR_QDRANT_REST_URL") + if err != nil { + log.Fatal(err) + } - store, err := qdrant.New( - qdrant.WithURL(*url), - qdrant.WithCollectionName("YOUR_COLLECTION_NAME"), - qdrant.WithEmbedder(e), - ) - if err != nil { - log.Fatal(err) - } + store, err: = qdrant.New( + qdrant.WithURL( * url), + qdrant.WithCollectionName("YOUR_COLLECTION_NAME"), + qdrant.WithEmbedder(e), + ) + if err != nil { + log.Fatal(err) + } } ``` diff --git a/qdrant-landing/content/documentation/frameworks/langchain.md b/qdrant-landing/content/documentation/frameworks/langchain.md index b0f82aa8c..5849f67a4 100644 --- a/qdrant-landing/content/documentation/frameworks/langchain.md +++ b/qdrant-landing/content/documentation/frameworks/langchain.md @@ -1,6 +1,5 @@ --- title: Langchain -weight: 100 aliases: - ../integrations/langchain/ - /documentation/overview/integrations/langchain/ diff --git a/qdrant-landing/content/documentation/frameworks/langchain4j.md b/qdrant-landing/content/documentation/frameworks/langchain4j.md index e226fe271..3c6039ebe 100644 --- a/qdrant-landing/content/documentation/frameworks/langchain4j.md +++ b/qdrant-landing/content/documentation/frameworks/langchain4j.md @@ -1,6 +1,5 @@ --- title: Langchain4J -weight: 2110 --- # LangChain for Java diff --git a/qdrant-landing/content/documentation/frameworks/llama-index.md b/qdrant-landing/content/documentation/frameworks/llama-index.md index 305830425..e2e213559 100644 --- a/qdrant-landing/content/documentation/frameworks/llama-index.md +++ b/qdrant-landing/content/documentation/frameworks/llama-index.md @@ -1,6 +1,5 @@ --- title: LlamaIndex -weight: 200 aliases: - ../integrations/llama-index/ - /documentation/overview/integrations/llama-index/ diff --git a/qdrant-landing/content/documentation/frameworks/memgpt.md b/qdrant-landing/content/documentation/frameworks/memgpt.md index 2c7cbb87e..ee89ad3f3 100644 --- a/qdrant-landing/content/documentation/frameworks/memgpt.md +++ b/qdrant-landing/content/documentation/frameworks/memgpt.md @@ -1,6 +1,5 @@ --- title: MemGPT -weight: 3200 --- # MemGPT diff --git a/qdrant-landing/content/documentation/frameworks/pandas-ai.md b/qdrant-landing/content/documentation/frameworks/pandas-ai.md index 8e22a7cd7..568492cac 100644 --- a/qdrant-landing/content/documentation/frameworks/pandas-ai.md +++ b/qdrant-landing/content/documentation/frameworks/pandas-ai.md @@ -1,6 +1,5 @@ --- title: Pandas-AI -weight: 2900 --- # Pandas-AI diff --git a/qdrant-landing/content/documentation/frameworks/semantic-router.md b/qdrant-landing/content/documentation/frameworks/semantic-router.md index dec075f78..70b8d18a7 100644 --- a/qdrant-landing/content/documentation/frameworks/semantic-router.md +++ b/qdrant-landing/content/documentation/frameworks/semantic-router.md @@ -1,6 +1,5 @@ --- title: Semantic-Router -weight: 2700 --- # Semantic-Router diff --git a/qdrant-landing/content/documentation/frameworks/spring-ai.md b/qdrant-landing/content/documentation/frameworks/spring-ai.md index 1d6095737..8129af2db 100644 --- a/qdrant-landing/content/documentation/frameworks/spring-ai.md +++ b/qdrant-landing/content/documentation/frameworks/spring-ai.md @@ -1,6 +1,5 @@ --- title: Spring AI -weight: 2200 --- # Spring AI diff --git a/qdrant-landing/content/documentation/frameworks/testcontainers.md b/qdrant-landing/content/documentation/frameworks/testcontainers.md index 3198cf8c0..f90104655 100644 --- a/qdrant-landing/content/documentation/frameworks/testcontainers.md +++ b/qdrant-landing/content/documentation/frameworks/testcontainers.md @@ -1,6 +1,5 @@ --- title: Testcontainers -weight: 2700 --- # Testcontainers diff --git a/qdrant-landing/content/documentation/frameworks/txtai.md b/qdrant-landing/content/documentation/frameworks/txtai.md index a9b121391..aed9c7c50 100644 --- a/qdrant-landing/content/documentation/frameworks/txtai.md +++ b/qdrant-landing/content/documentation/frameworks/txtai.md @@ -1,6 +1,5 @@ --- title: txtai -weight: 500 aliases: [ ../integrations/txtai/ ] --- @@ -8,8 +7,8 @@ aliases: [ ../integrations/txtai/ ] Qdrant might be also used as an embedding backend in [txtai](https://neuml.github.io/txtai/) semantic applications. -txtai simplifies building AI-powered semantic search applications using Transformers. It leverages the neural embeddings and their -properties to encode high-dimensional data in a lower-dimensional space and allows to find similar objects based on their embeddings' +txtai simplifies building AI-powered semantic search applications using Transformers. It leverages the neural embeddings and their +properties to encode high-dimensional data in a lower-dimensional space and allows to find similar objects based on their embeddings' proximity. Qdrant is not built-in txtai backend and requires installing an additional dependency: @@ -19,5 +18,3 @@ pip install qdrant-txtai ``` The examples and some more information might be found in [qdrant-txtai repository](https://github.com/qdrant/qdrant-txtai). - - diff --git a/qdrant-landing/content/documentation/frameworks/vanna-ai.md b/qdrant-landing/content/documentation/frameworks/vanna-ai.md index 3cf4518f7..6a1f7c06f 100644 --- a/qdrant-landing/content/documentation/frameworks/vanna-ai.md +++ b/qdrant-landing/content/documentation/frameworks/vanna-ai.md @@ -1,6 +1,5 @@ --- title: Vanna.AI -weight: 3000 --- # Vanna.AI diff --git a/qdrant-landing/content/documentation/observability/_index.md b/qdrant-landing/content/documentation/observability/_index.md new file mode 100644 index 000000000..95ea235e9 --- /dev/null +++ b/qdrant-landing/content/documentation/observability/_index.md @@ -0,0 +1,11 @@ +--- +title: Observability +weight: 15 +--- + +## Observability Integrations + +| Tool | Description | +| ------------------------------------- | ---------------------------------------------------------------------------------------------------- | +| [OpenLIT](./openlit/) | Platform for OpenTelemetry-native Observability & Evals for LLMs and Vector Databases. | +| [OpenLLMetry](./openllmetry/) | Set of OpenTelemetry extensions to add Observability for your LLM application. | diff --git a/qdrant-landing/content/documentation/frameworks/openlit.md b/qdrant-landing/content/documentation/observability/openlit.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/openlit.md rename to qdrant-landing/content/documentation/observability/openlit.md index 1d4a8ec34..87c2e9596 100644 --- a/qdrant-landing/content/documentation/frameworks/openlit.md +++ b/qdrant-landing/content/documentation/observability/openlit.md @@ -1,6 +1,7 @@ --- title: OpenLIT weight: 3100 +aliases: [ ../frameworks/openlit/ ] --- # OpenLIT diff --git a/qdrant-landing/content/documentation/frameworks/openllmetry.md b/qdrant-landing/content/documentation/observability/openllmetry.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/openllmetry.md rename to qdrant-landing/content/documentation/observability/openllmetry.md index e1767e7cb..2154db8d6 100644 --- a/qdrant-landing/content/documentation/frameworks/openllmetry.md +++ b/qdrant-landing/content/documentation/observability/openllmetry.md @@ -1,6 +1,7 @@ --- title: OpenLLMetry weight: 2300 +aliases: [ ../frameworks/openllmetry/ ] --- # OpenLLMetry diff --git a/qdrant-landing/content/documentation/platforms/_index.md b/qdrant-landing/content/documentation/platforms/_index.md new file mode 100644 index 000000000..962b72f01 --- /dev/null +++ b/qdrant-landing/content/documentation/platforms/_index.md @@ -0,0 +1,19 @@ +--- +title: Platforms +weight: 15 +--- + +## Platform Integrations + +| Platform | Description | +| ------------------------------------- | ---------------------------------------------------------------------------------------------------- | +| [Apify](./apify/) | Platform to build web scrapers and automate web browser tasks. | +| [Bubble](./bubble) | Development platform for application development with a no-code interface | +| [BuildShip](./buildship) | Low-code visual builder to create APIs, scheduled jobs, and backend workflows. | +| [DocsGPT](./docsgpt/) | Tool for ingesting documentation sources and enabling conversations and queries. | +| [Make](./make/) | Cloud platform to build low-code workflows by integrating various software applications. | +| [N8N](./n8n/) | Platform for node-based, low-code workflow automation. | +| [Pipedream](./pipedream/) | Platform for connecting apps and developing event-driven automation. | +| [Portable.io](./portable/) | Cloud platform for developing and deploying ELT transformations. | +| [PrivateGPT](./privategpt/) | Tool to ask questions about your documents using local LLMs emphasising privacy. | +| [Rivet](./rivet/) | A visual programming environment for building AI agents with LLMs. | diff --git a/qdrant-landing/content/documentation/frameworks/apify.md b/qdrant-landing/content/documentation/platforms/apify.md similarity index 98% rename from qdrant-landing/content/documentation/frameworks/apify.md rename to qdrant-landing/content/documentation/platforms/apify.md index 64cedc2cf..bdc6233ad 100644 --- a/qdrant-landing/content/documentation/frameworks/apify.md +++ b/qdrant-landing/content/documentation/platforms/apify.md @@ -1,6 +1,6 @@ --- title: Apify -weight: 3600 +aliases: [ ../frameworks/apify/ ] --- # Apify diff --git a/qdrant-landing/content/documentation/frameworks/bubble.md b/qdrant-landing/content/documentation/platforms/bubble.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/bubble.md rename to qdrant-landing/content/documentation/platforms/bubble.md index d36804531..10fa865bd 100644 --- a/qdrant-landing/content/documentation/frameworks/bubble.md +++ b/qdrant-landing/content/documentation/platforms/bubble.md @@ -1,6 +1,6 @@ --- title: Bubble -weight: 3200 +aliases: [ ../frameworks/bubble/ ] --- # Bubble diff --git a/qdrant-landing/content/documentation/frameworks/buildship.md b/qdrant-landing/content/documentation/platforms/buildship.md similarity index 96% rename from qdrant-landing/content/documentation/frameworks/buildship.md rename to qdrant-landing/content/documentation/platforms/buildship.md index 50a55e93c..66f8efbb7 100644 --- a/qdrant-landing/content/documentation/frameworks/buildship.md +++ b/qdrant-landing/content/documentation/platforms/buildship.md @@ -1,6 +1,6 @@ --- title: BuildShip -weight: 3800 +aliases: [ ../frameworks/buildship/ ] --- # BuildShip diff --git a/qdrant-landing/content/documentation/frameworks/docsgpt.md b/qdrant-landing/content/documentation/platforms/docsgpt.md similarity index 96% rename from qdrant-landing/content/documentation/frameworks/docsgpt.md rename to qdrant-landing/content/documentation/platforms/docsgpt.md index 20713bb5d..2a348e8fc 100644 --- a/qdrant-landing/content/documentation/frameworks/docsgpt.md +++ b/qdrant-landing/content/documentation/platforms/docsgpt.md @@ -1,6 +1,6 @@ --- title: DocsGPT -weight: 2600 +aliases: [ ../frameworks/docsgpt/ ] --- # DocsGPT diff --git a/qdrant-landing/content/documentation/frameworks/make.md b/qdrant-landing/content/documentation/platforms/make.md similarity index 98% rename from qdrant-landing/content/documentation/frameworks/make.md rename to qdrant-landing/content/documentation/platforms/make.md index 292bedbf7..f45f78fb8 100644 --- a/qdrant-landing/content/documentation/frameworks/make.md +++ b/qdrant-landing/content/documentation/platforms/make.md @@ -1,6 +1,6 @@ --- title: Make.com -weight: 1800 +aliases: [ ../frameworks/make/ ] --- # Make.com diff --git a/qdrant-landing/content/documentation/frameworks/n8n.md b/qdrant-landing/content/documentation/platforms/n8n.md similarity index 98% rename from qdrant-landing/content/documentation/frameworks/n8n.md rename to qdrant-landing/content/documentation/platforms/n8n.md index 298098f0b..a0da27059 100644 --- a/qdrant-landing/content/documentation/frameworks/n8n.md +++ b/qdrant-landing/content/documentation/platforms/n8n.md @@ -1,6 +1,6 @@ --- title: N8N -weight: 2000 +aliases: [ ../frameworks/n8n/ ] --- # N8N diff --git a/qdrant-landing/content/documentation/frameworks/pipedream.md b/qdrant-landing/content/documentation/platforms/pipedream.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/pipedream.md rename to qdrant-landing/content/documentation/platforms/pipedream.md index 07f45f5d1..fa6bc13dd 100644 --- a/qdrant-landing/content/documentation/frameworks/pipedream.md +++ b/qdrant-landing/content/documentation/platforms/pipedream.md @@ -1,6 +1,6 @@ --- title: Pipedream -weight: 3300 +aliases: [ ../frameworks/pipedream/ ] --- # Pipedream diff --git a/qdrant-landing/content/documentation/frameworks/portable.md b/qdrant-landing/content/documentation/platforms/portable.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/portable.md rename to qdrant-landing/content/documentation/platforms/portable.md index 5a13e81a2..4133719d4 100644 --- a/qdrant-landing/content/documentation/frameworks/portable.md +++ b/qdrant-landing/content/documentation/platforms/portable.md @@ -1,6 +1,6 @@ --- title: Portable.io -weight: 3700 +aliases: [ ../frameworks/portable/ ] --- # Portable diff --git a/qdrant-landing/content/documentation/frameworks/privategpt.md b/qdrant-landing/content/documentation/platforms/privategpt.md similarity index 96% rename from qdrant-landing/content/documentation/frameworks/privategpt.md rename to qdrant-landing/content/documentation/platforms/privategpt.md index deb25fa49..f386272ed 100644 --- a/qdrant-landing/content/documentation/frameworks/privategpt.md +++ b/qdrant-landing/content/documentation/platforms/privategpt.md @@ -1,7 +1,6 @@ --- title: PrivateGPT -weight: 1600 -aliases: [ ../integrations/privategpt/ ] +aliases: [ ../integrations/privategpt/, ../frameworks/privategpt/ ] --- # PrivateGPT diff --git a/qdrant-landing/content/documentation/frameworks/rivet.md b/qdrant-landing/content/documentation/platforms/rivet.md similarity index 97% rename from qdrant-landing/content/documentation/frameworks/rivet.md rename to qdrant-landing/content/documentation/platforms/rivet.md index c76c835ef..6e7db399e 100644 --- a/qdrant-landing/content/documentation/frameworks/rivet.md +++ b/qdrant-landing/content/documentation/platforms/rivet.md @@ -1,6 +1,6 @@ --- title: Ironclad Rivet -weight: 3100 +aliases: [ ../frameworks/rivet/ ] --- # Ironclad Rivet diff --git a/qdrant-landing/static/documentation/data-management/redpanda-social-preview.png b/qdrant-landing/static/documentation/data-management/redpanda-social-preview.png new file mode 100644 index 000000000..79ae79acb Binary files /dev/null and b/qdrant-landing/static/documentation/data-management/redpanda-social-preview.png differ