krzysztof/landing_page
1
0
Fork 0
mirror of https://github.com/qdrant/landing_page.git synced 2026-09-25 22:18:30 +02:00
Code Issues Packages Projects Releases Wiki Activity

Update Blog “vector-search-for-content-based-video-recommendation-gladys-and-sam-vector-space-talk-012”

Browse Source
This commit is contained in:
demetrios
2024-03-19 15:05:24 +00:00
parent 5a6f727ff4
commit dff5a35392
1 changed files with 10 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files
qdrant-landing/content/blog/vector-search-for-content-based-video-recommendation-gladys-and-sam-vector-space-talk-012.md
+10 -10
View File
@@ -1,14 +1,14 @@
--- ---
draft: true draft: false
title: The challenges in using LLM-as-a-Judge - Sourabh Agrawal | Vector Space Talks title: The challenges in using LLM-as-a-Judge - Sourabh Agrawal | Vector Space Talks
slug: llm-as-a-judge slug: llm-as-a-judge
short_description: Sourabh Agrawal discusses the intricate world of AI chatbots. short_description: Sourabh Agrawal explores the world of AI chatbots.
description: Diving into the realm of chatbots, Sourabh Agrawal sheds light on description: Everything you need to know about chatbots, Sourabh Agrawal goes in
the intricacies of evaluating their performance, from real-time to to detail on evaluating their performance, from real-time to post-feedback
post-feedback assessments, and introduces uptrendAI—an open-source tool for assessments, and introduces uptrendAI—an open-source tool for enhancing
enhancing chatbot interactions through customized and logical evaluations. chatbot interactions through customized and logical evaluations.
preview_image: /blog/from_cms/sourabh-agrawal-bp-cropped.png preview_image: /blog/from_cms/sourabh-agrawal-bp-cropped.png
date: 2024-03-07T18:57:43.704Z date: 2024-03-19T15:05:02.986Z
author: Demetrios Brinkmann author: Demetrios Brinkmann
featured: false featured: false
tags: tags:
@@ -16,7 +16,7 @@ tags:
- LLM - LLM
- retrieval augmented generation - retrieval augmented generation
--- ---
> "*You don't want to use an expensive model like GPT 4 for evaluation, because then the cost adds up and it does not work out. Right. If you are spending more on evaluating the responses, you may as well just do something else, like have a human to generate the responses.*”\ > "*You don't want to use an expensive model like GPT 4 for evaluation, because then the cost adds up and it does not work out. If you are spending more on evaluating the responses, you might as well just do something else, like have a human to generate the responses.*”\
-- Sourabh Agrawal -- Sourabh Agrawal
> >
@@ -30,9 +30,9 @@ Sourabh Agrawal, CEO & Co-Founder at UpTrain AI is a seasoned entrepreneur and A
## **Top takeaways:** ## **Top takeaways:**
Why is real-time evaluation critical in maintaining the integrity of chatbot interactions and preventing issues like promoting competitors or making false promises? What strategies do developers employ to minimize cost while maximizing the effectiveness of model evaluations, specifically when dealing with LLMs? These might be just some of the many questions people in the industry are asking themselves. Worry not! Because Demetrios and Sourabh will break it down for you. Why is real-time evaluation critical in maintaining the integrity of chatbot interactions and preventing issues like promoting competitors or making false promises? What strategies do developers employ to minimize cost while maximizing the effectiveness of model evaluations, specifically when dealing with LLMs? These might be just some of the many questions people in the industry are asking themselves. Fear, not! Sourabh will break it down for you.
Check out their conversation as they dive into the intricate world of AI chatbot evaluations. Discover the nuances of ensuring your chatbot's quality and continuous improvement across various metrics. Check out the full conversation as they dive into the intricate world of AI chatbot evaluations. Discover the nuances of ensuring your chatbot's quality and continuous improvement across various metrics.
Here are the key topics of this episode: Here are the key topics of this episode: