Skip to content

Latest commit

 

History

History
221 lines (212 loc) · 9.4 KB

2024_11_14_release.md

File metadata and controls

221 lines (212 loc) · 9.4 KB
Raw

NNV-HNSW(PQ) Compare ChromaDB (HNSW)

  • fullCode : Please refer to the complete code at Example

TEST Spec

  • A dataset of approximately 1,000 restaurant reviews for testing
  • Below are the questions and the resulting reviews.
    • Q1. Where is a place with a comfortable indoor environment?
    • Q2. Where is a good restaurant to go to with family?
    • Q3. A restaurant I strongly do not recommend.

Chromadb

[
  {
    "base_review": "Where is a place with a comfortable indoor environment?",
    "similar_review": [
      {
        "review": "A large spacious place. If you want; you can relax inside and have something to drink."
      },
      {
        "review": "The indoor atmosphere was nice; but I can't say the same for the outdoor"
      },
      {
        "review": "Stylish; decent and clean place. I advise."
      },
      {
        "review": "The view is nice; the indoor seating area is quite large."
      },
      {
        "review": "It is in the center; easy to reach; close to the parking lot; the prices are partially affordable; the products are delicious but not quite satisfying; the seating places are cramped; the place is a little flat."
      }
    ],
    "latency": "1.01 ms"
  },
  {
    "base_review": "Where is a good restaurant to go to with family?",
    "similar_review": [
      {
        "review": "A decent place. You can eat as a family. You can eat many kinds of fish as grilled; fried or stewed."
      },
      {
        "review": "Nice intimate restaurant. Good service. Eye for detail. Clean. Really good food; well presented."
      },
      {
        "review": "Everyone is smilingİ the food is delicious. Great place; I recommend it."
      },
      {
        "review": "A nice cozy place. It is easily accessible from all parts of the city. It is very interesting that the restaurant does not have a menu."
      },
      {
        "review": "We went to Marmaris with my wife for a holiday. We chose this restaurant as a place for dinner based on the reviews and because we wanted juicy food. When we first went there was a serious queue. You proceed by taking the food you want in the form of an open buffet. Both vegetable dishes and meat dishes were plentiful. There was also dessert for those who wanted it. After you get what you want you pay at the cashier. They don't go through cards they work in cash. There was a lot of food variety. And the food prices were unbelievably cheap. We paid only 84 TL for all the meals here. It included buttermilk and bread. But unfortunately I can't say it's too clean as a place.."
      }
    ],
    "latency": "1.00 ms"
  },
  {
    "base_review": "A restaurant I strongly do not recommend.",
    "similar_review": [
      {
        "review": "A fast food restaurant with very friendly staff. It didn't appeal to my taste at all. Undercooked dough and lint meat."
      },
      {
        "review": "The waiters are generally very sullen and unhappy. Service is very slow. Nothing extra comes to the table. Even the starter appetizer; which is available in many kebab shops; does not come. Lahmacun was very dry and tasteless."
      },
      {
        "review": "A restaurant that has lost its previous refinement. Lahmacun as seen in the photo. The service is slow. I recommend a little more wannabe and attention."
      },
      {
        "review": "A nice cozy place. It is easily accessible from all parts of the city. It is very interesting that the restaurant does not have a menu."
      },
      {
        "review": "Ambience is very nice but they don't let you work at the outside tables; that is a negative point."
      }
    ],
    "latency": "1.00 ms"
  }
]

Pre-Trained PQ

[
  {
    "base_review": "Where is a place with a comfortable indoor environment?",
    "similar_review": [
      {
        "review": "You get full like crazy in the range of 150-200 per person. It's beautiful inside. Easy to access."
      },
      {
        "review": "Good place to eat. However; the staff work poorly: They can easily forget to bring some dishes or add seasonings; even though they previously admitted to the contrary."
      },
      {
        "review": "A decent place. You can eat as a family. You can eat many kinds of fish as grilled; fried or stewed."
      },
      {
        "review": "The place is not very big; but there are enough tables outside as well; but we sat inside. The souffles from the name of the place were very nice."
      },
      {
        "review": "The interior design is simple and pleasant; with balconies and upper floors with sea views."
      }
    ],
    "latency": "latency: 0 ms"
  },
  {
    "base_review": "Where is a good restaurant to go to with family?",
    "similar_review": [
      {
        "review": "Wonderful place where you can go with your family and have fun; nice place with live music..."
      },
      {
        "review": "Wonderful place where you can go with your family and have fun; nice place with live music..."
      },
      {
        "review": "Location is nice. We love it as a family. Pizza was delicious."
      },
      {
        "review": "It's a very nice place; the hamburger is very nice. The staff is very good; there is a children's playground"
      },
      {
        "review": "I can't say anything negative about the place, the ambiance; the staff; the richness of the food; the appetizers; the taste and the presentation; it's just perfect.. But I'm giving 3 points because it's a very expensive place."
      }
    ],
    "latency": "latency: 3 ms"
  },
  {
    "base_review": "A restaurant I strongly do not recommend.",
    "similar_review": [
      {
        "review": "The service is slow; I think there is a lack of staff and unhappiness; it has not to expensive and it was seedy experience."
      },
      {
        "review": "Flavor : It has nothing but dough taste. Labor : Not befitting a touristic place. Service : There was no wet wipes and napkins on the table, but there was no sympathetic family to say. This service and this taste were not available at this price."
      },
      {
        "review": "The fish served to me was almost raw; I couldn't eat it. A place that does not care about customer satisfaction."
      },
      {
        "review": "The fish served to me was almost raw; I couldn't eat it. A place that does not care about customer satisfaction."
      },
      {
        "review": "A nice cozy place. It is easily accessible from all parts of the city. It is very interesting that the restaurant does not have a menu."
      }
    ],
    "latency": "latency: 0 ms"
  }
]

Fit-Trained PQ

[
  {
    "base_review": "Where is a place with a comfortable indoor environment?",
    "similar_review": [
      {
        "review": "You get full like crazy in the range of 150-200 per person. It's beautiful inside. Easy to access."
      },
      {
        "review": "Good place to eat. However; the staff work poorly: They can easily forget to bring some dishes or add seasonings; even though they previously admitted to the contrary."
      },
      {
        "review": "A decent place. You can eat as a family. You can eat many kinds of fish as grilled; fried or stewed."
      },
      {
        "review": "The place is not very big; but there are enough tables outside as well; but we sat inside. The souffles from the name of the place were very nice."
      },
      {
        "review": "The interior design is simple and pleasant; with balconies and upper floors with sea views."
      }
    ],
    "latency": "latency: 0 ms"
  },
  {
    "base_review": "Where is a good restaurant to go to with family?",
    "similar_review": [
      {
        "review": "Wonderful place where you can go with your family and have fun; nice place with live music..."
      },
      {
        "review": "Wonderful place where you can go with your family and have fun; nice place with live music..."
      },
      {
        "review": "Location is nice. We love it as a family. Pizza was delicious."
      },
      {
        "review": "It's a very nice place; the hamburger is very nice. The staff is very good; there is a children's playground"
      },
      {
        "review": "I can't say anything negative about the place, the ambiance; the staff; the richness of the food; the appetizers; the taste and the presentation; it's just perfect.. But I'm giving 3 points because it's a very expensive place."
      }
    ],
    "latency": "latency: 0 ms"
  },
  {
    "base_review": "A restaurant I strongly do not recommend.",
    "similar_review": [
      {
        "review": "The service is slow; I think there is a lack of staff and unhappiness; it has not to expensive and it was seedy experience."
      },
      {
        "review": "Flavor : It has nothing but dough taste. Labor : Not befitting a touristic place. Service : There was no wet wipes and napkins on the table, but there was no sympathetic family to say. This service and this taste were not available at this price."
      },
      {
        "review": "The fish served to me was almost raw; I couldn't eat it. A place that does not care about customer satisfaction."
      },
      {
        "review": "The fish served to me was almost raw; I couldn't eat it. A place that does not care about customer satisfaction."
      },
      {
        "review": "A nice cozy place. It is easily accessible from all parts of the city. It is very interesting that the restaurant does not have a menu."
      }
    ],
    "latency": "latency: 2 ms"
  }
]