Cloaked Search Performance Testing

This repository is a way to do some basic performance testing of Cloaked Search. This tests the indexing using rally and query tests using apache bench. We have some results committed and ways to run them locally and in our k8s cluster.

Note that results will vary wildly depending on your os, cpu, memory, etc. We're only really looking for if the results are wildly different when running them in k8s since we more tightly control the resources there.

Building docker container

The Dockerfile in this repo is a thin wrapper around the esrally one that just adds Apache Bench to the container. In order to build it I did the following:

docker build . -t ironcorelabs/rally:2.7.1

The version of the container should change if the Dockerfile has a different version of the rally tool inside of it.

If you're building a new version for testing using k8s, you then want to tag and push it to our private repository. For local testing this isn't required.

docker tag docker.io/ironcorelabs/rally:2.7.1  gcr.io/ironcore-dev-1/rally:2.7.1
docker push gcr.io/ironcore-dev-1/rally:2.7.1

Local testing

For local testing, you'll want to run docker compose in one of the following directories, SaaSShield or Standalone.

SaaSShield

The SaaSShield directory contains a docker compose that starts up Elastic Search, Cloaked Search and the TSP. Cloaked Search is configured to use the TSP for key management and thus each index and search call must make calls to it to get search and encryption keys.

Start up the services and run the test:

cd SaaSShield
docker compose up

The results will be in rally-home/cloaked-search-perf/results. Note that this also binds to the local port 9200 in case you want to poke at the container. If you have a local ES instance you might want to remove the port bindings.

Standalone

The Standalone directory contains a docker compose that starts up Elastic Search and Cloaked Search. Cloaked Search is configured to use a standalone key and thus no calls are made from Cloaked Search for key management.

Start up the services and run the test:

cd Standalone
docker compose up

The results will be in rally-home/cloaked-search-perf/results. Note that this also binds to the local port 9200 in case you want to poke at the container. If you have a local ES instance you might want to remove the port bindings.