Right now we only support search on vectors of doubles, but we may want to support more types such as ints or booleans that are typically associated with quantized representations of embeddings.