kleebeesh

As we move more towards gitops, I see a lot of processes that could benefit from a simple UI.

Example: modifying user permissions in a kubernetes cluster:

1. User requests permission to a specific namespace by modifying a yaml file and making a PR.

2. Cluster admins review and merge the PR.

3. Cluster admins apply the change.

The paper trail of requests and reviews is a great benefit of using Git for this type of process. However it's inaccessible to users with minimal knowledge of Git.

It seems like it wouldn't be terribly difficult to build a generalizable UI for this type of process. Admins create some forms where inputs map to changes in specific files. When a user fills out a form, the app makes a PR. Admins can review and proceed as usual.

Does such a thing like this exist?

Methods like collaborative filtering via matrix factorization, Word2vec, Doc2vec, etc.. map large, sparse matrices into a low-dimensional vector space while enforcing similarity constraints. There are extensions for vectorizing various modalities (users, items, documents, audio, images, etc) into one vector-space for similarity search and recommendation ([1], [2], [3]). There is extensive research on approximate nearest-neighbor searches ([4]).

For example: it's possible to map users, songs, and artists into a common vector space ([1]). Two users who listen to similar songs have high similarity. Songs are recommended based on vector similarity to users. This pattern extends to many domains as long as there is a way to enforce similarity (likes, co-occurrences, etc.) to "train" the vectors.

In my experience, training the vectors is simpler than the engineering to efficiently query them (e.g. "select the 10 nearest neighbors to vector with ID 123"). This becomes expensive for large datasets, and correctly using the approximate nearest neighbor libraries is non-trivial.

I can't find any database to insert vectors as they're computed and then run queries against them. It seems often companies build a custom API on top of one of the approximate nearest neighbors libraries. Though the interesting queries seem pretty homogeneous.

Any ideas as to why none of the big DB players have an offering for this use-case? Like Algolia, but for vectors instead of text? Any recommendations for such a product?

[1] IHeartRadio queries various modalities of data from the same vector space: https://youtu.be/jjO1gOH-BW4?t=5m39s [2] Using a convnet to map new (cold-start) songs into an existing vector space: http://benanne.github.io/2014/08/05/spotify-cnns.html [3] Flickr similarity search: http://code.flickr.net/2017/03/07/introducing-similarity-search-at-flickr/ [4] Benchmarks for approximate nearest neighbor libs: https://github.com/erikbern/ann-benchmarks