reply on: SN release: semantic search \ stacker news ~meta

121 sats \ 5 replies \ @SimpleStacker 16 Jan \ on: SN release: semantic search meta

This is great! SN search functionality was pretty poor before, so hopefully this makes old posts way more searchable!

Just curious, what language model are you using to get the semantic embeddings?

this sentence transformer

deleted by author

We like using OpenSearch for search stuff so we store them there. I’m not sure if Postgres supports k-nn in arbitrary dimensions.

10k sats \ 1 reply \ @shyfire 16 Jan

deleted by author

0 sats \ 0 replies \ @k00b OP 16 Jan

You're right! Thanks for bringing it to my attention. I wasn't even aware of that extension.

I've been disappointed by pg's fts in the past so I didn't consider using pg for this, but we could make better use of the embeddings if they were in pg.