pull down to refresh

0 sats \ 2 replies \ @SimpleStacker 23 Aug \ on: Stacker Saloon

One of the most annoying things as a solo/small-team researcher working with huge datasets is having to manage all that infra on your own.

write
preview
0 sats \ 1 reply \ @k00b 23 Aug

Are there products that make it easier at least?

reply
100 sats \ 0 replies \ @SimpleStacker 25 Aug

I don't think so(?) At least, not that I know of, but I'm only mid in terms of experience working with production grade technologies for big data

I have a 63 GB database of embeddings i'm working with, I don't want to pay cloud storage costs, so i'm just doing it all locally on my machine, and doing anything is pretty slow.

I do back it up to Dropbox, which I have a subscription for, but that's it.

reply