pull down to refresh

0 sats \ 2 replies \ @SimpleStacker 23 Aug \ on: Stacker Saloon
One of the most annoying things as a solo/small-team researcher working with huge datasets is having to manage all that infra on your own.
write
preview
0 sats \ 1 reply \ @k00b 23 Aug
Are there products that make it easier at least?
reply
100 sats \ 0 replies \ @SimpleStacker 25 Aug
I don't think so(?) At least, not that I know of, but I'm only mid in terms of experience working with production grade technologies for big data
I have a 63 GB database of embeddings i'm working with, I don't want to pay cloud storage costs, so i'm just doing it all locally on my machine, and doing anything is pretty slow.
I do back it up to Dropbox, which I have a subscription for, but that's it.
reply