Howdy there, partner! Welcome on into the Stacker Saloon.
Saddle on up to a stool and spill the beans about your day, fire away with them questions, or let loose and give us the lowdown on your wild and woolly life. We're all ears, so don't hold back!
We're open round the clock, so mosey on in whenever you please!
One of the most annoying things as a solo/small-team researcher working with huge datasets is having to manage all that infra on your own.
Are there products that make it easier at least?
I don't think so(?) At least, not that I know of, but I'm only mid in terms of experience working with production grade technologies for big data
I have a 63 GB database of embeddings i'm working with, I don't want to pay cloud storage costs, so i'm just doing it all locally on my machine, and doing anything is pretty slow.
I do back it up to Dropbox, which I have a subscription for, but that's it.
damus notedeck made nostr viewable again ✨
Hahahahahahahahahhaha
"The secret of change is to focus all your energy, not on fighting the old, but on building the new."
@k00b what best practices would you recommend for making large requests to the API? Like say I wanted to retrieve every item from a specific month.
You should be able to use
topand typeallIIRC withcustomdate range, and you'll want to cursor back slowly (sleeping every so often) untilcursoris null.If
topdoesn't supportall, you can do posts and comments independently withtop.deleted by author
Nah, it should be opaque. It's probably a bug where the offset isn't overridden.
This refactor is the largest refactor of my career by miles. In the past, anything this big was a literal rewrite from scratch.
It's currently in the exciting stage of being at functional parity with prod and most of what remains is leveraging/exposing its improvements.
Why are you doing this?
We want to add 100 new floors to a 50 floor building - it needs a better foundation.
I explained the details here: #1071869
Oh wow this is exciting stuff!!!
I dunno, tackling a refactor that large, this would probably be me:
https://media4.giphy.com/media/v1.Y2lkPTZjMDliOTUybjRhNWRhcXRvdnZ1aGNlcGV3emlpNHJybGVkdWU3ZTA3aHVsYjZhbSZlcD12MV9naWZzX3NlYXJjaCZjdD1n/l4FATJpd4LWgeruTK/giphy.gif
Kudos to the SN team, it must have been quite an undertaking
It's more like this
I also have one more gigante annoyance left: migrating all the prod data to fit into the new design.
🤦🤦
lol
I hate when people say “If you look at this in real terms” meaning they used CPI to adjust the nominal inflation rate. Why they call it real never made any sense to me! They should just call it adjusted using CPI
Day 605 of posting mining earnings from the day before: 499 sats on 21Aug2025!
Running total: 403,418 sats!
Yesterday's comment
Day 606's comment
Idea for Stacker News user interface.
I hate to click on a SN item and it turns out to be just a link with a zero character introduction.
If these were flagged in some way (like character count) for the post intro I could just skip those posts.
there's a territory for it now ~hyperlinks. Regardless I suspect stackers will continue posting hyperlinks everywhere anyway
Yeah hmm
good idea.
hmmm maybe just an icon like we have for polls and bounties.
sox made the icon already
~hyperlinks is for anything at least mildly interesting that you can find on the web!
I believe the issue is that many news links are posted on SN without any comments, ~hyperlinks can’t fix this
ahh good point so I can just spam links for the hell of it
links' description should be mandatory to fix this issue
i don't think i'd support mandatory link description. Sometimes a pure link post can have value.
A simple label to advertise the fact that the post contains no text would be the way to go, imo.
so one knows before clicking, and if one knows there's no content can click directly the link.
Make sense.
Howdy Stackers,
Check out ~Goods_and_Gadgets
Let's share some cool stuff - Goods and Gadgets - that you think need a mention or worth sharing with all. Take it as a dedicated space for things/products that you use daily or accidentally find in your garage. Anything to Everything - NO HOLDING BARS!
Just some SN phone casesJust some SN phone cases
It’s now time to protect your phone… with an SN case! Available for any G00GLE Pixels, SUMSANG Galaxies & APPL iPhones
Be safe, get yours from #940482 or https://AGORA.ftp.sh/tag/phone/
deleted by author