Opinionated MSM Community Feedback Summary
Prelude
This might be cringe since I am not exactly sure how to best make this part of our internal debate around MSM and v2 of it public without making it possibly cringe but it's important enough for me to risk cringe. If it's cringe, direct your cringe at me, lol.
I think it might be cringe since it puts SN (the company) in a weird public spot. This makes it clear that the team is not aligned in all decisions—even though it should be obvious that's not always the case and maybe that would be even more weird. Even though we all work on SN, we're still individuals with our own visions for it.
I actually had a discussion with @k00b about something else yesterday where he essentially encouraged me to have my own vision. I realized I used to have one but at some point, it must have changed to me trying to predict what @k00b's vision is. Maybe because I was trying to avoid conflict? Or because I was taking on a subordinate role and felt whatever my vision for SN is, it must be inferior to his due to my lack of professional experience? I don't know but that's another topic.
I think that was prelude enough. I thought about editing some tone in the original internal message but I figured it would be better to leave it as is. Would just take more work from me and it wouldn't feel as honest as possible.
Original Message
First of all, sorry that I didn't write something into #debate about MSM last week to discuss it in more detail. I intended to but it wasn't easy to find the right words instead of just "I don't like it and I can't tell you exactly why". But with the new iteration, it got easier thanks to the new load of comments about it and afaict, again mostly against it [0]. So here's my feedback summary (I don't want to write or burden you with a wall of text):I think paying 36 stackers more compared to March is better but I think it's still too competitive. I think this was and still is my main argument against monthly rewards (at least in this competition format and maybe I didn't articulate myself well before).It's hard to summarize all comments against MSM on SN but I'm going to try it anyway: I think the ones who mention that they don't like it essentially don't like it because it draws too much attention away from what SN was before [1]. Daily rewards were like a nice side-effect of contributing on SN but not the main driver of contributions. They were like:Hey, thanks for contributing and oh, btw, here's a daily reward.It was a fast feedback loop and it felt more like an addition to the zaps you received from the community anyway. Therefore, the main driver was interacting with the community itself and zapping or getting zapped, reading or posting content and replying. The reward was just a confirmation of how valuable your contributions on that day were. It was also a nice reminder about SN every single day. They were also private by default.This competition style with a public leaderboard seems to turn the community against it each other: hider vs non-hiders, "popular" content vs "unpopular" content, being on the leaderboard ("the popular people") vs not ("the newbies").I am honestly not surprised that MSM has not lead to more registrations since when you join SN and you see only 64 (now 100) will get paid, you're not going to feel like:Hey, I am going to commit a lot of time this month so I can maybe get on the leaderboard and get a few thousand sats even though I don't really understand how the ranking system works.(not to mention that even if you're not a new stacker or a very old stacker, you still don't understand how the ranking works)Competitions can be fun but they can also be very toxic and actually make something less fun that was fun before (making a profession out of a hobby for example).In my (probably not very humble) opinion, we're overestimating the long-term impact of MSM on the metrics instead of MSM just being a new thing that hadn't finished its first loop yet.Additionally, rationalizing decisions solely based on metrics makes us look very corporate and detached from the community:The Good
- The number of stackers earning for their posts and comments hit all-time highs (up 13% and 11% respectively in March)
- The number of stackers spending sats hit an all-time high (up 4% in March)
- The number of items created hit an all-time high (up 23% in March)
- The number of comments/post hit an all-time high (up 29% in March)
- The number of zaps hit an all-time high (up 26% in March)
- We had our second biggest month of sats spent on zaps (up 25% in March)
Mentioning only that registrations weren't up in "The Bad" also feels like a slap in the face of everyone who commented against it. All arguments against it were ignored in this section ...The Bad One metric which remained flat in March is the number of new stackers signing up to SN. We have a few experiments planned to target this specifically, which we hope will incentivize more signups and help stackers earn more for their referrals.... and were only acknowledged with this sentence in the final note:The Stacker News team has been closely monitoring feedback and data from Million Sat Madness, and has been debating the right approach to rewards both internally and on SN.From the start this was jammed down everyone's throat without stacker's input.I don't want to downplay the metrics and that we did receive more and better content (also acknowledged by some comments) but I don't think that's worth "sacrificing" the sense of community that we've built up so far. I think we're focusing too much on improving metrics. They should just be proxies for other things that are harder to measure like the direct feedback of stackers (old or new).The last month has not only pitted the community against each other but also us against the community since we seem to be too focused on improving metrics and are ignoring everything else.[0] maybe the ones who like it aren't commenting as much but I don't think that's the case (personal feeling, not based on anything tangible or also can't explain well)[1] It doesn't even seem to matter if they benefit from MSM or not. We mentioned our goal is to reward the top 100 stackers more, but did they even want more rewards? Was "we are not rewarding good content enough" really a problem that was serious enough to motivate drastic changes to rewards?
Summary of Discussion
Following this message, there was some discussion between @kr and me.
Here is my summary of it:
Registrations
- registrations numbers have been at 800 new stackers/month since 2022
- neither daily rewards nor MSM impacted registrations
- biggest driver of registrations has been paid advertising (for example, running ads on Fountain)
- we're planning to do more paid advertisement
Long Tail of Rewards: New Stackers vs Sat Farmers
- long tail means "sat farmers" are more likely to get rewards
- people spinned up multiple accounts to earn a bigger chunk of the daily rewards long tail
- only participating in contests like Meme Monday or Fun Fact Friday was enough to get daily rewards
- with monthly rewards, sat farmers who only participate on a few days per month fall behind more regular stackers
- monthly rewards might be a "nuclear option" against gaming of rewards
- maybe "how many stackers should get rewards?" is the wrong question and it should be "which stackers should get rewards?"
- how does a missing long tail of rewards impact new stackers? do they prefer a challenge with a public leaderboard or do they feel excluded and demotivated?
- even with monthly rewards, bar is still pretty low to earn rewards
Essentially, the question here might be:
What is more important: Inclusion or Competition?
Inclusion means a long tail of rewards for new stackers but also means less rewards for regular stackers. Some of these rewards then also actually go to "sat farmers" which hurts SN from two directions: good content gets rewarded less while bad content from sat farmers is rewarded more.
Competition on the other side makes the SN experience evolve more around rewards which can be too much but rewards content that most like ("good content") more. Competitions can be fun for competitive stackers but they can also get toxic and lead to turning against each other.
Awareness of Rewards
- rewards should be viewed as a bonus but are they?
- people outside of SN dismiss daily rewards: "why should I care about a few sats per day" even when told it can be 4-5 digit amounts per day
- having one big reward pool for a month grabs more attention outside of SN than smaller pools every day
- paying out one big chunk of rewards grabs more attention inside of SN than paying out smaller chunks every day (even if it leads to mostly the same amount per month)
- amount of daily rewards for great stackers ("the unspoken club") were opaque to new stackers
- daily rewards were often a surprise: surprises are nice but not knowing about daily rewards is bad
- can there be too much awareness of rewards?
Wrap Up
I hope this makes it clear that we're not unaware of the controversy around MSM but daily rewards also had their issues which might not have been as obvious as the issues with MSM.
I definitely look forward to less centralized planning from our side and more competition between territories with their own individual reward policies instead of forced competition between stackers by us but we're not there yet.
1
2
Footnotes