Contribution Points are go!

Just shortly about this, more later.

I do not see a big risk in switching it on (is critical feedback a risk for you?), you can switch it off any time you want.
As you said you wanted to experiment with it and our feedback is part of that. It was the only way to get the latter.
I see risk in keeping it on. That is what I’m advocating against.

As already said, later (might be days) more.

Thanks Simon for the long response.
I see especial your questions helpful to continue here in a constructive way.

I can see why you’d think that, but there will always be competitive people like myself. I actually like “leaderboards” and I do like to compete for some points (I actually hold quite some world records in video games) but on the MoT Club I’m not a huge fan of the leaderboard due to how it’s currently configured.

It’s just like stack overflow, I would “hunt for questions that I can answer” but more actively then I would normally. Don’t get me wrong here, I would still answer the questions that I can with pleasure :heart: but I wouldn’t “hunt” for them actively.

Before we had the leaderboard and while we have it, I just like to help people and share knowledge. It’s one of the best ways of consuming knowledge yourself. It’s like making a training about something you’ve learned, you’ll discover more things while making the training content. The Club is exactly the same, I’ve used a lot of frameworks and done a lot of things, but people always have other perspectives or context, which I can learn from. I can share my experience while I absorb other peoples experience.

Make it individual and not a competitive leaderboard. That way it will stay healthy. The badges system is pretty cool, although the badges could use an upgrade :wink:
This way there is no point system and people can still collect stuff for those who like gamification.

You could perhaps showcase your obtained favorite badge next to name.

Example of badges (for ideas): HackerOne

You could have badges for:

  • Attending each TestBash
  • Writing an article
  • Joining a podcast
  • Doing an AMA

People who like gamification will make effort to obtain these and you’ll get more submissions like this also for articles, …

People who don’t care for gamification and still just contribute on the forum, without having to look at some sort of point system where 1 is “better” then the other.

If you want, we can sit together and come up with a list of possibilities, I’m happy to do it. (Let some other people join also, I’m sure there will be some people willing to contribute)

6 Likes

Thanks for sharing, @kristof. Useful to get your extra take on things and those examples.

Great idea. Let’s do this as a group exercise when we’re closer to moving forward with this feature on the MoT Platform. :+1:t2:

2 Likes

I shared this idea with the team at Discourse. And they kindly pointed out that this feature already exists. :man_facepalming:t2:

So I’ve set the default view to “Week”.

Bring back Slack, it was never quiet :stuck_out_tongue:

If I could give 100 claps or hearts like on Medium then I would give it to this post :point_up:

4 Likes

Chris, it’s super clear that your posts are well thought out and considered

Thank you.

I’ll be straight up here. I didn’t expect the leaderboard to be taken as seriously as it has been

It made me feel bad, and I thought you should know. It’s clearly well implemented and well intentioned, but it feels like it’s missing what I bring and that makes me feel unvalued.

One problem is that it’s called the contribution leaderboard. A board of leading contributors. You also said that “Our challenge to you is to one day see MoT Staff not in the Top 10”, which means that the ideal is that people engage more to increase their score. I feel like I laid out my concerns already, and I have others but the tone is much the same. It means something, because it says it does, but it doesn’t mean anything because it doesn’t describe it. It’s simultaneously the least and most important list. Still, it is an experiment and you did ask for feedback, so I suppose this is part of the process.

to “see where they are at over a period of time” and use it to motivate themselves in a way that works for them

I don’t want competition. I’m a service provider. A support class. I want to get zero kills in my FPS because I’m busy enabling my team to dominate. In ways that it can motivate it can demotivate - and new engagement will be difficult, starting at zero and seeing the mountain to climb.

How can we be sensitive and inclusive to folks who are uncomfortable with points-based systems?

By not using them. It’s also a diversity issue - how do we mark posts read by people with dyslexia, or posts created for people with mobility issues that struggle with typing? People with families cannot visit as much, or stay for as much time. Can we create a level playing field for the neurodivergent? Perhaps we don’t need a playing field.

What things help motivate you already to contribute to the MoT Community?

  • Writing, explaining and coaching helps me think.
  • I enjoy writing and researching.
  • I like to engage with ideas. I’m a scientist and engineer.
  • I like to support others.
  • I like to be seen as good at what I do and get positive feedback.
  • I like to be funny sometimes.
  • Habit.
  • I want good ideas to prosper and bad ones to not. I like the idea that people will use written test cases much less, and some people will be happier at work because of that.
  • I like to be around good testers and thinkers. It helps me be better.
  • I like to engage with people. It stops me being lonely without the anxiety of more direct social interaction or over-commitment to that energy requirement.
  • I like fun. Sometimes I have fun.

This is why I think I engage. There’s also going to be a much larger contingent of passive readers, looking for value in absorbing not writing content who will have different motivations, and I think it’s worth thinking about them and how to provide them with what they want.

How might we build something that acknowledges that any form of points-based system can be gamed in some way?

Stop directly comparing non-fungible abstracts. It’s basically like counting test cases, but instead counting posts or likes.

Is there any form of metric or data point that would help you?

Not really, no. I can’t quantify a word of thanks or praise, or the warm feeling of work well done, and I don’t have a want or need to. I rely on the good will of strangers to tell me I’m a good boy.

Solutions Time

And what things that don’t exist do you think would help?

“If you want to build a ship, don’t drum up people to collect wood and don’t assign them tasks and work, but rather teach them to long for the endless immensity of the sea.”
– Antoine de Saint Exupéry

I think about this a lot. You need people to want to engage, I don’t think they can be persuaded to - and studies show that rewarding people for doing what they love leads to them requiring the reward to continue doing so.

I’m not an expert on community management or anything, but here’s some ideas to think about:

Inspiring Behaviour

Identify what behaviour you want to see, and find a way for you and the community to call it out. You could create posts praising things that are particularly helpful, funny, kind, honest or patient, and others will want to be a part of that system. They see someone being highlighted for their positive influence and want to be in the same place. Share their stories, get their bios, make them important. Everyone can be at the top of their own leaderboard.

Community-Powered Rewards

You can create a sticker system similar to Reddit’s awards, for people to mark something as particularly helpful or nice or effortful. This will be a nice way to give feedback, and something one could collect if you wanted to go that way. It’s not measured against someone, just something people could look at and feel good about. If it costs something, like contribution points for example, then it has rarity and value above a “like”, that someone took their points and spent them saying “hey, that was really good, well done”.

Gamification

I don’t like gamifying the process, and it does Disnefy the place a bit, but if you really had to gamify it you could make stickers collectible, or issue points to spend on giving them, like channel points on Twitch, redeemable for nice things like custom icons or borders. Instead of collecting points to be better than others we collect them to do stuff. You could even give discounts or small freebies from other areas in MoT if you wanted. Issue emotes usable by people who have achieved certain things. Essentially break stuff down into what you want them to do and what you could give them for it.

If you hold things like group events you could reward the people that turn up. In fact scores for turning up to events is one way to create a more even leaderboard, if you wanted one. You need to attune rewards to the vision of the community.

It’d require a lot of thought and experiment, I predict, it’s a back-and-forth meeting you’d need in order to to iron that all out.

Customisation

Our profiles are our identity. Allowing us some level of expression, without breaking the clean image of the site too badly, would provide a sense of investment and expression, and therefore belonging.

You could make profiles more customisable, typical examples are icon frames, text colours, lists of interests, banners, backgrounds.

Low-Interactivity Support

Consider reaching out to those who don’t interact on the site as much and supporting them to do so. Very few people in a community actually take part in it. Some people just need a word of encouragement or some simple directions.

Some of this might be in a comforting welcome message, how to very quickly get started with something. Optional directions on how to do simple things, how to use the tools and so on.

Use the community

You have a large pool of good testers, it’s worth using them to find all the problems before you go ahead.

The community will use whatever tools they have to hand to express themselves. We could challenge (ask) people to take part in polls, debates, digital meetups, testing challenges, creative challenges, lunchtime talks, gaming events, collaborative writing, livestreams, and we can also source the community to provide them or ideas for them. We could even hold charity events where we test apps or websites of charities (with their consent), and find problems in their systems for free. It’d be fun, and useful, and people love stuff that’s fun and useful. You get to feel good about yourself, practice testing, and perhaps work with some great people and learn new things.

Consider subgroups with different interests and ways for them to find each other. → If anyone plays Deep Rock Galactic on BST time, hit me up by the way. ←

Give people the permission they’re looking for to create. While we could create an area for people to post personal wins, or book recommendations, perhaps a personal story day where the focus is put on expression without judgement, or on the other end a gladiator pit to present ideas that you want attacked to improve them (blog drafts would be one example). There’s a difference between having a place for pet pictures and “Pet Pictures Thursday!” (I do not have a pet, it’s just an example). This would have to be advertised pretty broadly, and people need to be asked to engage with it. It’d also need moderating.

You could also look to the navigators of the community. Those that influence its tone and direction. Consider creating a connection with the community by liaising with them.

Make it easier to be artful

People want less and less text in their life. People want images and video. They want colour and formatting. If we give them a focus on tooling that provides that level of expression perhaps we could give them a way to engage in their own way but also make things easier to absorb.

Consent

I have some thoughts about interactivity and consent I’ve expressed before. The desire to be heard without judgement and the desire to better the future with antifragile argument. A separation of concerns, with subgroups or tags or something is an idea I’ve had bouncing around for some time. I present it here, unfinished, as-is. This should help to remove the fear of people like me who could cut a user in half with my razor-sharp wit and my precise spear thrusts of reasoned argument, and provide a space for people just to talk about a bad day and get a “oh, that sounds awful” rather than what I provide, a short essay on solving that problem. Sometimes people want to be heard, not fixed. Not my expertise.


Again, I’m not a community management person these are just ideas I found laying around in existing examples, or ideas I’ve come up with while writing. HTH. If you want me to chip in on a session or anything let me know and I’ll find some time.

2 Likes

Here’s an interesting gamification thought.

Wherever I sit on the leaderboard if giving a like doesn’t balance out receiving one then any reward I give is a cost to me, comparatively speaking. If I like someone else I’m down 1 point compared to them. It’s best for me to not give likes, except in some like-for-like pact I make with another user.

If you do get the point back (both people are rewarded) then the best way to move up the leaderboard would be to never issue likes to higher-engagement users, and always issue likes to lower-engagement users. That way you’re moving yourself and people lower than you up higher than people higher than you, rather than making it harder to climb past those with more points later on.

1 Like

Thanks, @kinofrost. Appreciate you sharing all this on the thread.

There are tonnes of helpful ideas and useful reflections to help us move forward with this concept.

3 Likes

“Why would they actually bother doing that?”

Because…we’re a bunch of testers? :stuck_out_tongue_winking_eye::laughing:

4 Likes

I’m a little late replying, so apologies for that.

I think this is over-complicating something that’s quite simple. The engagement from members of the community is already here, imo, but if people are interested in ‘top contributors’ then a simple stats page showing the number of posts made, number of upvotes or reactions for those posts is enough - which we already have, but its buried away a bit. It’d be good to see this info on the mini-profile modal that pops up when you click a users avatar.

@kristof badges idea is great too, and there is some sort of badge mechanic already implemented on this forum- so maybe make these more visible, and get some nicer looking badge graphics.

Screenshot 2023-05-30 at 09.12.03

3 Likes

I considered writing a bot that pings the page to see if it’d boost my score.

People don’t like being measured, especially if what it says is measures isn’t what it actually measure, and double especially if the number is used for reward or punishment. So they disengage from their original motivations and form new ones - punish the system, manipulate the outcome, prove a point, avoid judgement, gain the reward.

The evidence is everywhere. Online leaderboards with impossible scores. Speedrunning. The Barbados v Grenada 1994 Carribean Cup qualifier.

You may deliver it incorrectly, but the content is always 100% correct.

Proof of the super deep that you are. We won’t sweat over the points @kinofrost

3 Likes

This topic was automatically closed after 60 days. New replies are no longer allowed.