Live Coaching - Exploring the Black Box Puzzles

Our second interactive activity of TestBash Home with @workroomprds is going to be an exciting exercise in exploratory testing and coaching :star_struck:

To get you warmed up, you can check out the puzzles on Jamesā€™s website Black Box Puzzles.

Weā€™ll be adding all unanswered questions from the session here so if we didnā€™t get to your question, donā€™t worry, we will find you an answer :grin:

If youā€™ve thought about a question after reflecting upon the session, you can also add it here!

2 Likes

Hello! If you ask questions before, I might answer here. And theyā€™ll be on my mind in the session (a bit) and Iā€™ll see if thereā€™s a good opportunity to get to them there, too. If it doesnā€™t get in the way of the testing and coaching.

2 Likes

weā€™re doing puzzle 35 btw :slight_smile:

http://blackboxpuzzles.workroomprds.com/puzzle35/

it seems that both buttons light the lights on the right in certain order: top-down, right-left.

the difference is that the lights that were turned on by the left button fade out more quickly than by the right one. (2 sec vs 1 sec?)

anyway, both fade away by themselves. no off button.

the lights turn off by the timing of each row.

Left adds less, Right adds more.

Each row sums the time and fades away left to right.

Tools mentioned

https://www.flashbackrecorder.com/rewind/

Questions from attendees

  • Deborah: Any coaching tips to guide without giving the answers away?
  • Antonella: Great session! Are the puzzles sorted by difficulty? i.e 1 being the easiest? Thanks!
  • Isabel: On confusion: Kathy Charmaz writing about grounded theory says when you admit you are confused, then you are researchingā€¦ same with testing? The confusion is important. Admitting the confusion?
  • Deborah: Have you ever used this to interview someone for a tester role? Do you think it could work?
  • Maik Nogens: When would you suggest to not confirm your model, but switch to disprove your model?
  • Christer Nilsson Ribbing: Is there a way to get it green?
  • Darren Keig: Are there any resources / courses / other things to help someone who is interested in getting into test coaching?
  • Matthew Dubus-Cook: is your phone ringtone, that keeps going off, the start of Mariah Careyā€™s xmas song?
1 Like

Yellow doesnt light on its own. It only lights if the blue is on.

2 Likes

The two buttons seem to fill an empty queue with a command to turn on the blue button first and the yellow button second from right to left. The queue is automatically emptied based on last in, first out principle. The left button seems to control a queue in which the elements are emptied every two seconds. The right button seems to ccontrol a queue in which the elements are emptied every four seconds.

Hmm, when emptying the queue the blue en yellow are removed consequetively so there goes the two/four seconds hypothesis on removing.

In reply to one of the questions, a puzzle from James was used in my interview at Metaswitch. Not one of the public ones. I never got that one either.

Great observations ā€“ can you dream up a principle that might explain them?

Metaswitch commissioned a puzzle!

Just one queue?
(this line is filler to game the sub-20-char reply limit)

maybe itā€™s like a couple of queues (like for two different massage therapists*), blue line for therapist A, yellow line for therapist B. And the left/right buttons are for the lengths of the treatments. So if a new person comes to the line, theyā€™ll join Line A (blue) unless itā€™s longer, and then theyā€™ll join Line B (yellow).

@workroomprds - is that close to describing it?

*maybe itā€™s my back/neck talking after sitting through almost all this Test Bash :slight_smile:

1 Like
  • Deborah: Any coaching tips to guide without giving the answers away?
  1. Road-test first, use beta-testerā€™s insights as hints
  2. Try to think of the least possible new info, and then give something that moves the person halfway to it
  3. Observe whatā€™s causing confusion, and help take (that thing) away. Example for this one: concentrate on one row
  4. Observe if someoneā€™s heading down a blind alley. Ask if they feel they have no choice. Offer another choice if theyā€™re stuck.
  5. Give people a chance to say they donā€™t want the full answer.
  6. Never ever trick or misdirect if help is asked for
  • Antonella: Great session! Are the puzzles sorted by difficulty? i.e 1 being the easiest? Thanks!
    Not organised by difficulty at all. And different people find different stuff differently difficult. So: Iā€™d suggest you work /backwards/; the tech works better in newer ones with larger numbers.

  • Isabel: On confusion: Kathy Charmaz writing about grounded theory says when you admit you are confused, then you are researchingā€¦ same with testing? The confusion is important. Admitting the confusion?
    Confusion can make us freeze. Saying that one is confused helps (I reckon) to re-take control, and to make small steps out.

  • Deborah: Have you ever used this to interview someone for a tester role? Do you think it could work?
    I use it to see how people deal with triggering, observing, notes and memory, uncertainty. Other people use them in job interviews, but Iā€™m rarely in that position.

  • Maik Nogens: When would you suggest to not confirm your model, but switch to disprove your model?
    When your model seems to match your observations /so far/

  • Christer Nilsson Ribbing: Is there a way to get it green?
    Javascript

  • Darren Keig: Are there any resources / courses / other things to help someone who is interested in getting into test coaching?
    Jerry Weinbergā€™s books

  • Matthew Dubus-Cook: is your phone ringtone, that keeps going off, the start of Mariah Careyā€™s xmas song?
    No. Straightforward iOS alarm. Iā€™ve use Public Service Broadcastingā€™s Go! and Apollo440ā€™s Stop the Rock as alarm tones that get me to do stuff. Maybe Iā€™ll try Mariah. Thanks for asking.
    [/quote]

Spoiler Alert

Thatā€™s it!

2 Likes

Yay! :man_dancing:t2:
Thanks, that was an awesome challenge.
Not just solving it, but really feeling that hump of getting stuck, and dealing with it.
Really good session. :pray:t2:

1 Like

Really? ā€œThatā€™s it!ā€ ? Now, the next riddle is to find out WHY this is itā€¦ maybe I am just dumb :sweat_smile:

Hi testbashers!

Here is my take on reveling the rules of this excellent puzzle.

  1. We have two groups of buttons. Lights group are black buttons, and action buttons are white.
  2. Upper row lights are blue
  3. Lower row lights are yellow
  4. Blue light row goes first
  5. Left action button starts light timer of 2 seconds duration.
  6. Right action button starts light timer of 4 seconds duration.
  7. Action buttons confirm action with red color.

Now comes the fun part :slight_smile:

Putting lights in a queue. Que fills from right to left.
Que timer starts when light is turned on. And that counts for next light added to row que.
Each row has independent timers.

Example.

Click right button four times. Second light timer has already been started at the moment when first light in that row went off!
Which means that second row light will not go off after four seconds of its appearance time moment, but four seconds after the moment when first light went off.
Que timer is started when first light goes off.

I used my phone stopwatch.

I measured after how much time light goes off. I got consistent times just for one light in queue.

For exercise.

Fill up queues with right button. With left button.

Alternate left and right button.

Measure timings.