Welcome, Guest
Username: Password: Remember me
  • Page:
  • 1

TOPIC: Flaw in the survey about 5 v 7 rooms

Flaw in the survey about 5 v 7 rooms 1 hour ago #1

  • Fred K
  • Fred K's Avatar Topic Author
  • Away
  • 11th Level
  • Supporter
  • Posts: 4441
Before all the data is compiled from the surveys at Gencon about preferences for 5 versus 7 rooms, it is important to point out a flaw in the survey.

If I remember the phrasing, it was "would you prefer the current 5 room format versus paying $128 for a 7 room dungeon?" (it might have been "would you prefer the current 5 room format at the current price point versus paying $128 for a 7 room dungeon?")

This survey format creates several problems:
1. Referencing it as the "current format" implies that this isn't the exception but rather the norm. New players wouldn't know the differences. This is especially problematic because they aren't token buyers yet and don't realize that both the tokens and party cards are aimed at a 7 room dungeon and would need adjustments to fit a 5 room environment at appropriate challenge levels.

2. The price point was positioned in a way that didn't equally present the options. When you ask a group if they'd like to pay more for something, the general answer will be no. An objective way to ask would be either to ask if they would like to see 2 more rooms added to what they just saw at a proportional increase in price or separate out the groups by experience levels (even difficulty levels could work) and just flatly ask if they would prefer a 5 room adventure at $98 or a 7 room adventure at $128 without anything unintendedly creating bias.

I had a focus area in college on public polling - when I heard the survey, the flaw (likely unintentional) was clear.

I wouldn't recommend taking too much weight to the data you gathered from it since the results will likely point towards the bias without giving you enough data to filter out what is actionable. Sorry.

Fred
What do we want? Evidence based science! When do we want it? After peer review!

Elf Wizard build
truedungeon.com/forum?view=topic&catid=570&id=247398

Rogue build
truedungeon.com/forum?view=topic&catid=569&id=245490#287189

Items for Sale or Trade
truedungeon.com/forum?view=topic&catid=583&id=247555

Items needed to complete my collection
truedungeon.com/forum?view=topic&catid=61&id=253058

Please Log in or Create an account to join the conversation.

Flaw in the survey about 5 v 7 rooms 38 minutes ago #2

I think there were some differences in how the question was asked. In our case, the question was asked as "would prefer a 5 room adventure at $98 or a 7 room adventure at $128", and he said that the majority of his responses were a preference for the 7 room adventure.

Of course, my preference would be for a 7 room adventure for under $100, but maybe that isn't financially possible. I've always been concerned that True Dungeon prices in the triple digits would deter new players from trying it.

Please Log in or Create an account to join the conversation.

  • Page:
  • 1
Time to create page: 0.087 seconds