The No-Training Test
Will your team really use it?
The no-training test is a way to evaluate merchandise planning software by asking the people who will use it every day to complete real tasks, with no training and no vendor in the room. It answers the question a demo can't: will your team use this on their own?
Works with any vendor. About 45 minutes per person.
Features get scored. Adoption gets assumed.
Most evaluations compare features, integrations and cost. Far fewer ask whether a planner with twenty years in Excel will give up the spreadsheet they trust. Yet that decision, made quietly after go-live, is what settles whether the software gets used. One ERP consultancy argues that weak change management is what sends users back to Excel.
That planner isn't being difficult. Their spreadsheet holds years of judgment, it does what they need, and it has never surprised them in front of the CFO. If new software asks them to give that up on faith, the sensible response is to keep the spreadsheet running on the side. So test the tool with them early, and treat what they tell you as evidence.
A demo can't show you this. In a demo, an expert drives on data that was prepared for the occasion. It shows what the tool can do, not what your team will do with it on a Tuesday in the middle of a buy.
Who takes it, and the rules
- Your most Excel-loyal senior planner. If it works for them, the rest of the team will follow.
- Your newest hire. They show how quickly someone with no history in your files can get going.
- Tell them it's the software being tested, not them. Anything they can't find is a finding about the tool.
- No training, no vendor, no colleagues. Sit beside them, say nothing, and note each time they need a hint.
- Use real work where you can. Their own numbers show more than a vendor's sample, as long as you keep consumer data out.
The eight tasks
Print this table for each person. For every task, mark done alone, done with a hint or not done.
| # | Task | What to watch | Result |
|---|---|---|---|
| 1 | Sign in from the invitation | Could they get in on their own, first time? | Alone / Hint / Not done |
| 2 | Find your department in the current season | Did they get there without being shown where to look? | Alone / Hint / Not done |
| 3 | Find the purchase orders that are running late | Did they look where a planner would expect, or hunt around? | Alone / Hint / Not done |
| 4 | Change a buy quantity and see what else moves | Could they tell what the change affected, such as OTB or margin? | Alone / Hint / Not done |
| 5 | See who last changed a number, and when | Would they trust a figure they did not enter themselves? | Alone / Hint / Not done |
| 6 | Paste rows in from Excel | Did their own file come across without someone reformatting it? | Alone / Hint / Not done |
| 7 | Export a view back to Excel | Do they feel they can get their work back out? | Alone / Hint / Not done |
| 8 | Find one number they check every Monday | Is the number they rely on where they expect, and does it look right? | Alone / Hint / Not done |
Then ask the Monday question: “Would you use this on Monday instead of your spreadsheet? What would stop you?” Write down their exact words. In the end this answer matters more than the task count.
What the results tell you
This is a way to read the results, not an industry benchmark. Use the same reading for every finalist.
- Mostly done alone, and “yes” to Monday: move on to testing whether the numbers reconcile with your files.
- Done with hints, and a “yes, if…”: the “if” is your training plan. Fix what you can in the setup, then run it again.
- Stuck on trust, not on buttons: they can use it but don't believe it. Find out what their spreadsheet does that this doesn't yet.
- Mostly not done: budget for real training and support after go-live, and count that in the cost.
Ask every vendor on your shortlist the same thing
“Can our team run these eight tasks on our own, without your team in the room, before we sign?” If the answer is no, ask what has to happen first, how long it takes and what it costs. That is useful to know either way.
You can run this on RetailNorthstar with a free 30-day trial: no credit card, no call needed, and 5 to 25 seats depending on your team size, so both testers can have their own sign-in. Plans start at $999 a month if you decide to continue, with no per-user fees.
No-training test questions
What is the no-training test?
It is a way to evaluate planning software by asking the people who will use it every day to complete eight real tasks, with no training and no vendor in the room. It measures how much of the tool they can use on their own.
Does this mean software should need no training at all?
No. Any serious planning tool has depth worth learning. The test shows how much of the everyday work people can do without help, and where your training time would need to go.
Who should take the test?
At minimum, your most Excel-loyal senior planner and your newest hire. Add someone outside planning, such as finance or production, if they will use the tool too.
How long does it take?
Plan on about 45 minutes per person. Run it with each person separately, so one person does not show the next where to click.
Can we run it on any vendor?
Yes, if the vendor gives you access your team can use on its own. Use the same tasks and the same people for every finalist. If a vendor cannot offer that before you sign, ask what has to be set up first and how long it takes.
Run the test on your own team.
30 days free, with no credit card and no call needed. See what your planners do on their own.
Connected merchandise planning — live in weeks, not quarters.