What design sprints are good for

You likely know the design sprint format already, thanks to the GVers’ evangelism: a five-day greatest-hits tour taking in collaborative ideation, sketching, prototyping, and user testing. Heavy timeboxing and lots of dot voting. It’s an intensive but effective format and, to those who don’t realise constraints force creativity, it’s surprisingly versatile.

Design sprints offer an apparently straightforward value proposition: get from idea to insight while skipping build and launch. High impact, risk reduction, learning at minimal cost – all perfectly aligned with current lean trends.
  
Sprints appeal to design consultants too. They offer clean engagement edges and require a complex skill mix – facilitation, strategy, prototyping, training – that commands high rates and opens the door to follow-on work. I love them, and they’re now the bulk of my consulting.

But I’ve done enough sprints to know the real value isn’t always as advertised. Clients naturally want to twist them for their own needs, to wring even more juice out of the process, despite the rigid structure. And that’s fine, because sprints are good at some unexpected things, and bad at some unexpected things too.
 

Design sprints are good for…

Generating momentum. Particularly in larger companies, design and innovation can appear sluggish, but a single week-long sprint lets you temporarily hush whispers of vapourware and show something – real pixels! – that represents at least a decent first thought. This makes sprints particularly valuable for new teams or leaders who want to hit the ground running. It can also galvanise teams to move quickly, setting examples of cadence and establishing a norm of getting assumptions out of heads and into product explorations. The next challenge is to maintain momentum while fending off overexcited expectations.

Highlighting the scope of the design process. Particularly for stakeholders who see design as all downstream aesthetics, a sprint demonstrates that design decisions run all the way through a product, like mould in a good cheese. Your sprint will show the value of broad input from outside PM and Design. Engineers, writers, and support staff should at least feature in Monday’s ask-the-experts interviews; better yet, they should wield pens on Tuesday and Wednesday. If your sprint goes really well, your client will spiral into existential crisis about the difference between design and product management, and you’ll know you've earned your money.

Developing the team. Best to split up prototyping duties rather than pile them all on the designer’s shoulders. So you’ll need to teach some Keynote prototyping: just enough that your teammates will add it as a skill on LinkedIn. You’ll also quickly discover when you don’t have the right people or skills in the room. Perhaps visual design becomes a bottleneck, no one wants to commit to copywriting, or the real decision-maker isn’t available: these problems won’t go away unless you address them.

Provoking core product issues. The interesting questions about a product sometimes only surface once you start designing. A design sprint is an exploratory drill for complexity – you may discover vast reservoirs of viscous complications, or your gushing wells may suddenly dry up. This is where an experienced team helps: red flags and here-be-dragons hunches are useful signals. By the end of the week, you may all be convinced the project doesn’t have legs. Usually no one will say so on the spot, so as not to repudiate a tough week, but if the week’s primary outcome is to shitcan the project, that’s great. It only took you a few £000 rather than a few £000,000.
 

Design sprints aren’t good for…

Reliable product design. Sorry. Even though you have to select tight boundaries for your prototype, you’re still going way too fast for considered design. Sketching, writing, and prototyping 10–20 pages (you’ll end up with this number, even if you try to do just four) in a day or two is a dangerous pace. Even the most experienced designer will find her sketches don’t always translate to the screen – in-tool juggling and shuffling is a natural part of the design process, and from my experience deserves a minimum of ½ day per page. The sprint offers no time for design critique and no time for polish. Nothing I’ve done in a design sprint is portfolio-ready. And that’s entirely the point. A sprint is the opening gambit of a long, complex game – a tool of provocation, not delivery.

Proposing sophisticated user research. Design sprints reflect the learn-through-making ideology that dominates tech culture today – hence Friday’s user tests. But the week does little to suggest opportunities for deeper research such as ethnography, longitudinal learning, ethical inquiry. Instead, a sprint suggests more of itself: more making, more testing, more iteration. If you’re not doing any user research that’s a decent start – you’ll at least learn some fundamental test facilitation skills, although probably not so much the synthesis and analysis, which contain the real flavour and demand practice. But beware the limitations of user tests. The design sprint doesn’t really shine a light on more sophisticated research methods, and nor is it meant to. Hire a researcher.

Answering deep product-market fit questions. A sprint will absolutely provoke these questions, and then leave you dangling. Remember this is a design sprint, not a product sprint. Don’t expect to learn much about market sizing or segmentation, customers’ propensity to pay, business model viability, or your propositional appeal against competitors. There are better tools for that. You can try to get some answers in the tests, sure, but it’s all hypotheticals all the way down – "would you pay for this?" – which are subject to all sorts of bias and divorced from true behaviour. Proper market research this is not.

Getting the green light. The only acceptable approval decision after a design sprint alone is “Let’s not do this project”. Unless the project is cheap and very low-risk (in which case, you wasted a week anyway), a design sprint won’t give you enough reliable information to approve a project. Address the previous paragraph first.
 

Some bonus tips because why not

Prototype in high fidelity. As high as you can. Real text, real images, believable visual direction, colours, type. I’m less and less convinced by low-fidelity testing: the mental gap is just too large. And why would you pass up the chance to learn about people’s responses to brand, to copy, to aesthetics?

Keynote doesn't handle scrolling well, so add a fake scrollbar for desktop-and-mouse-based prototypes. Keep it simple. It’s tempting to add a thumb (that’s the bar in the middle of the scroll track), but users will try to drag it. Up and down arrows are fine.

Amend your Keynote toolbars. Put Group/Ungroup, Front/Back/Forward/Backward, Copy/Paste Style, Mask, and Lock/Unlock in there. Like this. You'll use them a lot.

Use Keynude to override Keynote’s woeful default shape properties. For some reason I’ve found it makes some of the Keynote UI appear in French. Learn French if this is a problem.

Have a writer in the room.

In-house tests are better, but you can export your Keynote to HTML, throw it on a server, and run passable remote tests via Skype etc.

Open your test with a blank Google page / App Store / whatever page and ask users how they’d search for your product. This helps you learn about their language and existing mental models. Show them a dummy results page that links to your prototype, and away you go.

If you liked this and want someone to run a design sprint at your company, I offer a six-day consultancy package – ½ day set up, 5 days onsite (anywhere in the world, subject to visa bits), and ½ day for review, wrap-up, and next steps. Contact me to find out more.

2016 in review

It’s early for this sort of thing, but time has collapsed.

I played at being a one-percenter in 2016. I can see the appeal. I swam in rooftop pools and people called me “sir”. I waved my Platinum Ambassador card and drank champagne in airport lounges. I learned an important part of playing rich is smiling and saying thank you with plausible sincerity.

Turns out I haven’t the sustainable income or the shamelessness the lifestyle requires. A year of pampering will suffice. But I’m keeping the sport: Le Mans, Centre Court, Wrigley Field, Lord’s. Still something moving about the sacrifice, something (in DFW’s words) about athletes’ ability to “carve out exemptions from physical laws”. Wales at the Euros was beyond imagining, all heart-bursting hiraeth and boundless gratitude.

I got into cycling because it’s what thirty-something men do in my city. I worked on a few challenging projects and spent many days deep in the British Library, researching the book. I can now talk convincingly about Kantian ethics and non-human forms of agency.

My favourite album was Pantha du Prince’s The Triad. The USA elected a neofascist.

2016 – we must will it behind us, even now – was unique in its dread, so determined was its self-infliction. We wielded the razor brave and true down our own wrists. How do I reconcile the guilt of the best year of my life against a backdrop of such distress?

Perhaps it’s easiest to wallow in dystopias, because those war game scenarios, aren’t they just irresistible? Choose your own apocalypse: Putin rolls into the Baltics / Erdoğan goes full totalitarian / North Korea finally gets their physics right – whatever the route, the endgame is the same. Per Tobias Stone’s speculation, flags are hoisted, DEFCONs plummet, and people like us topple into mass graves, our Kantian ethics useless. Long-term calamity is of course assured too, now climate deniers run the world. But the long term no longer seems to matter; the future has become an anachronism.

And this is what we voted for.

Come on, they say, this is a laughable overreaction to protest politics. But I’ve read Orwell, man, I have an Economist subscription, I am the problem. We all die, but I was right, I was right, if only you’d listened…

Enough self-indulgence. Nihilism is a luxury only the privileged can afford. But the other immediately promising strategy – desperate hedonism, live for now before the New Dark Ages set in – well, I’ve rather played that out this year.

Which leaves… I don’t know what. I’m too old and cowardly for the Black Bloc antifa shit, but being careful with pronouns, reassuring people they’re welcome: it’s noble and generous, sure, but it does nothing to change this momentum. There must be other strategies, more ways to fight what today seems bleakly inevitable. I hope I find out what those are in 2017.

Blind spot

Goddamn AC in here’s like a child’s breath. First meetings are tough enough without getting this sweat on, and we’re still waiting on that refurb thanks to Homeland jumping the line. I still remember the grumbling in DOT when Homeland got their increase. You’ve never seen a pretzel line so long.

“Thank you all for being part of this historic ethics delegation. As you know, the Safer Cars on American Roads program has been active since January in Washington, Pennsylvania, and California. I think we can say that, minor bumps aside, it’s gone well at the state level.” A few Pittsburgh taxi drivers had thrown themselves under the Uber XC90s, but they’d earned only scant sympathy and six-figure medical bills.

“Before we progress to federal and NHTSA approval Meg has asked us to dialog the outstanding ethical questions. So that’s the role of this group.” Important at meetings like this to be metronomic with eye contact, to feign impartiality. There’s protocol, recordings. “Since we have a few newcomers, let’s start with brief introductions. Brief, please.”

I point my pen at the kid I’ve not met, who must be Eric. Twenty-five, six? He leans back in his chair. “I’m Eric Jo. I’m a staff engineer at Alphabet.” He means software engineer, of course – car people don’t wear those ridiculous watches. His t-shirt has ‘Google SDCP’ printed above that laughable cute fascia. Eric wears the resigned look of a young man left holding the short straw, glasses about five degrees off horizontal.

Next to Eric, Bud Carver, in his yellow Wednesday suspenders. Bud’s a professional fucking saboteur. Spends his days hovering in departmental meetings, complaining the meeting shouldn’t happen. I’ve protested to Meg of course, but the guy’s inner circle: some kind of Tea Party figure before Don threw him the DOT trimmer gig.

Been perhaps three years since I last saw Cecilia – she was at Mercedes forever, then went totally quiet. Like, nothing. Vanished from the mailing lists, wasn’t at the Denver convention, then we finally got word from Cupertino two months ago. Great engineer. We still don’t really know what they’re up to over there: all sorts of stories of cutbacks and prototypes. Not exactly a forthcoming bunch.

Of course, Facebook sent Roosevelt. Ever since the Post alleged their latest prototype brakes more heavily in front of Democrats, Legal stepped in. I tried to discourage lawyers – this is a working group after all – but it’s hard to change Facebook’s mind these days.

Dylan and I go way back. ASU, class of ’96. There were rumors Kalanick himself wanted in on the committee until Uber PR nixed the idea. Dylan wiped the floor with me at Spyglass last month: went round in 77 and won’t let me forget it. He emailed last week to announce his new title – “Director of Strategic Infrastructural Programs Direction” – and asking “to powwow about subsidy opportunities” before the next spending reviews.

“I’m Alexandrine Lang, I head up future projects at VW Group.” Three weeks back, an Audi A6 suddenly occupied Meg’s parking space, GM-Ford were out, and Alexandrine was on the list. The PR optics aren’t good since we let VW wriggle off the emissions hook, but at least they’re eager to please.

Finally, Floren Moïse. Heard he was the only Georgia Tech guy to decline the UPS offer. Meg’d be happy to ditch him, but Floren adds spice: specifically, he drives Bud crazy. I don’t know how exchange programs work in that world, but Atlanta has eroded his accent somewhat. He’s wearing one of those collarless shirts, buttoned to the top. A dapper academic: who’d have thought?

“Thanks everyone. Jaxson sends his apologies – as you know, the Autopilot hearings are ongoing and delicate, so we agreed Tesla should step back for now.”

The coffee pot spits in the corner. A fern wilts silently in the heat.

“Our first order of business is federal border protocol. Our friends at Justice tell me you’ve all implemented their patrol-car stop recommendations; they pass on their thanks. We now have to consider how to handle international crossings.

“Per last week’s memo, Homeland has requested not only the checkpoint dead-zone but remote shutdown capability within a 3-mile radius. This would mostly be an issue on the Canadian border, of course, but while California’s dragging its heels over the Wall, it may be relevant in the south too.”

“Three miles is going to be risky," says Eric. "From an engineering point of view of course there’s no obstacle, but at that range I don’t think we can guarantee safe shutdown in mixed-autonomy traffic, unless we have the specialized lane filters.”

Cecilia speaks precisely over steepled hands. “Our view is that a remote disable sets a worrying precedent. A backdoor is a euphemism for a vulnerability, after all.” She hesitates. “I must add however that Apple has no official stance on autonomous vehicle behavior, and I am unable to confirm or deny my presence at this delegation.”

“Look, the Russians are basically all over our asses at this point, Tom,” says Dylan. “Putin’s got a gifted crew behind him now, and if we give Homeland a backdoor it’s just a matter of time until the Russians jack-knife a semi on I-5. Christ, Tom, it’ll be a mess. Uber… they don’t want to put passenger lives in danger.”

“But the true problem,” interrupts Floren, “is we would be subverting the established capitalist model of ownership, we reframe the relations of subject-object. Are we morally justified in imposing this ludicrous proto-authoritarianism on the world?”

It’s usually harmless to let Floren lap the course a few times, to let him exercise those post-nominals and flap about us focusing on the wrong horizon. By the time he’s expounded upon the distinction between deontology and consequentialism, Bud’s eyelids are twitching.

“Let’s get back on track, folks,” I say. “Frankly, I’m not worried about a little top-down control. Our focus groups tell us that, except for the usual ACLU types, citizens are comfortable with authority intervention, so long as it’s framed as a safety measure. But let’s cut the crap – we all know the deal with the remote shutdown. You just want deniability in case another Snowden crawls out.”

“Well, silence that made whole scenario far more painful than it needed to be,” says Roosevelt. “If DOJ actually allowed us to disclose interventions I’m sure we’d all be warmer to the idea. This is basic First Amendment stuff, Tom, and as you know we’ve been over it a thousand times with any department that will listen. And since the FBI disclosure cases are still in this mysterious holding pattern, we don’t seem to be getting anywhere.”

“Yeah, okay, look – it’s between you and Homeland really. We’re just the messenger on this one,” I say.

“I think the moral angle has to be secondary to the legal case. If Homeland makes a formal request we’ll consider it through the proper channels. Until then, it’s a no.”

Bud, already on his third cookie, is staring at Alexandrine. A small column of saliva pulses between his open lips. She shifts awkwardly in her seat.

“Fine,” I say, “I’ll circle back with Homeland’s counsel. They seemed eager, so my guess is this’ll come back. Anyway, since we’re on legal turf, let’s move into collision liability.” Bud shuffles his papers; everyone else swipes their tablet. “Per the April ISO draft, vendors will assume liability in level four-compliant autonomous modes. So we still have to thrash out what we’re doing about laggard firmware. Uh, Dylan, can you update us on Uber’s stance here?”

“Sure,” Dylan says. “They’re now prepared to disable vehicles once they’re 30 days behind the upgrade curve. But as you know, inventory is Uber’s priority – vehicles out of service really hurt their passenger load factor. So for lesser lags the passenger will see a HUD warning, and if they dismiss it, liability shifts to the passenger or his insurer per EULA.”

“Okay, thanks. Alexandrine, since VW is new to the group, can you fill us in on their thoughts?”

“We’ve carried out surveys to crowdsource our collision heuristics, which we expect to underpin all software versions. So patching shouldn’t be an issue. Actually, the surveys have been very illuminating. They’re based on something called the trolley problem – have you all heard of it?”

An exasperated crunch escapes from Floren’s throat, and Cecilia and I exchange a glance. Eric takes pity first. “Look… the trolley problem is basically useless in real life. If you find yourself crashing it’s because you fucked up three seconds earlier, and the answer is almost always just to smash the brakes. Steering makes you lose more control, and a few mph might make all the difference.”

“Gotta say I’m with Eric here, Alexa,” says Dylan.

“Alexandrine.”

“Oh – Alexandra, sure. Sounds like you should lean on your machine learning guys more. Predictive heuristics are a waste of time. Ship with an adaptive ML system, learn from fleet damage, injury records, y’know? Let the algorithm choose a response based on previous patterns.”

“Nom de bleu,” cries Floren. “You tech people are like this always. Such wretched solutionism! Kill a few people but never mind, just tweak the algorithm! It’s… it’s indecent,” – his chair rocks forward – “the way you wash your hands of moral agency, when it is through your own technology that these futures are mediated.”

Bud waves a disdainful hand. “Now Floren, I’m sure we all read your piece in Armchair Ethicist Weekly, but this is about American industry. The real world, you get it? This isn’t the time for philosophizing.”

“Monsieur Carver, now is precisely the time for philosophizing!”

I have to step in. “Okay, so Alexandrine, I think we need to cover VW’s approach in more detail before the next licensing committee. I’ll ask the team to review with you next week.

“I guess we should move on to the final agenda item, which is HIMs of course. As you know, highly intimate moments in moving vehicles are mostly covered by states’ reckless driving or indecency laws. But, er, certain… media properties are concerned about moral corruption – tinted windscreens, mobile brothels, all that panic. So I need to bring Justice a recommendation that’s going to balance the realities of driverless time with this political aspect.”

Bud sits bolt upright. Crumbs fly from his mouth. “Gimme a break! Classic example of government meddling in the lives of ordinary people. Some guy wants to bust a nut in his car? Big deal. So long as it’s discreet, so long as it’s legal, let him.”

“Obv–”

“But nothing kinky.”

“Obviously our incognito mode disables internal cameras,” says Eric. “Or at least, it disables transmission anyway. But our view is essentially that this is just another connected device, and who are we to dictate use cases?”

“Discretion is important,” says Cecilia. “HIMs are, how should I say, seen as incompatible with our brand. As you know, we’ve disallowed adult content on the App Store for years. But also, people will do what people do. Our primary concern is inadvertent audio triggering by user vocalizations. I’ll have the Siri engineering team provide an update, although I can’t confirm whether such a team exists.”

“Facebook is keen to keep this area as loose as possible, Tom,” says Roosevelt. “As you know, intimacy has proven to be a surprising growth area for Oculus, and we think it would be a shame if overregulation got in the way of these exciting new forms of self-expression. Not to mention the potential constitutional issues.”

***

“Hi Meg. Good weekend?”

“Ah Tom. Yes, thanks. Kids up, so you know: zoo, tantrums.”

“So, you wanted to see me?”

“Yes, sit down. How are things with the ethics panel?”

“Fine. Still working with VW on their heuristics. They’re, well, they’re a long way behind. But Homeland have backed off remote disable for now: something about reassessing terrorism vectors, new strategy soon. We’re meeting again early next month. Tenth maybe.”

“Ok, well I have an update from my end. Seems Bud’s been talking to Dylan and the other vendors since the meeting, and… they’ve tabled a new approach. They’ve asked that we look again at self-regulation…”

“Oh, you’ve got to be—”

“…and DOT’s agreed we’ll suspend the delegation…”

 “—shitting me!”
 
 “…to let vendors choose their own approaches. We’ll monitor progress with DOJ, and—“

“They screwed me!” Shot a 77, then shot me in the back. 

“Oh, don’t be melodramatic, Tom. Look, word is Don himself had a hand in it: jobs on the line and all that. You know policy priorities take precedence; not a lot we can do from our level.”

I shake my head. “Unbelievable. Wait, all of them? Floren?”

“Oh, Floren.” Meg laughs. “He’s fuming, of course, but Legal waved the NDA and he calmed down.”

“Motherfuckers.”

“Look, Tom, I get that you’re upset but really, I think the ethics thing is overblown. These guys are innovators, remember? Smart people. It’s not good business for Silicon Valley to do unethical things; the market will iron out any misbehavior.” She pauses to sip her coffee. “And besides, if things do start out a little hairy, we still have plenty of budget for signage and public information programs.”

The improbability of Alex Hales

Occupying as it does the fragile months of the summer, English cricket is deeply influenced by alcohol. While football terrace prohibition causes binge-drinking before kickoff, cricket presents a daylong test of boozy stamina. Cup deposit schemes and zealous stewarding have made the beer snake an endangered species, but the cricket and a stag night remain the only places at which an Englishman can consider fancy dress.

This does not make for precise memories.

Ah, but I forgot. You Americans, you don't understand cricket. Actually, you relish not understanding it, this daft tortoise game of bad teeth, straight elbows, and dinner etiquette, as enacted by Britain and Her Colonies.

But you like baseball, which makes explanation surprisingly easy. Cricket is baseball but really, really hard to get someone out. While baseball outs tumble like autumn leaves, a cricket 'wicket' is a gleaming butterfly on a spring morning. Hundreds of runs are scored. A game lasts five days. This, you begin to understand, is why we drink.

I watch quite a lot of cricket, mostly Middlesex and England. (These deserve nominative elaboration. Middlesex are a London-based team named after an obsoleted county; the anachronisms pile up quickly in this game. The team called England is the responsibility of the England and Wales Cricket Board, allowing me as a Welshman to pledge allegiance.)

I drink less than I used to, as maturity has grown and my tolerance dropped. But it’s fair to say that cricket's longitude and consumptions, and my woeful memory, have made my cricket memories melt together. It's been marvellous, sunburned, imprecise fun; I've seen no-balls, legends, centuries, dogged controversies; but I'd struggle to recall exactly when and where and who.

Until last week.

England batsman Alex Hales has had an awful summer. On the brink of deselection, he was a man at war with own psyche. With a game based on quick scoring, on aggression and active intent, he too often has lacked the technique and patience required of an opening batsman. Just one week ago he played perhaps his worst ever England innings, staying in just long enough to, in the words of one commentator, look really bad.

On Tuesday his luck was in. A one-day match at his home ground, Trent Bridge, against a Pakistan team that excels at the five-day game but is short of quality in the short stuff.

Tuesday's game will stick around, unlike others, because it broke all-time records. Hales played perhaps the worst best-of-all-time innings I've seen, swiping the bat recklessly, bisecting fielders with mishits. Commitment and luck overruled control and timing. Cat-like, he survived many deaths, including a dropped catch and a dismissal reversed by a no-ball. Dancing on the knife edge of fortune, Hales was electrifying. His partner Joe Root, the world's leading exponent of eloquent batting, capable of exquisite shots that catch your breath like only great poetry can – looked ordinary in comparison.

By the time he finally yielded his wicket, Hales had scored 171, an English record. And England themselves weren't done. Hales's departure brought in Jos Buttler, a known slogger, who feasted on some poor Pakistan bowling to rack up a lightning 90 not out. Buttler too rode his luck, clean bowled at one point but – to whoops around the ground – recalled after the TV umpire declared another no-ball. With his last stroke, Buttler hit the boundary that sealed the all-time record score. England ended on 444–3 off fifty overs; a score unfathomable a generation ago.

Hales is a vigorous but fragile player who threw caution aside. Batting form moves slowly, as befits this intensely slow game. Recovery often requires a spell out of the limelight, some time playing to tiny crowds in domestic cricket. Rarely do we see a transformation this abrupt. It's easy to overplay the triumph-of-the-human-spirit angle, but Hales was somehow able to shed his mental shackles for a day and produce something extraordinary. He has not cured his technique issues. He may yet not be the man England need as a Test Match opener. But for one day, the world truly rotated along his axis. And to be there was to witness a day when cricket surpassed itself, that became not just about sunburn, cider, and cheers, but genuine sporting improbability.

“It can be a cruel game” Hales said afterwards, “and it can be the best game in the world."

Inherent and acquired diversity

[Capturing a tweet drizzle in a better format.]

There are actually two dimensions to diversity. One is ‘inherent’ diversity in traits such as gender, ethnicity, age, sexuality. Lots of welcome focus on improving this through recruitment practices, addressing bias, etc.

But poor decisions can also stem from a lack of ‘acquired’ diversity: a homogeneity of backgrounds, languages, life experiences. This gets easier as you get older / richer / more senior – more breadth, more travel, more inputs. But it's also a personal responsibility.

So, people of tech: Travel! Learn new languages! Hang with people outside your socioeconomic group! Work abroad! Dabble! You’ll become a more rounded person with broader and more useful perspectives. And you’ll have a lot of fun too.

A 🔒 user wisely points out those are privileged prescriptions. True. But please, friends, broaden your perspectives if and however you can. Because we don’t need more stupid tech decisions caused by a lack of thinking, a lack of perspective. Our industry is going to demand an enormous amount of user trust over the next couple of decades. Let’s start justifying that trust today.