clement13.net
Original photo: A “Hammer and Nails” hardware store (old postcard)
Description
A “Hammer and Nails” hardware store (old postcard)
Source
Tichnor Brothers, Publisher · original page
Licence
PD Public domain
Original photo, unretouched. The background is a version of it stylised by the site.

The law of the instrument

When you have a hammer, everything looks like a nail: we apply the solution we master, whether or not it fits.

Effect≈ 11 min readCheckedCheck doneFacts, figures and references were checked against the sources cited in the page.Written with AI assistance; sources are cited at the bottom of the page. An error? Report it via clement13.net.Reading
FrequencyFrequentSeveral times per project.
Where you meet it
  • Technology choice
  • Architecture
  • Method choice
  • Spreadsheets and office tools
  • Project management
  • Team management
AI helpPartialIt helps, but it falls into the trap too. See how ↓
In brief
  • What: the tool, technology or method we master becomes the default answer, even to problems it was not made for.
  • Why: the learning effort is already paid for, the familiar solution is reassuring, and the problem is reformulated so that it applies.
  • Detect: the solution is named before the problem is described; nobody has compared an alternative.
  • Avoid: describe the need without naming a tool, compare at least two options against written criteria, ask what would make us give up the tool.
On this page

Definition#

Avatar of Abraham MaslowFictitious illustration
Abraham MaslowAmericanApril 1, 1908 – June 8, 1970Psychologist
Avatar of Abraham KaplanFictitious illustration
Abraham KaplanAmerican1918 – 1993Philosopher of science

The law of the instrument, or “hammer effect”, is the tendency to treat every problem with the tool we know best. The philosopher Abraham Kaplan gave the formulation in 1964 in The Conduct of Inquiry: “Give a small boy a hammer, and he will find that everything he encounters needs pounding.” The psychologist Abraham Maslow popularized the version best known today in 1966, in The Psychology of Science: “I suppose it is tempting, if the only tool you have is a hammer, to treat everything as if it were a nail.”

This is not a general rule that “tools are bad”. A mastered tool is often a good choice. The bias begins when the tool is chosen before looking at the problem, or when the problem is distorted to fit the tool. Nor is it a bias measured in the laboratory like anchoring: it is an old and very widespread observation, more than a precisely quantified effect. This entry says so in order not to make it say more than it does.

The mechanism#

Several drivers combine, all resting on the same idea: what I know how to do is more accessible to me than what I don't know.

  • The cost already paid. Learning a tool, a platform, a language or a working framework takes months. Giving it up means losing that investment; using it again seems free, though it is not always (see sunk costs).
  • Availability. We think first of what we know. Solutions we have never practiced simply do not come to mind when we formulate the options.
  • Silent reformulation. The problem is redefined to match the tool: “we need a data warehouse” becomes “we need one more table”; “we need tracking” becomes “we need a shared workbook”. The need drifts without anyone having decided it.
  • Social comfort. In a team, proposing the tool everyone knows is easy to defend. Proposing something else requires justifying, training and taking on the risk.
  • Professional identity. Someone who is “the expert in” a given tool has an interest, without malice, in that tool being relevant (see expert bias).
A needappearsWhich tooldo I know?The need isreformulated tofit the toolAlternatives areneither soughtnor comparedSolution delivered,with ever heavierworkaroundsRemedy1. describe the need without naming a tool2. compare at least 2 options3. write down what would make us give upbeforeinstead of
The tool comes before the analysis and distorts the question. The remedy is to reverse the order: describe the need, then compare options, including the usual tool.Hover over or tap an element to read its details.

Where it shows up#

In project management#

  • The spreadsheet turned database. A shared workbook serves as a reference repository, a tracking tool and a source of reports. It works as long as the volume stays small, then the formulas, versions and permissions become unmanageable.
  • The single technology. A team that knows a relational database well stores documents, message queues or time series in it. Conversely, a team enthusiastic about a recent technology applies it to simple needs that do not call for so much.
  • The universal method. The same ritual (V-cycle, two-week sprints, Kanban) is applied to maintenance, to an infrastructure project, to a search for a solution, because “that's how we work”.
  • The script for everything. The engineer who likes automation writes a script where a standard configuration of the existing tool would suffice, and leaves the team code to maintain.
  • The service provider. A service supplier proposes, whatever the need, what it knows how to do and sell: its platform, its method, its profiles.

In management#

  • The one-key manager. Coming from a technical background, they settle a team conflict with a process; coming from human resources, they settle a design flaw with a conversation. Each deals with what they know how to do.
  • The dashboard for everything. Faced with a difficulty, the answer is one more indicator, whatever the problem (see Goodhart's law).
  • Reorganization as a reflex. An executive who succeeded through a reorganization proposes one for every difficulty.
  • Training as the answer. A flaw that stems from tooling, scheduling or workload is treated with a course, because training is the tool at hand.

Famous cases#

Famous case

The 15,841 cases lost by a spreadsheet September 25 - October 2, 2020#

Bias at play: the law of the instrument (the spreadsheet as an information system), underestimating the tool's limit.

15,841positive cases not counted in the daily figures
65,536maximum rows in a sheet in the .xls format
Sept. 25 - Oct. 2, 2020period concerned

What happened. In the United Kingdom, Public Health England (PHE) received test results from laboratories as CSV files. These files were automatically imported into spreadsheets in the .xls format, Microsoft's older spreadsheet format, limited to 65,536 rows per sheet (the more recent .xlsx format accepts more than a million). Because each result took up several rows, the limit was reached well before the supposed number of cases; records beyond it were simply ignored, with no visible error. On October 2, 2020, the anomaly was identified: 15,841 positive cases, spread between September 25 and October 2, had not been transmitted. They were added to the published figures over the following days, and the tracing of these people's contacts fell behind. The problem was worked around by spreading the data over several files.

Maximum rows per sheet.xls format: 65,536 rows.xlsx format: 1,048,576 rows
Maximum number of rows in a sheet: the .xls format, used for the import, versus the .xlsx format. This is not the cause on its own: it was the choice of a spreadsheet as a link in a public-health data chain that made the limit dangerous.

What this illustrates

A spreadsheet is an excellent tool for calculation and exploration. Placing it in the middle of a processing chain that must be complete, auditable and lossless makes it a link whose limits and silent failures we do not control. The reflex to keep: when a familiar tool plays a role it was not designed to play, ask what happens when its limit is reached, and how we would notice. Here, nobody saw the error because no check compared the number of rows read with the number of rows received.

Field study

Gene names turned into dates 2016#

Bias at play: the law of the instrument, trust in the tool's automatic conversions.

704 out of 3,597papers whose gene files contained errors (about 20%)
2016publication of the analysis (Genome Biology)
2020renaming of genes by the nomenclature committee to avoid the problem

What happened. In a spreadsheet, a gene name such as SEPT2 or MARCH1 can be converted into a date (“2-Sep”, “1-Mar”) without warning. Mark Ziemann and his colleagues analyzed the supplementary files of thousands of genomics papers published between 2005 and 2015: about one paper in five (704 out of 3,597 in their sample) contained these errors. In 2020, the HUGO Gene Nomenclature Committee (HGNC) renamed some of the genes concerned (for example SEPT1 became SEPTIN1) so that the spreadsheet would stop mistaking them for dates.

What this illustrates

When a universal practice rests on a single tool, the tool ends up imposing its rules on reality: here, science changed the names of its objects to suit the software. In your projects, an identifier, a code or a format that exists only because “the tool can't do it any other way” is a sign of the law of the instrument.

Warning signs#

  • The solution is named before the problem is described: “we'll do that in [tool]”.
  • The options presented differ only in how to use the same technology.
  • The need is expressed in the tool's vocabulary (“a table”, “a workflow”, “a dashboard”) rather than in that of the use.
  • Workarounds pile up: macros, scripts, manual exports to compensate for what the tool does not do.
  • “We've always done it this way”, “we already have the license”, “it's what the team knows” are the only justifications.
  • Nobody can say in which case the tool would not be the right one.

Avoidance reflexes#

  1. Describe the need without naming a tool. Write the problem in terms of use, volume, reliability, lifespan, users. If the tool appears in the sentence, the sentence already describes the solution.
  2. Compare at least two options, including an unusual one. Not to choose it at all costs, but to force ourselves to justify the choice with written criteria.
  3. Set the criteria before examining the tools. Volume, lead time, available skills, maintenance cost, risk, reversibility. They weigh more than familiarity.
  4. Write down what would make us give up. “We will abandon this approach if the volume exceeds X, or if we add more than Y workarounds.” A limit written in advance is easier to apply than one discovered in a crisis.
  5. Put a figure on the real cost of the familiar. The license already paid for is not the cost; count the maintenance, the workarounds, the risk of silent error.
  6. Bring in an outside perspective. A person who has not invested in the tool naturally asks about the alternative.
  7. Keep a limit test. For any tool placed at the center of a chain, add a completeness check (number of items entered against number of items processed).

With AI: detect, remedy, mitigate#

Estimated AI help: partial

AI knows alternatives the team has never practiced, which makes it a good generator of options. But it often recommends what is best documented, and it follows the wording of the question: if you ask “how do I do this with [tool]?”, it answers with that tool.

Detect#

  • Pick out in a design document the decisions with no written alternative.
  • Spot, in a specification, the requirements phrased in the vocabulary of a tool rather than that of the need.
  • List the workarounds mentioned in tickets or minutes, a sign of a forced tool.

Fix#

  • Propose several families of solutions for the same need described without a tool.
  • Draw up a neutral criteria grid before examining the options.
  • Describe the exit conditions of a tool: thresholds, signals, migration cost.

Mitigate#

  • Ask the question without naming the usual tool, then compare its answer with the planned solution.
  • Ask AI to defend the solution furthest from the team's.
  • Have its answers checked by a person: AI proposes, the team that knows the context decides.

Prompts to build into your routines#

1. Options for a need described without a tool. To use before choosing a tool or technology.

Here is a need described without any mention of a tool or technology.
Propose four families of solutions of different natures (not four variants of the same one).
For each: what it does well, what it does poorly, the volume or context beyond which it no longer fits, and the maintenance cost to expect.
Do not recommend anything: I want to compare. Do not cite a product you are not certain exists.

Need: [description: use, volume, expected reliability, lifespan, users, constraints]

2. Defending the alternative and looking for exit conditions. When the team is about to settle on the tool it knows.

Our team is about to address this need with [usual tool]: [need].
1. Give the best arguments for why a very different approach might be preferable, without caricaturing our choice.
2. List the symptoms that would indicate in six months that [usual tool] was not suitable (volumes, workarounds, silent errors).
3. Propose a simple completeness or consistency check to put in place from the start.
4. Say, in one sentence, in which cases [usual tool] remains the right choice nonetheless.

How to build them in#

  • At scoping: run prompt 1 before any discussion of tools, then compare with what the team has in mind.
  • Before the decision: prompt 2 feeds the “exit conditions” section of the selection file.
  • In architecture review: ask to see the rejected alternative and the reason it was rejected, not only the chosen solution.

Precautions#

  • Do not name the tool in your question: you would steer the answer.
  • The products, versions and limits cited by AI may be wrong or outdated: check them in the official documentation.
  • A list of options is not a decision: it is up to the team, which knows its skills and its context, to decide.
  • Do not paste confidential data or architecture plans into an unauthorized tool.

Limits#

  • This is a common-sense observation more than a precise experimental result: there is no benchmark quantified effect as there is for anchoring.
  • Relying on what we master is often rational: learning cost, support, recruitment and maintenance legitimately favor the familiar. The bias is not choosing the familiar tool, it is not having compared.
  • The opposite effect exists: the appeal of novelty, which leads us to ignore the suitable tool because it is old (see pro-innovation bias).
  • The two “cases” in this entry illustrate the risk of the single tool; they do not prove that the teams concerned followed this reasoning. Attributing them to a bias remains an interpretation.

Sources and verification#

See also#

Combines with, or reinforces#

These biases feed each other.

Variants or cousins: not to be confused.

What neutralises it.

  • Le cadrage du problème avant la solution (concept or method, no page)
  • Les options comparées par critères (concept or method, no page)
  • The devil's advocate