The Decision Layer
Chapter 6Part II, Why enterprise software is broken·18 min read

The Integration Illusion

Connecting your systems makes the records agree. It does not produce a decision. Integration makes the nouns consistent and does nothing for the verbs.

Adam O'Connor·Founder, Optimal Nexus

The screen went up on a Monday morning, and for about four minutes it was the best day of the quarter.

An eighteen-month project had just landed. The firm, a marketing and technology agency of a few hundred people, had spent it wiring its systems together. The CRM now spoke to the finance system. The project tool fed the resourcing tool. The time tracker pushed into the same warehouse as the billing platform, and all of it surfaced on a single screen the chief operating officer had taken to calling the command centre. Tiles for pipeline, utilisation, revenue, margin by client, hours booked against hours sold. Everything the leadership team had spent years chasing across nine browser tabs now sat in one place, refreshing every fifteen minutes, colour-coded and calm.

The room was, briefly, delighted. This was the thing they had been promised. A joined-up business. One view. The end of the Monday ritual where four people arrived with four different numbers for the same question and spent the first half hour arguing about whose spreadsheet was right.

Then the managing director pointed at a tile that had gone amber, a large client account showing margin slipping below plan, and asked the only question that mattered. "Alright. What do we do about it?"

And the beautiful screen had nothing to say.

It could tell them the margin was down. It could, with two clicks, tell them which projects inside the account were dragging and by how many hours. It could not tell them why. It could not tell them what the team had decided the last two times this exact account had drifted, whether they had absorbed the overage to protect a renewal or held the line and had an awkward call. It could not tell them what to do. It showed them, in high resolution and in real time, a problem they still had to walk into a separate meeting to actually think about.

They had built a magnificent window. They still had no idea what to do with what they could see through it.

The turn

Something is wrong with a story that ends this way, and it is worth being precise about what. The firm did nothing foolish. Integrating your systems is not a mistake. Fragmentation is real, and Chapter 4 laid out how expensive it is: nine systems, each recording its own slice of reality, none of them recording the decision. If your data is scattered, gathering it is progress. The command centre was progress.

But it was progress along the wrong axis, and it was sold as progress along the right one. The industry's answer to the decisionless stack has been, for two decades, integration and the dashboards that sit on top of it. Connect the systems. Pipe the data. Put it all on one screen. The promise, stated or implied, is that once everything is joined up, the business will be joined up, and the leader will finally be able to run it as one thing.

This chapter is about why that promise is an illusion. Not a lie. An illusion, which is more dangerous, because it looks so much like the real thing that firms stop looking for the real thing. Integration produces a convincing picture of a coordinated business while leaving the actual problem, the missing decision layer, exactly where it was. You can integrate every system you own and remain as decisionless as the day you started.

What actually flows through the pipe

Strip the marketing away and an integration is a plumbing job. A pipe is built between two systems so that when a record changes in one, a corresponding record changes in the other. A deal marked closed-won in the CRM creates a project in the delivery tool. A timesheet approved in one place posts a cost in another. The engineering can be genuinely hard and the result genuinely useful. Fewer things get rekeyed. Fewer numbers disagree. The left hand can see what the right hand booked.

But look closely at what travels down that pipe. It is always a record, or a field inside a record. A status. A value. A date. An amount. Integration moves the nouns of the business from one place to another and keeps them consistent. What it never moves, because none of the systems ever held it, is the decision.

Recall the distinction from Chapter 4, the one the whole diagnosis rests on: the record and the decision are different things. The CRM holds the record that a deal was priced at a certain number. It does not hold the decision to price it there: the reasoning, the alternative that was rejected, the judgement that this client would walk at a higher figure but tolerate a tighter scope. That decision lived in a sales director's head, and a chat thread, and a conversation in a car park after the pitch. When you integrate the CRM with the finance system, you move the price. You do not move the reasoning behind the price, because the reasoning was never in the CRM to move.

The most ambitious version of the pipe dream has a name the vendors like: the three-hundred-and-sixty-degree view. Every record about a customer, gathered from every system, assembled into one profile. But a three-hundred-and-sixty-degree view of the records is still a view of records. You can surround a client with every fact the firm has ever logged and still not know the one thing that matters on Monday, which is what you should do about them, informed by what you chose last time and how it went. A complete picture of the nouns is not judgement. It is a very good filing cabinet with the drawers open.

This is the quiet defeat at the heart of the integration project. It can only carry what the systems contain, and the systems, as we established, contain everything except the decision. The records agree with each other now. The decisions are still nowhere, still ambient, still walking out of the building every time someone resigns.

A perfectly integrated business is still not a coordinated one. It is a decisionless stack that loads faster.

The illusion works because consistency feels like coherence. But agreeing on the number is not the same as knowing what to do about it. The command centre made every tile consistent. It made not one decision easier to reach, to capture, or to repeat.

The four questions a dashboard cannot answer

The dashboard is the visible face of the integration. A good dashboard is a genuine achievement of design and engineering. It takes the exhaust of a dozen systems and renders it legible. It is also, structurally, a rendering of records, and it inherits every limit of the thing it renders.

Think about the questions a leader actually brings to a screen, in the order they matter.

The first is what is happening. Here the dashboard is superb. Pipeline is up, utilisation is down, this client is amber, that project is red. Reporting the state of the world is exactly what a dashboard is for, and modern ones do it beautifully, in real time, on a phone at the airport.

The second question is why. Why is utilisation down? And here the dashboard begins to fail, because a why is not a value in a field. Sometimes it will let you drill: utilisation is down because three consultants rolled off a project and have not been rebooked. But that is just a more granular what. The actual why, the reason those three were not rebooked, whether it was a hiring lag, a sales gap, or a deliberate choice to hold bench capacity for a deal about to close, is a matter of context and judgement that lives in no field the dashboard can query.

The third question is what to do. Should we move those consultants to the at-risk account, or hold them for the deal? Here the dashboard is silent, and honestly so. It was never built to answer this. It shows you the instruments; it does not fly the plane.

And the fourth question, the one almost nobody thinks to ask of a screen because we have been trained not to expect it, is: what did we decide last time? The last three times an account looked exactly like this one, what did we choose, and how did it turn out? This is the question that separates a firm that learns from a firm that merely reacts, and it is the question Chapter 5 was built around. The dashboard cannot answer it, ever. Not because of a gap in the data but because of a gap in kind. It holds records of what happened. It holds no record of what was decided, so it can hold no memory of what worked. Every amber tile is met as if for the first time, by a firm with a perfect memory for facts and no memory at all for judgement.

A dashboard shows you what is happening, hints at why, never says what to do, and cannot remember what you decided the last time you stood exactly here.

None of this makes dashboards useless. It makes them misnamed. They are reporting instruments sold, increasingly, as decision instruments, and the gap between those two things is precisely the gap this book is about.

Disconnected systems are not a wiring problem

Walk into most firms and ask why the business feels fragmented, and you will hear a wiring diagnosis. Our systems are disconnected. They do not talk to each other. If we could just get them integrated, everything would come together. It is a comforting story, because it turns a deep problem into a procurement problem. Buy the right middleware, run the right project, and the fragmentation resolves.

An entire industry exists to sell into this story, and much of it is good technology. Integration platforms, the category the analysts call iPaaS, exist to connect systems without custom code. Middleware of every vintage exists to make system A speak to system B. These things are real and often worth buying. A firm with genuinely disconnected systems should probably connect them.

But notice the assumption underneath the wiring diagnosis: that the thing you are missing is a connection between two systems you already own. That if only the CRM and the finance system talked, the missing piece would appear in the conversation between them. This is the assumption that does not hold.

The decision layer was never one of the systems. It is not the CRM, not the ERP, not the project tool, not the warehouse. It is not sitting inside any of them waiting to be released by an integration. So no amount of connecting them can produce it, for the same reason that introducing nine people who each know part of a story does not cause the whole story to exist in the room. You can put them all in touch. You can have each one recite their piece. The narrative that ties the pieces into a decision, the judgement about what it all means and what to do, is not the sum of the pieces and does not emerge from wiring them together. Someone has to do the work of connecting them that is not data work at all.

This is what it means to call disconnected systems a structural condition rather than a fault. A fault is something wrong with a system that can be repaired. A structural condition is a property of how the whole thing is arranged, and you cannot repair your way out of it by improving any single component, or any connection between components. The missing decision layer is structural. It is missing not because the pipes are bad but because nobody ever built the thing the pipes were supposed to reach. Middleware connects what exists. It cannot conjure what was never built.

Firms that do not see this spend years and budgets in a loop: integrate, feel briefly joined up, discover they still cannot answer the decision, conclude the integration was incomplete, integrate more. The loop never closes, because each turn treats a structural absence as a wiring gap. You can lay perfect track in every direction and still have no train.

Integration connects records; orchestration coordinates decisions

There is a word for what the firms in these stories are actually reaching for, and it is not integration. It is orchestration, and the difference between the two is the difference between a business that looks joined up and one that is.

Integration connects records. It is a state, a property of your data: the systems agree, the numbers reconcile, the same customer has the same address everywhere. Integration is about data at rest being consistent. It is necessary, it is often hard, and it is, on its own, inert. A fully integrated business can still sit and stare at an amber tile, because consistent data does nothing until someone decides something and something happens as a result.

Orchestration coordinates decisions and the action that follows them, across people and systems, so that the whole business moves as one. It is not a state but a motion. Where integration asks do our systems agree, orchestration asks when we decide something, does the whole organisation turn together in response? When the leadership decides to protect a slipping account, orchestration is what carries that decision, with its reasoning, to the resourcing manager who must free up the right people, to the finance partner who must model the margin hit, to the account lead who must have the conversation, and then captures what was chosen and what happened, so that the next amber tile is met by a firm that remembers.

Feel the difference in a single moment. A leadership team makes one decision: we are going to protect this client, whatever it costs us this quarter, because the relationship is worth more than the margin on it. In a firm that only integrates, that decision is a sentence in a meeting that evaporates on the walk back to people's desks. In a firm that orchestrates, the decision moves, and the whole business turns with it. Revenue stops discounting to chase a number the firm has just chosen to sacrifice. Finance recalculates the quarter with the margin hit absorbed on purpose rather than discovered later as a nasty surprise. Resourcing frees the senior people the account now needs and warns the deal they were being held for that it will have to wait. Legal checks the penalty clauses the firm is now knowingly choosing to risk. Even the models in the building, scoring churn and margin, update on the new reality instead of flagging a decision that has already been made. One decision, and the organisation rearranges itself around it, coherently, on purpose, and remembers afterwards that it did. That is orchestration, and no dashboard has ever produced a second of it.

Integration moves the record of a closed deal from sales to delivery. Orchestration carries the decisions embedded in that deal, why it was priced this way, what was promised to win it, which risks were knowingly accepted, so that the team inheriting the work inherits the judgement and not merely the contract. This is the seam Chapter 5 warned about, the handover where context evaporates. Integration cannot fix that seam, because the context that evaporates was never in the record being handed over. Orchestration is, precisely, the discipline of not letting it evaporate.

Make it concrete. A renewal is coming up on that same slipping account. In the integrated firm, the sequence looks like this: the CRM flags the renewal date, the dashboard shows the account is amber, and a meeting is called at which four people reconstruct, from memory and half-remembered threads, what was agreed last year, why the margin is thin, and whether the client was ever told the rate would rise. The decision, when it finally comes, is made tired, late, and without the one thing that would have made it easy: a clear account of what the firm chose the last time it stood here and how that choice played out. Then the decision is made, and it is written down nowhere, so next year the same meeting reconstructs it again. In the orchestrated firm, the renewal date arrives already carrying its history: the original pricing decision and its reasoning, the two mid-year choices to absorb overage, the note that the client was warned once and reacted badly, and the outcome of the near-identical renewal on a sister account eight months ago. It is inherited, examined, decided, and the new decision is captured on its way past, ready for next time. The difference is not better data. Both firms have the same data. The difference is that one of them treats the decision as a thing worth carrying and the other lets it fall on the floor at every seam.

The distinction is the same one this book draws between automation and orchestration elsewhere, seen from another angle. Automation replaces a task. Integration connects a record. Neither one coordinates a decision. Orchestration is the work of aligning people, systems, and machine judgement around a decision, so that deciding actually causes the business to move, coherently, and so that the movement is remembered. A firm can be fully automated and fully integrated and still not be orchestrated, which is another way of saying it can have superb plumbing and no conductor.

Integration asks whether your systems agree. Orchestration asks whether, when you decide something, the whole business turns together. Most firms have spent a decade buying the first and calling it the second.

Say the two out loud, next to each other, and you can feel which one the command centre delivered. It delivered agreement. It did not deliver motion. The tiles reconciled. The business, faced with a decision, still had to leave the room and reassemble the judgement by hand, the way it always had.

Why the illusion costs more than the fragmentation

The reason to be hard on the integration illusion, rather than merely amused by it, is that it is more dangerous than the fragmentation it claims to cure. A fragmented business at least knows it is fragmented. The four numbers that disagree on Monday are annoying, but they are honest: they announce, every week, that the firm cannot yet see itself, and an honest problem keeps the search for a solution alive.

The integrated business that mistakes its command centre for a joined-up firm has lost that honesty. It has bought a picture convincing enough to end the search. The screen is calm, the tiles reconcile, the demo went well, and the leadership concludes that the fragmentation problem has been solved. The budget line closes. The project is marked delivered. And the actual problem, the missing decision layer, is now not only unsolved but invisible, hidden behind the very artefact that was supposed to reveal it. You cannot fix what you have been persuaded you already fixed.

This is why the illusion earns the word. A lie you can catch. An illusion recruits your own eyes against you. The firm with the beautiful dashboard is often further from real decision infrastructure than the firm still arguing over spreadsheets, because the second firm still feels the pain that motivates the cure, and the first has anaesthetised it.

"But we have a single source of truth now"

Integration in the old sense, the point-to-point pipes between operational systems, is not really how a modern firm joins its data up any more. The current answer is a platform: a cloud data warehouse, a lakehouse, a customer data platform, some unified place into which everything flows and from which everything is served. The pitch is the phrase every leader has heard: a single source of truth. One place where all the data lives, cleaned, modelled, and reconciled, so the arguments about whose number is right are finally over. Surely, the objection goes, this is different. Surely once we have a genuine single source of truth, we have the joined-up business, and the decision layer along with it.

Here is the honest answer. A modern data platform is a real achievement, and it is a single source of record. It is not, and does not become, a single source of decision. Those are different objects, and unifying the first does not create the second.

Think about what a warehouse actually unifies. It unifies where the data lives. Every record from every system, gathered into one governed place, modelled into consistent tables, queryable in one language. That is genuinely valuable, and I would not talk any firm out of it. But a decision is not a record, and it was not in any of the source systems, so it is not in the warehouse either. You have gathered all the nouns of the business into one beautiful building. The verbs, the actual acts of judgement, the choosing of this over that for these reasons, were never emitted by any system, so no pipe carried them in, and the warehouse is as silent about them as the CRM was.

A single source of record answers what is true about the past with unprecedented authority. It still cannot tell you what you decided, why you decided it, which alternatives you weighed, or how it turned out against what you expected, because none of that was ever written down anywhere the platform could reach. And so, one level up from where the old firms got stuck, the modern firm gets stuck in exactly the same place: it has never been better informed about its own past, and it is no better at deciding, capturing, and repeating.

A fair-minded reader will push once more. The good platforms now ship an insights layer, or a decisioning module, or a bolted-on model that does not merely report but recommends. Does that not close the gap? It helps, and it is worth having, but it does not close the gap, for a reason that is easy to miss. A recommendation generated from records is still generated from records. It can suggest, on the pattern of the data, that this account looks like one that tends to churn. It cannot know what you actually decided the last three times, because you never told it, because there was nowhere to tell it. A recommendation with no access to your firm's real decisions is a confident guess dressed as an answer, which, as Chapter 2 argued, is in some ways worse than no answer at all. The module is a better guesser bolted to a better filing cabinet. It is not the missing layer, because the missing layer is the place where the decision, its reasoning, and its outcome are captured in the first place, and no amount of analysis downstream can recover what was never recorded upstream.

The single source of truth is a genuine milestone. It is just a milestone on the road to a different destination than the one the leader thinks they are travelling to. It perfects the record. The decision is still homeless.

The layer that was never a system

Step back and look at the shape of Part II. Three chapters, three faces of one problem. The stack records everything except the decision. The enterprise, having never captured the decision, cannot remember it. And integration, the industry's answer to both, moves records between systems while the decision stays exactly as homeless as before, now behind a screen that makes the homelessness harder to notice.

Notice what every one of these failures has in common. There is a layer missing from the business, and it is not any of the systems, which is why buying, connecting, and unifying systems has never produced it and never will. It sits above the record and below the leader. It is where a decision, its reasoning, and its outcome would live if anything in the estate were built to hold them. Every chapter so far has been circling this absence and tracing its edges.

It is time to stop describing the hole and name the thing that fills it. The missing layer is not another system to bolt onto the stack. It is a discipline, with a body of practice and a growing seriousness behind it. It is called Decision Intelligence, and the rest of this book is about what it is and how to build it. That is where we turn now.

The full bookDownload The Decision Layer as a PDF, free

Related reading