All glossary terms
K Data & reasoning Architecture

Knowledge graph

Knowledge graph projects rarely fail on technology. They fail because building one means agreeing what a customer is, and that is a political negotiation wearing engineering clothes. What changed recently is that the construction cost fell and the agreement cost did not.

Definition

A knowledge graph represents entities and the relationships between them in a form a machine can traverse. What makes it a knowledge graph rather than a collection of links is the schema above it: an agreed vocabulary of what kinds of thing exist in your organisation and how they are permitted to relate.

What is a knowledge graph?

A knowledge graph is a map of things and the labelled links between them. Picture a customer linked to a contract, which links to a product and a country. Each link states its exact meaning, and people define that in advance rather than letting the computer guess.

The part that distinguishes it from any other linked dataset sits above the data. A schema, or ontology, states what kinds of thing exist and which relationships are permitted between them. Without that layer you have a network; with it you have something that can be queried, validated and reasoned over.

Two implementation families dominate and the choice matters less than vendors suggest. Property graphs attach attributes directly to nodes and edges and suit operational querying. RDF and triple stores express everything as subject, predicate, object and suit federation and formal reasoning. Most enterprise work uses the first and most published theory assumes the second, which is a recurring source of confusion when teams read the literature.

When does a Knowledge graph beat vector search?

When the answer requires following a chain rather than finding a passage. That is the whole test, and it is sharper than the usual advice about graphs being good for relationships. If a single document contains the answer, retrieval is cheaper and simpler. If the answer only exists across several hops, a graph earns its cost.

Applying it to real questions makes the decision quick.

Two questions compared. The first, what is our refund policy for enterprise customers, is answered by retrieving one passage from one document, marked as vector search wins. The second, which contracts signed by this account manager contain a clause that conflicts with the jurisdiction we just entered, is shown as a chain of four hops across account manager, contracts, clauses and jurisdiction, marked as requiring traversal because no single document contains the answer. A caption states that the test is whether the answer exists in one place or only across a chain.
Question types and whether they need retrieval or traversal
Question type Where the answer lives What to use
Lookup In one passage, in one document Vector search. A graph adds cost and no capability
Multi-hop Only in the chain between several records Traversal. No document contains it, so retrieval cannot find it
Aggregate Across many records of the same type SQL. Neither retrieval nor traversal is the right instrument
Mixed Some in documents, some in the chain, some in tables All three, composed into one reasoning path. The common enterprise case

The last row is where most real questions land, which is why the argument about graphs replacing vector search was always misplaced. The interesting capability is composing traversal with retrieval and aggregation in a single chain, rather than choosing one. Where the retrieval side of that sits is covered at agentic RAG.

Why do knowledge graph projects fail?

Because the hard part is not building the graph, it is agreeing what goes in it. Defining an entity means deciding whose definition wins, and that decision has budget and headcount attached to it. Teams reach for a technology selection when the actual blocker is an unresolved disagreement.

The pattern repeats closely enough to be worth naming.

  • The ontology negotiation stalls. Sales counts an account one way, finance another, legal a third. All three are correct for their purpose. A single graph forces a choice, and nobody in the project has authority to make it.
  • Scope expands to justify the cost. Because a graph is expensive to build, the business case grows to cover the whole enterprise, which makes it slower, which makes it later, which makes it harder to defend.
  • It is built for an audience that never arrives. Many were built on the assumption analysts would query them directly. Analysts mostly did not, because they had dashboards that answered their questions already.
  • Nobody owns it after launch. A graph is a derived artifact, so the moment sources change it drifts. Without a named owner, drift is discovered by whoever is embarrassed first.

What changed with the Knowledge Graph in the last two years?

Building a knowledge graph used to be the expensive step. People had to read through documents and records by hand or write rigid rules that broke whenever the data looked slightly different. Now AI language models do much of that reading and sorting automatically. The harder challenge is still there, which is getting everyone to agree on what each term means, such as what exactly counts as a ‘customer’. Because the building became cheap and the agreeing did not, most of the effort now goes into reaching that shared understanding.

Three consequences follow, and the third is the one worth planning around.

  1. 01
    Automatic construction became viableA graph can now be derived from ingested data rather than hand-modelled first. What it changes: the project can start by producing something and then arguing about it, instead of arguing first and producing later.
  2. 02
    The consumer changed from a person to an agentThe audience that never arrived for the analyst-facing graph does exist for the agent-facing one, because an agent has no dashboard alternative. What it changes: the business case no longer depends on persuading people to learn a query language.
  3. 03
    The bottleneck moved to governanceWhen a graph is generated rather than curated, nobody reviewed what went into it. What it changes: you now need to know which relationships were asserted by a source and which were inferred by a model, because those carry different weight and a generated graph looks identical either way.

That third point deserves care. An automatically constructed graph is a set of claims, and some of them are extractions a model made with imperfect confidence. Recording how each edge got there is the difference between a graph you can defend and one you can only use, and it is far cheaper to capture during construction than to reconstruct afterwards.

What does it cost to keep one?

More than building it, and the build cost is the one that appears in the business case. A knowledge graph is derived from sources that keep changing, so it is stale from the moment it is finished unless something keeps re-deriving it.

Four running costs, roughly in the order they surprise people.

  • Re-derivation. Sources change daily. Rebuilding the whole graph is expensive and updating it incrementally requires knowing what changed, which brings you back to whether your connectors report deletions. See enterprise connectors.
  • Schema drift. A new product line, a new entity type, an acquisition. Each needs the ontology extended, and each extension is another small negotiation.
  • Entity resolution, forever. Deciding that two records are the same customer is not a one-off. New records arrive that match neither cleanly nor cleanly enough to reject.
  • Permissions that track the sources. If a record becomes restricted at source, the graph has to know. A graph that ignores this becomes a way to reach data through relationships that access control never anticipated.

That last one is worth stating plainly because it is a security property rather than a maintenance chore. A knowledge graph can leak by inference: no individual edge is sensitive, and the path between them reveals something that was meant to be restricted. Whether permissions travel with the record is covered at agent identity.

What do agents need that analysts did not?

To know whether a fact still holds. An analyst reading a graph brings judgment and can tell that a relationship looks stale. An agent traverses an edge and acts on it, so a graph built for human interpretation is missing the properties that make it safe to act on.

This is where the term stops being sufficient on its own, and it is the honest limit of this page.

A knowledge graph asserts that something is the case. It generally does not record when that became true, how long it holds, which source asserted it, or who may rely on it. Those four properties turn a graph you can read into a graph an agent can act on, and adding them produces something the literature calls a context graph. That page covers the difference properly, including which of the four can be retrofitted to an existing graph and which cannot.

The practical sequence, if you are starting now: build the graph automatically from your sources, record provenance and timing while you construct it because both are unrecoverable later, and resist the urge to model the whole enterprise before producing anything.

One caution on vocabulary. Knowledge graph, semantic layer, ontology and context graph are used interchangeably in vendor material and mean different things. An ontology is the schema. A semantic layer is a business-friendly abstraction over data, often without a graph underneath. A knowledge graph is the instantiated data. A context graph adds the conditions under which each assertion holds. Getting these confused in an architecture document costs weeks.

Frequently asked questions about knowledge graphs

If your question is not here, our team will answer it directly.


Talk to a Specialist →
What is a knowledge graph?

Entities joined by typed relationships, stored so a machine can walk from one to the next. A customer connects to a contract, which connects to a product and a jurisdiction, and those connections carry declared meaning rather than being bare foreign keys. What separates it from any other linked dataset is the schema above it, stating which kinds of thing exist and which relationships are permitted between them.

When should you use a knowledge graph instead of vector search?

When the answer requires following a chain rather than finding a passage. If one document contains the answer, retrieval is cheaper and simpler and a graph adds cost without capability. If the answer only exists across several hops, no document contains it and retrieval cannot find it at all. Most real enterprise questions are mixed, which is why composing traversal with retrieval and aggregation beats choosing between them.

What is the difference between a property graph and RDF?

How they attach information. Property graphs hang attributes directly on nodes and edges, which suits operational querying and is what most enterprise implementations use. RDF and triple stores express everything as subject, predicate and object, which suits federation and formal reasoning and is what most published theory assumes. That mismatch between practice and literature is a recurring source of confusion when teams start reading around the subject.

Why do knowledge graph projects fail?

Because consensus, not construction, is the bottleneck. Pinning down what counts as an entity is really a decision about whose version of the truth prevails, and that carries budget and headcount behind it. Sales counts an account one way, finance another, legal a third, and all three are right for their own purpose. Teams then reach for a technology selection when the actual blocker is a disagreement nobody in the project has authority to settle.

What should you do when teams define an entity differently?

Model the disagreement instead of resolving it. A graph recording all three definitions with their owners is more truthful than one that picks a winner behind closed doors, and it is faster to deliver because it does not require the meeting that never gets scheduled. The cost is that consumers must then state which definition they want, which is a considerably better problem than silently receiving somebody else's.

What changed about knowledge graphs recently?

Construction stopped being the expensive part. Extracting entities and relationships from documents and records used to need manual curation or brittle rules, and language models now do much of that work, so a graph can be derived from ingested data rather than hand-modelled first. The agreement problem did not move, so the balance of effort shifted: you can now produce something and then argue about it.

What is the risk of an automatically built knowledge graph?

That nobody reviewed what went into it. A generated graph is a set of claims, some asserted by a source and some extracted by a model with imperfect confidence, and the two look identical once they are edges. Recording how each edge got there is the difference between a graph you can defend and one you can only use, and it is far cheaper to capture during construction than to reconstruct afterwards.

What does it cost to maintain a knowledge graph?

More than building it, and only the build cost tends to appear in the business case. It is derived from sources that keep changing, so it is stale the moment it is finished unless something keeps re-deriving it. Add schema drift as new entity types appear, entity resolution that never finishes because new ambiguous records keep arriving, and permissions that have to track changes at source.

Can a knowledge graph leak sensitive data?

Yes, by inference, and this is a security property rather than a maintenance chore. No individual edge need be sensitive while the path between them reveals something meant to be restricted, such as which employees connect to which investigation. If permissions do not travel with the records into the graph, it becomes a way to reach data through relationships that your access control never anticipated when it was designed.

What do AI agents need from a knowledge graph?

An AI agent needs to know whether a fact is still true. A human analyst looking at a knowledge graph can sense when a link looks out of date and use judgment before relying on it. An agent simply follows the link and acts on what it finds, with no such instinct. So, a graph made for people to read is missing details, such as when a fact was last confirmed, that would make it safe for an agent to act on.

What is the difference between an ontology, a semantic layer and a knowledge graph?

They are distinct and vendor material uses them interchangeably. An ontology is the schema: what kinds of thing exist and how they may relate. A semantic layer is a business-friendly abstraction over data, often with no graph underneath it at all. A knowledge graph is the instantiated data itself. Getting these confused in an architecture document reliably costs weeks, so it is worth agreeing the vocabulary early.

Where should you start with a knowledge graph?

Build it automatically from your sources rather than modelling the enterprise first, and record provenance and timing during construction because both are unrecoverable afterwards. Pick the questions that genuinely need traversal, since those justify the cost and the lookup questions do not. Then resist the scope expansion that tends to follow, because a graph covering three real use cases beats one designed to cover everything.

Produce it first, then argue about it
Which of your questions actually need a traversal?

SERAA Axon builds a knowledge graph automatically from ingested data and composes SQL, vector search and graph traversal into a single reasoning chain, reading in place across 100+ connectors with no migration, and leaving a reasoned audit trail at every decision node.