risura

← Back to the corpus

Plate 12 · Direction III · Runs and the stability of errors · § method

How a series of runs separates noise from stable drift

A series of runs is not meant to catch identical paragraphs. It shows whether the model keeps following one semantic route: shifting the category, substituting the function, pulling in a neighbor, or leaving a blank space again where the brand entity should be.

Recorded by Inês Ferreira March 25, 2026

One skewed answer may be only a field note. A series shows whether the model keeps returning to the same road.

In a composite scene built from repeated observations, a small Portuguese B2B platform for customer communications was tested with the same question: “What kind of company is this, and who is it suitable for?” Each dialogue began from a clean context, the conditions were recorded, and the wording did not change. Some answers described the product fairly close to the point: teams, customer requests, working communications. Others brought in agency-like shades: communication services, customer follow-up, campaign work. One answer even kept the city right but placed the product next to an overly broad CRM category.

That set of answers still does not prove a stable drift. Atelier das Entidades first looks at what exactly is being repeated. A tone can repeat. A favorite phrase can repeat. A stray neighboring term can repeat. Or the route can repeat: the platform keeps sliding toward an agency label, the operational product keeps turning into customer support, the category keeps widening beyond the real task. Only in the second case does noise start to become material for a conclusion.

Why a single answer cannot hold a conclusion

An AI answer is unstable by nature. It is affected by the wording of the query, the language, the dialogue context, the system mode, whether search is enabled, model updates, and visible sources. Even a careful direct question can produce different texts. So for the lab, a single answer is a field note. It may be interesting, unpleasant, even revealing, but it cannot bear the weight of a general claim about the brand.

That does not make a single answer useless. Often it is exactly what reveals the crack. A founder sees the model call a product an agency. A marketer notices that the audience has become too broad. A brand strategist catches an empty formula where a category should be. Such a scene starts the check. But between “strange” and “stable,” there has to be an interval: repeat the same query, record the conditions, read the answers by hand, compare the semantic moves.

The lab is especially careful with vivid errors. They are memorable, but they may not return. The model invents an extra office, adds someone else’s founder, calls the product an advertising service. All of this is recorded, but without repetition it remains one rough spot in the answer. Stable drift is often quieter: not a false fact, but a repeated movement toward a neighboring category.

A blatant invention is like broken glass on the floor. Quiet drift is a slightly tilted shelf. Until it is checked several times, one may not notice that all the books are sliding in the same direction.

Conditions are recorded first

A series of runs starts with conditions. The team records the query, language, system or mode, date, whether search was open, and whether the dialogue began with a clean context. This sounds dull, but without such notes a series quickly becomes the story “it feels like the model keeps getting it wrong.” One extra hint in the previous message can push an answer toward the right category or toward someone else’s neighborhood.

The main series is built around one fixed query. If the lab wants to test how a brand appears in a vendor-selection scenario, it uses one question of that type. If the function of the product is under examination, another question is used, but that is a separate series. They cannot be merged into one conclusion. The query “what does this company do?” and the query “which solutions are suitable for a small tour operator?” test different usage scenes.

For composite object B, this distinction is especially visible. A direct question about the company can show whether the model holds the brand entity. A vendor-selection scenario shows whether the brand appears as a candidate among the right neighbors. Both observations are useful, but they answer different questions. If they are piled together without a label, the result is not a method, just a scatter of cards on a table.

Recording conditions does not turn the work into a sterile technical laboratory. Atelier das Entidades works with live AI interfaces, where part of the mechanism remains hidden. Still, minimal discipline is needed: the same question, clean context, clear language, recorded mode. Then the oddness of an answer can be compared, not merely remembered.

Repeatability is read as a trajectory

A language model rarely returns the same paragraph twice. In brand research, that is fine. Literal sameness can be the result of a short templated answer or a question that has been phrased too tightly. Atelier das Entidades looks deeper: where the answer takes the company when it is reassembled again and again.

Stable drift is a repeated semantic trajectory in which different answers again lead the brand toward the same wrong category, function, or neighborhood.

The words may diverge. One answer writes “communications platform,” another says “tool for customer requests,” a third calls it “customer support service.” The first two formulas may be close to the product. The third may already be pulling the brand toward an agency or support role. What matters is not the isolated word, but the work the answer assigns to the company.

This is where the canonical classification used by Atelier das Entidades helps: the model loses the brand entity in four ways — it shifts the category, substitutes the function, pulls in a neighbor, or leaves a blank space. A series of runs shows which of these ways returns. Sometimes the category differs slightly each time, but all versions lead into one adjacent market. Sometimes the category is acceptable, but the function changes again. Sometimes the answer looks cautious, yet repeatedly fails to name the audience or the difference.

This is how a series separates repetition of a semantic trajectory from repetition of words. The word “CRM” may appear once as a neighboring category and not damage the answer. If it becomes the main shelf for the product across different runs, that is different evidence. The same applies to agencies, customer support, hotel software, and general management platforms.

How noise is separated from drift

Noise often has sharp edges. One run adds a highly specific fact that does not appear in other answers. Once, a company from another country appears nearby, though the rest of the answers stay within the local market. In one answer, a city surfaces that has no connection to the object. Such elements should not be thrown away, but they cannot carry the conclusion either. They are recorded as separate rough spots in the series.

Noise can also come from a question that is too broad. “Tell me about the company” leaves the system too much room, and the answer easily drifts into generic guesses. A question that is too narrow is also risky: “why is this platform not an agency?” already suggests the desired frame. So the first series usually imitates a real user query, while additional series test separate elements: category, function, audience, neighbors.

There is language noise as well. A Portuguese formulation may preserve local context, an English one may smooth it out, and a Russian one may rebuild it through a more general category. For companies that work in external markets, this difference matters. A brand can be distinct in one language layer and blur in another. That is why the language of the question is recorded next to the result, instead of remaining in the researcher’s memory.

Stability appears when the same erroneous link returns under preserved conditions. Composite object A may keep moving from customer communications toward agency adjacency. Composite object B may stay within tourism, yet keep losing the product’s operational function. In both cases, the repeated item is not necessarily one label. What repeats is the loss of the link between company, product, category, audience, and practical work.

What the series shows in brand text

A series of runs does not dictate how a company should write its website. A brand does not have to live only for machine retelling. But the series shows where the language gives the model too much freedom. If the product keeps moving toward an agency, it is worth checking the words around communications, growth, customers, follow-up, and campaigns. If an operational platform for tour operators keeps becoming hotel software, the team should ask whether industry language is drowning out practical function.

What often helps is not adding volume, but strengthening links. Company, product, category, audience, and function need to appear near one another. If the category lives in the meta description, the audience in a case study, the function in a presentation, and the difference only in the founder’s conversation with a customer, the model assembles the image from available pieces. Sometimes it gets it right. Sometimes it glues together someone else’s figure.

Atelier das Entidades treats advice to “add more text” with caution. A longer trace can become even softer: more general promises, more neighboring words, more reasons to slide into a familiar category. For AI visibility, entity density matters. A few precise formulas that link the product to the audience and the work are more useful than a long storefront of words that could fit almost anyone.

After a series, the team can formulate a narrow working conclusion. For example: in these runs, the model repeatedly leads the company from customer communications toward agency adjacency. Or: in these answers, the tourism context is preserved, but the product’s operational function slides toward customer support. These conclusions are not dramatic. But they can guide text editing, external descriptions, and the decision about which trace needs to be reinforced.

Limitations: a series does not turn model behavior into final truth

Even a careful series remains an observation under specified conditions. It does not cover the whole internet, all models, all languages, or future updates. The same brand may look different after a website change, new mentions, a search-index update, or a shift in answer mode. So the lab does not write “AI considers the company an agency” as a general verdict. The more precise version is: in these runs, the system repeatedly led the company toward agency adjacency.

There is no magic number of runs that works universally. For one task, a small series may be enough to see a clear repeat. Another task needs denser work, especially if the category is broad and there are many neighboring shelves. Atelier das Entidades does not turn this into a pseudo-precise scale. The method remains qualitative: answer, conditions, markup, comparison, repeated semantic trajectory, careful conclusion.

There is also a risk of confusing model stability with source stability. If the answers repeatedly lean on one old directory, the repetition will show a drift, but its cause may lie in one specific external trace. That does not make the observation useless. On the contrary, it helps find a contaminated path in the language. The conclusion simply needs to be exact: under these conditions, the available trace probably pushes the system to assemble the brand this way.

A series also does not show every real user query. People ask messily, incompletely, with local words and strange abbreviations. A lab series approximates such scenes, but it does not exhaust them. So the results are better read as a dense fragment of model behavior, not as a final map of a brand’s AI visibility.

Inês Ferreira
responsible for the record
Atelier das Entidades · Lisbon · March 25, 2026