Skip to main content
All thought leadership
Procurement6 minute read

Buying AI Marketing Technology Without Buying the Story

Every demo works, so the real job of procurement is finding out what happens on an ordinary Tuesday with your own messy data.

The demo is a rehearsed performance

Every enterprise demonstration you will sit through this year has been run hundreds of times on data chosen because it works. That is not dishonest, it is sales. The mistake buyers make is treating the demonstration as evidence about the product rather than evidence about the demonstration.

The useful move costs nothing: ask to run the same workflow on a sample of your own material, unprepared, in the room. Then watch what the vendor does when the output is mediocre. Whether they explain the limitation clearly or reach for a line about it being an early build will tell you more than the entire feature list.

Separate the capability from the wrapper

A large share of marketing AI products are an interface, a workflow and a prompt library sitting on top of a general purpose model you could reach directly. That is a legitimate product. Interfaces, workflows and integrations are real work and most teams should not build them. But it changes what you are buying, and therefore what it is worth.

So ask directly. Which model or models sit underneath, what happens when the provider changes them, what part is genuinely proprietary, and what remains defensible if the underlying capability improves for everyone next year. A vendor with a clear answer is a better partner than one who treats the question as hostile.

Questions that produce useful answers

Most vendor question lists are compliance theatre. These are the ones that change decisions.

  • What does the product do when the model is wrong, and how would a user notice
  • Where does our data go, who can see it, and is any of it used to improve something shared
  • Show us the workflow for a case the product handles badly
  • What is the cost at three times our current volume, in writing
  • Which customers have left, and what did their migration involve
  • What breaks first when a new model version ships

The last two are the ones that make a room go quiet. A vendor who can talk calmly about departed customers and version churn has been operating long enough to be worth trusting.

Contracts and the way out

Australian buyers sit a long way from most vendors' head offices, and that distance shows up in support hours, roadmap influence and the speed of an escalation. Price it in rather than hoping goodwill covers it, and get local response commitments written down.

On the exit: agree what leaving looks like before you sign. Your content, your configurations, your history and your customer records, in an open format, within a stated number of days, at no additional charge. Lock in with these products is rarely contractual. It is that a year of work now lives inside a proprietary structure and nobody has the appetite to rebuild it.

The question is never whether the technology is impressive. It is whether the specific work your team does gets measurably easier, and how you will know that it did.

Pilots that prove something

Most pilots are designed to succeed, which is why so many of them end in a purchase and no improvement. A pilot proves something only if it is able to fail. Define, in advance, the task, the current baseline in time or quality, the threshold that counts as success, and the date on which you decide.

Keep it narrow. One workflow, one team, a fixed window. Compare against how the work is done today rather than against nothing, and have the people who will actually use the tool run it, not the enthusiast who championed it. Enthusiasm is the most common reason a pilot passes and a rollout fails.

Published by the Australian Centre for AI in Marketing

Free to read, free to share, and free of any vendor interest.

Join the Centre

Keep reading

Operating models6 min

The Marketing Team Is Now a Systems Team

Artificial intelligence moves marketing away from producing individual assets and towards designing, supervising and correcting the systems that produce them at volume.

Read
Creative6 min

Brand Voice at Machine Scale

When output volume rises sharply, a brand voice held in the heads of three senior people stops being a standard and becomes a bottleneck.

Read

The monthly briefing

Get the next one when it lands

One email a month, one question worked through properly. If we have nothing worth saying, we do not send.

One email a month. No vendor promotion, ever. Unsubscribe in one click.