Notes · AI
Where AI fits in a workflow
I avoided writing case studies for two years. Not for lack of work to show. The portfolio stayed empty for the most boring possible reason: the task was annoying enough to defer forever. That turns out to be exactly where AI belongs.
Start with what you keep avoiding.
The work of writing a case study was slow and shapeless, and every time I sat down to do it I found something else that needed doing first. That is the honest reason I started putting AI into my own work. Not speed for its own sake. There was a thing I was supposed to do, kept not doing, and wanted to stop avoiding.
That turns out to be the right place to start. If you are wondering where AI fits in what you do, the question underneath it is usually: which part of my work do I keep putting off, or keep doing badly, or keep spending more time on than it deserves. Start there.
Start with the problem, named plainly, before you go anywhere near a tool.
Know what you are fixing, and how you will know it worked.
There is a failure mode where you add AI because adding AI is the thing to be doing, and afterwards you cannot say whether anything got better. You just have a more complicated process with a model in the middle of it.
The way out is to decide, before you build, two things. What is the problem. And how you will measure whether it is solved.
For the case studies, the problem was that they took so long I never wrote them. The measure was simple and a little crude: do they now get written, and is the version I get faster to a publishable state than doing it by hand. Faster, by my own standard of good, and actually finished. If a workflow with AI in it could not beat that low bar, there was no reason to keep it.
Pick your measure before you build
Time. Quality against your own criteria. Whether the work happens at all. It does not have to be sophisticated. It has to exist, so that later you can look at the workflow and say it earns its place, or cut it.
Two situations, two moves.
Once you have a problem worth solving, there are two cases. The workflow already exists and you do it by hand. Or it does not exist yet and you are designing it from nothing. The move is different for each.
Situation A
The workflow already exists.
Take it apart. Write the real process down at the resolution you work at, then find the steps that repeat.
Situation B
The workflow does not exist yet.
Work outside-in. You know the input and the output. Build the middle from those two ends, largest steps first.
Take it apart, then decide what can move.
If you already do the thing, you have a process, even if you have never written it down. So write it down, at the resolution you actually work at, not the tidy version. Then decide, step by step, what a model could hold and what has to stay yours.
Beat 1 — the workflow, as I do it by hand
Before the model, the case study was mine end to end. Here is the honest version, no AI in it. The starting point is not "where does AI go." It is "what do I actually do," written down as six steps.
Six steps, and all six are mine. That is the page you start from.
Beat 2 — how I decide what can move
With the steps on the page, I run each one through three tests. A step has to pass all three before it leaves my hands.
Test 01
Repetition
Does this step happen the same way every time, across different projects?
Reading the material and drafting from a confirmed angle repeat. Working out the angle does not — it depends on what the project was.
Test 02
Substrate or judgment
Is this the reason the work is mine, or is it what the work sits on?
Deciding the angle and deciding the draft is good are judgment. Reading the files and drafting to a fixed voice are substrate. Substrate can move.
Test 03
Worth the handoff
Does handing it over cost less than doing it by hand, output I can trust?
A step can repeat and be substrate and still stay with me, if setting up the handoff costs more, or if I would not skip checking it anyway.
Passes all three — moves
Read the material. Draft against my voice. These repeat, they are substrate, and handing them over is worth it.
Fails a test — stays
The angle, and the final yes. Those are the judgment, and they are the reason the work is mine.
The substrate can move. The judgment stays.
Beat 3 — the same workflow, with the model in it
Now the model goes in, but only where the three tests said it could. The shape is the same as the all-human version. The repeated, substrate steps moved. The two judgment points stayed.
The difference between this and where I started is not that the work got faster, though it did. It is that the reading and the drafting, the parts that were never the point, stopped sitting between me and the two decisions that were. I do the deciding. The model does the substrate. The line between them is the three tests, run once, on paper, before any of this was built.
Work from the outside in.
The harder case is when there is no process to take apart, because you have never done the thing. You cannot deconstruct what you do, because you do not do it yet. So you build the shape from the two ends you already know.
You know the input. You know the output you want. Start with only those. Say the input is a single word and the output is a finished article. Everything interesting is the middle, and the middle is empty. So you fill it in, from the top down, largest steps first.
At the coarsest level: the system has to understand the subject and my style, produce a draft, check that draft against something, revise, and then hand the result to me. Five rough moves, written at altitude. Then you go down a level into each move. Each high-level step, pressed on, reveals what it needs underneath it.
| Coarse move | Press on it, it needs | Resolves to |
|---|---|---|
| Understand my style | A place where my style is written down for it to read. | Needs a doc |
| Understand the subject | The source material and context gathered and fed in. | By hand |
| Produce a draft | Style and subject in hand, write against them. | Model can do |
| Check the draft | A standard to check against — I have to say what good looks like. | Needs a doc |
| Revise, then hand to me | Run the check, fix what it flags, surface the rest. | Model can do |
That third column is the one to notice. Decomposing a not-yet-existing workflow tends to surface the documents you are missing more than the tasks. The voice document. The context the model needs. The written-down standard. The workflow cannot run until those exist, and you only learn you need them by breaking the work into pieces small enough to show the gaps.
The shape tells you
Where AI fits stops being a guess. It fits in the steps that are mechanical once the surrounding documents exist. You designed the shape from input and output, and the shape told you.
The judgment does not vanish. It moves.
In both cases there is a step that feels like it must stay yours: the part where you look at what came out and decide if it is good. It feels unautomatable because it feels like judgment, and judgment feels like the opposite of a repeatable step.
But when I reject a draft, I am not rejecting it at random. I am checking it against things I expect, and I could name them if I sat down to. A critique has a shape exactly the way the workflow did. So you do to the checking what you did to the work. Take it apart. Name what you actually look for, the specific failures that mean a thing is not ready.
What makes me say no
The reasons I reject a draft, named precisely. Vagueness is what keeps the check stuck to me longer than it needs to be.
- The structure is wrong.
- The opening explains instead of showing.
- It used a word I do not use.
- It claimed something the work does not back up.
= your standard, in words. And a standard in words is a process — the model can read a draft against the criteria you wrote and flag what you would have flagged.
The judgment goes from a thing you perform every time to a thing you decided once and wrote down, so the routine cases can be checked without you, and you spend your attention only on the drafts that genuinely need it.
Decide where you stay, on purpose.
None of this is an argument for removing yourself from your own work. Taking the checking apart is what lets you be deliberate about the opposite: where you stay in it.
Some decisions are worth your eyes every single time, because getting them wrong is expensive, or because they are the reason the work is yours and not anyone's. Those points you keep. You draw that line yourself, and where you draw it is a matter of what you find acceptable, which is yours to set.
The method does not tell you where the human belongs. It makes the line a choice you make on purpose, instead of a default where you check everything because you never separated the decisions that matter from the ones that only feel like they do.
So the loop runs like this.
Five moves. Run them in order, and where AI fits stops being a guess and becomes something the shape of your own work hands you.
Name the problem and how you will measure it. The part you keep avoiding, and the crude test for whether it got better.
If the workflow exists, write it down and find the repetition. If it does not, build it outside-in from input and output until the steps and the missing documents show themselves.
Take the checking apart until your standard is written. Name the specific failures that mean a thing is not ready.
Hand the model the repeated steps and the written standard. The substrate, and the criteria to check itself against.
Keep, for yourself, the few decisions that are the actual work. Deciding what is worth doing, and what good means.
↻ then the next piece of work runs the same loop
the point.
What is left after all that is the part that was always worth your time. The model does not touch it. It just stops being buried under everything that was never the point.
— Kate