Skip to content

Part 4 (Chapter Scrubbing)

Introduction

If you haven't seen the previous parts of this series, it might be worth going and reading those first.

Previously, I added revision to the story generation process, and in this section I focused on adding "output scrubbing".

Approach

This time, I wanted to fix a minor issue - sometimes after the revision process now, it would include phrases like "here is your revised chapter..." or something along those lines. While not a huge deal, it was annoying to read so I wanted to spend some time to fix these.

Therefore, I would just add a scrubbing step at the end of the generation where another LLM is used to remove any editor notes and produce a final version.

That updated the generation process to look like this:

Updated LLM Story Generation Process

Result

So I found that this scrubbing system did remove most of the editor notes from the final output - but it also was removing content, which wasn't really what I wanted to happen. Probably this is due to bad system prompting, but I needed to move on to the more critical parts of the system, so I've switched my focus to those.

Conclusion

I suppose that it did work, but there were some bugs which has lead me to disable this for now. I think that in the future, once the more pressing issues are fixed, I'll revisit this issue and see what can be done to fix this. For now, I've added a command line flag to the generator to temporarily disable this step.