Part 4 (Chapter Scrubbing)
Introduction¶
If you haven't seen the previous parts of this series, it might be worth going and reading those first.
Previously, I added revision to the story generation process, and in this section I focused on adding "output scrubbing".
Approach¶
This time, I wanted to fix a minor issue - sometimes after the revision process now, it would include phrases like "here is your revised chapter..." or something along those lines. While not a huge deal, it was annoying to read so I wanted to spend some time to fix these.
Therefore, I would just add a scrubbing step at the end of the generation where another LLM is used to remove any editor notes and produce a final version.
That updated the generation process to look like this:
Result¶
So I found that this scrubbing system did remove most of the editor notes from the final output - but it also was removing content, which wasn't really what I wanted to happen. Probably this is due to bad system prompting, but I needed to move on to the more critical parts of the system, so I've switched my focus to those.
Conclusion¶
I suppose that it did work, but there were some bugs which has lead me to disable this for now. I think that in the future, once the more pressing issues are fixed, I'll revisit this issue and see what can be done to fix this. For now, I've added a command line flag to the generator to temporarily disable this step.