Evidence hierarchy
Not every review note deserves the same weight. A repeated behavior tag across similar setups is stronger evidence than one dramatic outcome. A rule violation that appears before the result is known is stronger evidence than a story written after the trade. A risk issue that appears across several paper entries is stronger than one entry that simply lost money.
Use the hierarchy to keep the feedback loop calm: journal completeness first, rule fit second, risk consistency third, outcome last. Outcomes still matter, but they should not be the only reason a process changes.
This hierarchy is especially useful when paper results look good. A profitable run with weak thesis notes, late entries, or drifting risk can still be a warning that the workflow is not ready to expand.
Cadence and ownership
- Review new paper decisions daily for missing context.
- Review repeated behavior tags weekly.
- Review agent rule changes only after comparable samples exist.
- Write who made the rule change and what result it should improve.
Ownership keeps the loop from becoming anonymous churn. Every rule change should have a reason, an expected effect, and a later review date.