With unified diffs we only care about the inline diffs
However, when clicking show full file it ended up
creating a parallel array of diff lines.