I would agree, but the "patchwork" of color differences are more tolerable if the components, -vs- structure finishes are similar.
Think in terms of Vinyl covered items alike or darn close, then the contrast of Headliner, Plastic Trim, Painted dash top and dash front and rug and steering column,,, such,,,, look like a better mix matrix.
I have similar problems with my Red Interior.
I would strive to Keep the Seats; Front & Rear & Side panels very, very close as a group as possible- Easier said than done.
Jim