You’ve experienced what the color science world calls “lightness anchoring theory”, where your brain is constantly adjusting for what it believes “diffuse white” is in everything you look at :D