Colourless Lighting With Exceptions

I am trying to make my game’s lighting look black and white while being able to have lights that reveal the colour of parts.

I have tried using ColorCorrectionEffect to get black and white lighting, except it’s a post-processing effect, so it applies to everything.

I can’t use a ViewportFrame to make exceptions because I want the player to be able to interact with the coloured area.