You exactly identified the problem case that I had!
In my prefab, the sprite was disabled. In my start function, I enabled the sprite and immediately set the color. I will change my code so that that the sprite is enabled in my prefab, and I can disable it in my start function when I don't need it. Whew, thank you!