Easter eggs and bunnies aren’t actually symbols of Christianity except in a very loose sense. They’re actually a vestigial remnant of Christianity’s pagan roots.
I can see the point that this Presbyterian church shouldn’t really have that kind of special access to a public school, though.