I would worry about the kids having a sick rabbit at home and then me bringing the disease back to my herd, but you face the same problems when you take rabbits to shows, and they have an even higher chance of contaminating your buns.
Most people would quarantine the rabbit to limit the risk.
That being said, I had an English Lop as a kid. My first rabbit, and at the time, my only rabbit. She was so unique looking, people came from all over to see her and other animals in my mini zoo. We took her to parks and to schools where she met lots of different people and she never got ill, so it depends on the rabbits immune system as well.