I keep my growouts up to 5-6 months, feeding mosgtly fresh forage. Doelings stay with the breeding doe pair, that is no problem. My setup is that each pair has two hutches connected by a tunnel, so if they feel like it they can always get out of sight of whoever is the problem at the moment. At high headcount times I need to disconnect the hutches for boys and girls, but they still have hidey houses and shelfs.
Does build a social structure, a working hierachy, with several steps of escalation when sorting out their pecking order, evil eye, humping, short chasings, tufts of fur flying. The last one is rather rare, and I never had a real fight among a group of does (It's instant Kung Fu when they accidentially meet one from the other group though)
Bucklings, on the other hand, are quite stupid in that regard. They kind of have a hierachy too, but it's not well accepted when hormones rage. There are more tensions. Juvenile hotspurs.
In 7 years, and about 2-4 litters per year, I had it only happen once that it escalated, came home from work to find in my group of 6 about 4-5 month old bucklings 2 crudly castrated bucks and one with his hind legs tangled in his intestines.
All rabbits get some hours of garden time at least every second day.
A lot depends on the setup, and I guess on the characters of the breeding lines too.