best thing I have done with my herd is the following protocol
Really really look at your three day old kits and mark the biggest and most solid of them. For my lines, I get a lot of colour differences in my kits so it's generally not hard for me to know who is who, but for those with same colours, sharpies are your friend.
THOSE will most likely be your keepers.
Realize that all sorts of things can throw them off. For instance, had a holland lop kit almost die on me (dragged out of box and almost frozen). it's currently 1/2 the size of it's litter mates. Prior to this, it was the biggest, nicest looking of the litter. Right now I wonder if it will even make it to eight weeks. A day missed feeding doesn't throw them off that much, but two days does. BUT you want kits that can utilize the feed they are given in the best manner. At three days old, you can generally tell that.
Check them again at 9-10 days. Any with nestbox eye cross of your list. They are disease carriers and you don't want to keep them. Also check them for growth and heft in your hand at that point. Solid, big kits is what you want. (or in the case of fancies... just nice healthy-feeling kits).. Type comes later.
Check those kits again at four-five weeks and either pull the biggest and best out to grow them separate or leave them with mom and pull the rest out. The bottom of the pack are your lunch rabbits, the top 1/3 you grow them out.
Mom's milk and genetics plays a big role, but so does the ability of the kits to utilize the feed at hand. Having "check mark" days has helped in my rabbitry and I'm getting nicer rabbits as I move forward with my meat mutt program.