I agree, it looks amber to me, too. Mind you, I haven't seen a ton of ambers in person...
If he's AAt, then he will continue to throw otters here and there, depending what the does are carrying. Since he is agouti-based (not castor-based) you should get some agoutis eventually, but it's not surprising that you're getting otters if you're breeding to a self (aa) doe. The self colors are recessive to otter, which is recessive to agouti (so he doesn't look otter, he only carries it in his genes). There should be a 50% chance of the kits being otter, and 50% chance agouti, since the dad’s A-locus genes will win out over the self color genes, and that’s all he’s got to give. But in individual litters those odds don’t always match… over time you might get a 50/50 split, but one individual litter may be all otters or all agoutis.
His chocolate color, on the other hand, is recessive. So where the kits are showing dad’s A-locus influence, they’re getting their B-locus looks mostly from their mom, I would think. Black is dominant (B) to chocolate (b), so you’ll get some black otters and castors from that pairing, but you won’t get any more chocolates unless the doe carries for chocolate (Bb). Try breeding him to a chocolate doe and you’ll probably get more ambers.
If anyone wants to correct my explanations, by all means, I don't exactly hold a degree in rabbit color genetics, and I'm known to make mistakes here and there.