So much anthropomorphism....frogs don't have 'babies'. Babies come from humans. Frogs produce eggs which turn into larvae or tadpoles which morph into froglets.
Or am I off base / pedantic with all this?
I think its easier to consider the morphed froglets (or adult frogs) produced from a pairing in the frame of mind as progenitors and offspring as babies. That said in my humble view I believe that when referring to the progeny themselves it would be appropriate to classify them as what they are at that time.
I don't think it matters. We call our children "kids" which are technically young goats.