Isogeny orbits in a family of abelian varieties

We prove that if a curve of a non-isotrivial family of abelian varieties over a curve contains infinitely many isogeny orbits of a finitely generated subgroup of a simple abelian variety then it is special.