Moduli interpretations for noncongruence modular curves

We consider the moduli of elliptic curves with G-structures, where G is a finite 2-generated group. When G is abelian, a G-structure is the same as a classical congruence level structure. There is a natural action of SL ₂(Z) on these level structures. If Γ is a stabilizer of this action, then the quotient of the upper half plane by Γ parametrizes isomorphism classes of elliptic curves equipped with G-structures. When G is sufficiently nonabelian, the stabilizers Γ are noncongruence. Using this, we obtain arithmetic models of noncongruence modular curves as moduli spaces of elliptic curves equipped with nonabelian G-structures. As applications we describe a link to the Inverse Galois Problem, and show how our moduli interpretations explains the bad primes for the Unbounded Denominators Conjecture, and allows us to translate the conjecture into the language of geometry and Galois theory.