Rotational symmetry breaking in a trigonal superconductor Nb-doped Bi₂Se₃

The search for unconventional superconductivity has been focused on materials with strong spin-orbit coupling and unique crystal lattices. Doped bismuth selenide (Bi₂Se₃) is a strong candidate, given the topological insulator nature of the parent compound and its triangular lattice. The coupling between the physical properties in the superconducting state and its underlying crystal symmetry is a crucial test for unconventional superconductivity. In this paper, we report direct evidence that the superconducting magnetic response couples strongly to the underlying trigonal crystal symmetry in the recently discovered superconductor with trigonal crystal structure, niobium (Nb)-doped Bi₂Se₃. As a result, the in-plane magnetic torque signal vanishes every 60°. More importantly, the superconducting hysteresis loop amplitude is enhanced along one preferred direction, spontaneously breaking the rotational symmetry. This observation indicates the presence of nematic order in the superconducting ground state of Nb-doped Bi₂Se₃.