In this talk, we discuss conformal field theories in two dimensions (2d CFTs) and aspects of the theory of modular forms. Physical considerations lead us to study two extensions to the theory of modular forms: modular forms for GL2(Z) that are defined on the double half-plane (in distinction to SL2(Z) modular forms defined on the upper half-plane), and L-functions for modular forms with poles *within* the fundamental domain. We introduce both concepts, and discuss their consistency, both with each other and with the physical considerations which led to them. Finally, we note that very similar physical considerations may apply to finite-temperature path integrals for generic QFTs in higher dimensions, and comment on possible consequences of this.