Weakly holomorphic modular forms with sign vectors and applications