Unite or risk losing election to Labor: PM