Can my name be taken off my joint account for the mortgage without my permission as well as off the mortgage?

No.  A joint account is exactly that:  Joint.  Both parties have equal and overlapping rights, and neither of them can circumvent the rights of the other, or prioritize their own legal or other interests, without the other person’s consent.

The scope of these rights are governed by Canadian banking and mortgages law, which addresses these topics, and potentially by the specific terms of the bank account and mortgage that you have both signed up for.  (And those terms should be checked carefully, to ensure that you have not agreed to any exceptions that would allow for your unilateral removal).