Brother, are you confusing the bayah to a shaykh with the baya` to a khalifah? Breaking the latter is the fisq you mentioned. and Allah knows best.