yes its possible but depending on the network you should be able to get it back easily. for e.g. on quakenet you can reg your channel and Q/L bot will join in and hold the channel for you if everyone leaves however Q/L can be down for maintenance or disappear due to server splits, at this point people can grab your channel provided nobody is inside. However usually Q will reenter and de-op anyone that wasn't op-ed when it left/split.