The apparent meaning of the hadith is very clear. "your" interpretation is in need of assumptions. I hope you can admit that, at least for yourself. There aren't any proofs against this matter. The ahadith that you mentioned doesn't forbid it. The scholars reached this conclusion based on sound qiyas. Qiyas is one source of legislation. You keep writing about staying away from the doubtful if you are in doubt then leave it, but leave the rest of us who don't harbour any doubts alone. The scholars who allowed it are probably more God fearing than you, don't you think?