I had my thoughts on this BUT I just called and confirmed it with a Shaykh. Your words are meant to be "If Allah (SWT) gives you health you will not go to this woman in an unIslamic Manner" And your oath is valid and you should uphold it. Marrying her (i.e. doing an Islamic Nikah) with her is sanctioned by Allah (SWT) and it is not part of your Oath! You are free to marry her and may Allah (SWT) give you two Barakah and Blessings in your life (Ameen).