Once you set up Mary as a person to be worshipped and deified, you cannot have Joseph having sex with his wife. Thus the story has to be changed - Joseph died and Jesus had no brothers. Mary thus remained a virgin forever. It is not true that God made Joseph into a cuckold. It was a privilege given to both Mary and Joseph, to look after the child that will bring salvation to all men, well, to those who believe. They went through a horrendous period, running away from King Herod who killed every child of that age in the area. Imagine the soldiers doing such an act. They raised him and cared for his welfare. For that, both parents are to be commended. And yes, Jesus has a brother - James, the writer of the epistle that carries the same name. Which means that Joseph had sex with Mary. Thus God blessed them with looking after his son. And at the same time, blessed their marriage with James.