1 Corinthians 7:28, 32-34, 38

If you do get married, you haven't sinned. If an unmarried woman gets married, she hasn't sinned. But you will have many troubles in this current world and I would want to spare you these.

I would prefer you to be free from such worries. A man who is not married pays attention to what is important to the Lord, and how he can please the Lord. But a man who is married pays attention to what is important in this world, and how he can please his wife. As a result his loyalties are divided. Similarly an unmarried woman or girl pays attention to what is important to the Lord, so she may live a life dedicated both in body and spirit. But a married woman pays attention to what is important in this world, and how she can please her husband.

So the man who marries the woman he's engaged to does well, while the one who does not get married does better.