I agree with Sherrine and Loring. Stress is just so tricky. It shows itself sometimes in very odd ways. I've noticed after very stressful moments that my muscles will practically be in a knot. Sometimes, we don't even realize how much stress we're under. When nerve pain hits, it can feel incredibly painful.
I would definitely check with another doctor concerning your baby; perhaps one who specializes in high-risk pregnancies. I've heard of so many women who were told their babies would be severely handicapped, and often it turned out not to be the case at all. Doctors can be wrong, and tests can sometimes be misleading or misinterpreted. As Sherrine said, such a mistake would be so tragic.
It's very sad that some doctors can forget that even the very handicapped can have meaningful lives. From our view, it can look so difficult, and while obviously not easy, I've heard (and sometimes seen) those who've raised the handicapped say the handicapped can often give us much more than we can give; they can truly inspire us. It's a matter of perspective.
I'm always amazed by all the medical advancements these days, too. Sometimes, they can even perform surgery on a baby while still in the womb!
Also praying for you, your wife, and your baby. Best wishes!