I'm so sorry for all of this while you aren't feeling good!
Yes, mold can most definitely have a huge impact on the immune system, some people need to have specific treatment for mold due to having gene mutations that make them more susceptible to it.
Detoxing well will be key for you, even if you don't have issues with mold. There are likely lots of posts on this subject, so I did a search for you and you can go through these threads to see what good information you can glean from them!
goo.gl/J01omj