Could the white powder on walls be toxic to infants?

The walls around my house leave a white powdery residue on your clothes if you lean up agaisnt them. I've asked my landlord to repaint and fix it since last year. They never did. My infant has been having problems breathing and now needs treatment for it. Wondering since he sleeps on a slanted wall, if that powder is hurting him in any way?