Yes, hair damage from soap is a real thing. As mentioned, I had to buzz mine to 1/4" after it started breaking off in clumps. Granted it took about 2 year to get to that point, the high PH takes time to break down the cuticle.
Some people can use soap with no issue but unfortunately your hair...