Looks nasty, what does the source model look like? What app did you create the displacement map? Are all the norms facing the correct way?..........dave

Edit:could you show use a picture of the dislacement map and UVs