You should have good solid legal ground to press the issue and maybe limit your ex down to visitation that is under 12 hours at a time, if anything. Social worker, Lawyers, Doctors, Hell if you can swing it get him into the doctors the same day you pick him up so there is outside documentation...