The hardest would either be Xaldin or Xigbar. Xaldin can get hard with that jumping move, but Xigbar is just relentless!
Though to be honest, Demyx was the one who took longest for me to defeat. Not because he's hard or anything, purely because he's just annoying.