For some reason it is impossible for me to interact, pvp wise, with some people. That means that I can't hit them with anything, including a sword. I haven't tried a bow yet though. UPDATE it appears to be working now.
Some times you can't attack people with swords, bows work, it's the same issue as not being able to attack mobs