Its usually due to poor connection. Many things can cause this such as, having to many people on the same network doing to many things at once (I have this problem a lot), your internet is just not good enough to be running the game or the other person has poor connection to you (unlikely in this situation because sounds like it happens in sector). My suggestion try asking your family to stay off the internet while you play and make sure that strangers aren't on your internet (Look up videos on how to kick people off your internet), Also try re-installing the game.