I knew it was Joe from the beginning. The way he didn't answer any questions about his background was a give away. He also did not have any flashbacks yet. You figure they wouldn't go to the trouble of showing fake flashbacks, so we knew it wasn't Janet, Charlie and Tori. Also likely wasn't the army guy because he did dumb stuff like test out the stun field by touching it with his hand.