People specifically use their cell phones these days as a crutch so they do not have to interact with other people in their lives. Personally if I saw someone interacting with Glass while I was talking to them (rapidly moving their eyes without making eye contact, etc.) I'd be offended and end the conversation at that point.