Yes bees make them all the time. Nothing to worry about if not charged. Sometimes you get the odd egg which may or may not stay in it. As soon as you see queen jelly then you know they are thinking about swarming. I usually open the edge of queen cups just to check for eggs. It gives me some idea if they are considering swarming!