Many new beekeepers panic and cut out queencells to stop swarming (before they check that there are eggs or the old queen is still present). In this case, at this time of year, if the colony produces a queencell, it's most likely a supercedure queencell (probably just 2 or 3) so I would leave...