Dead drones is fine. Our have been doing serious housekeeping on warm days, and we have piles of expired bees outside the hives. Some are drones.
Flying drones is more of a worry. As a suggestion, put at board under the hive and look at the debris after a week. If it is lots of drone caps (bigger chunks of wax) then you have a problem - you've got emerging drones, so a drone laying queen. If it is the usual small hive debris, then you are probably fine.
If you suspect a DLQ, it is worth opening up and having a look on a warm day. If all (or much) of the brood is drone, kill her maj and merge them with another colony if there are still enough workers to make it useful. If most of the bees are drones, then don't merge as it won't help the other colony.