Excerpt from a link I cant post right now due to new user restrictions:
If the new nest site is within the previous foraging range, the bees learn the position of the new site while still retaining knowledge of the previously acquired foraging range. Interestingly, bees from a newly established natural swarm always return to the new swarm site. Although it is not clear why, there is something about their experience of being in a swarm that supresses the drive to return to the old nest (Robinson and Dyer 1993). In the same study, the authors showed that if the new nest is removed while the foragers are out (within the first week), they will eventually return to their natal nest; thus illustrating that the bees will learn new positions while maintaining the knowledge of the position of the previous site. Similarly, when a beekeeper captures a swarm and takes it to another site, any bees that get lost or remain at the bivouac site (where the swarm grouped in a beard/ball) will eventually return to the natal nest. It is in bee’s interest to be able to locate its natal nest for a number of reasons, such as if the swarm fails due to bad weather or bad choice of site.
So judging from that, it doesn't appear to be something worth worrying about, if you have the majority of them in the nuc box.