I think the bigger problem is that it probably wouldn't make you happy if you can't interact with it. Like if you had your own watch museum and you could go and take any of the watches and wear them, would you have the time to look at all of them or wear them or the time to appreciate them?
Personally I make up all kinds of preferences and so on to be able to limit mine to a manageable number. For example I choose to not collect certain movements, case shapes, etc.
Like at the moment, I don't have any chronographs but I've decided to not get more than few if I ever get to it. And it would probably be quartz because I don't feel like servicing mechanical ones(unless I someday learn to do it myself.. who knows?)
So even if you have the space for it, at some point (even it's a 1000 watches) you would want to downsize or so. Or otherwise I think you would see them as commodity and only care a lot for up to 50. Basically if you had 1000s of rare watches they would stop feeling rare. 😂
At this point, I think it would probably make me happier to learn to service the watches I have. But I need to get tools and not more watches first.
So all in all, I no longer care much if I miss out on a watch like I did before.