I agree on everything you wrote why you love them, except the bit why you also hate them is a part why I love them even more. I love reading up on them, the varieties, the years, the scarce ones and then all the special stikes. It baffles me that there is so much to learn about 'a simple' coin. There is so much knowledge about these little coins, it can be overwhelming. On the other hand there is so much info on these coins it could also feel like well documenten and can't go wrong when one takes time to read up on them.
I started to collect bullion sovereigns with all different years. At this moment i nearly have all bullion years in my collection by now. And therefor i am on the verge of switching from bullion stacker to collector and continue to search for the more scarce, special sovereigns. It is a delicate and slow process as (like you said) there are so many varieties and information. But isn't that what a hobby is? And I am in no rush either.