Hi and welcome,
You will have realised already despite this being the SILVER forum there are as many if not more gold bugs than silver enthusiasts. If you intend to continue stacking silver you will find it considerably cheaper on here than anywhere else. Lots of full tubes around the £550 mark. Silver is a speculative investment for me and I do not buy it in quantity, but hold some just for diversity.
I don't ever stress about where spot is at, I buy what Gold I can when I can afford it, maintaining my cost average as others have already mentioned, but I also make sure I have a reserve of fiat just in case of emergencies. You only lose on Gold when you sell it and mine is for the long term. I do sell on here but generally only to fund larger purchases of different PM's. There are multiple others who do the same as well as a lot of dealers who will sell on here too. If gold follows the same pattern as in previous recessions it should dip when things start getting bad, but then there is little typical about how markets have been in the past few years. Without a crystal ball I think it is anyone's guess. But personally I think any dip will be short lived.