I'd read the Briggs Encyclopedia first. There are cheap used copies, and most libraries (especially university libraries) have it. Then I'd read the Victorian texts at the same time as I'm reading the Silver. That's how I'd structure things if I were teaching a university class on the subject.
If you want to read the Victorian studies first -- and I don't blame you, as lots of them are available for free on Sacred Texts -- bear in mind that Victorian attitudes about gender, class, race, and colonialism are ALL OVER them. So, absorb the actual collected data, but take all the theorizing and contextualizing with many, many grains of salt.
Yay, another reason to look forward to university!!

OK, I'll look for the Briggs first. I've got plenty of other stuff I can read before I get onto the Victorian stuff. Thanks!