@thomasfuchs me neither.
i remember a blogpost around 2005 in which a google engineer described how to design a crawler and a search index. that was really impressing.
main point: you don‘t need bandwidth or high end hardware, you‘ll need a good algorithm. :)