The biggest problem is still the sites themselves. It isn't too terribly difficult to get a vintage computer talking to the internet, but my experience has been that very few websites will properly render on an ancient browser and this becomes more and more common all the time.

Text based stuff though ought to be fine. My friend has been running IRC on some ancient computers.