Smithsonian Now Using Archive-It to Crawl Websites

February 26th, 2013

Smithsonian Now Using Archive-It to Crawl Websites

“In September 2012, the Smithsonian Institution Archives began using Archive-It, a service of the Internet Archive, to crawl its almost 250 websites…While Archive-It uses the same software for crawling and viewing websites as we had been using for the past three years, we have been plagued with hardware issues and have not been able to keep our software up-to-date. We now have access to software updates as soon as they are available. The processes of setting up a crawl and reviewing it afterwards are also more user-friendly with Archive-It. In addition, we now have the benefit of support from both the Archive-It staff and the larger Archive-It user community for those times when we just cannot figure out why a crawl is not working.”
Learn more

— By Jennifer Wright, The Smithsonian Bigger Picture Blog, February 26, 2013