A partnership between the CDL, Harvard Library, and UCLA Library has been awarded funding to create Cobweb, a collaborative collection development platform for web archiving.
Archiving the web comprehensively and thematically can exceed the technical and financial ability of any single library. To ensure that the limited resources of archiving programs are used most effectively, it is important that curators know something about the collection development priorities and holdings of similarly-engaged institutions. Cobweb will do this by supporting three key functions: nominating, claiming, and holdings. The nomination function will let curators suggest web sites relevant to specific areas; the claiming function will allow archival programs to indicate they intend to capture some portion of nominated sites; and the holdings function will allow programs to show which sites that have actually been captured.
How would Cobweb work? Imagine a fast-moving news event happening online via news reports, videos, blogs, and social media. Noting the importance of the event, a curator immediately creates a new Cobweb project and issues a call for nominations. Scholars, subject area specialists, and even interested members of the public respond, contributing to a site list more far-reaching than could be created by any one institution. Archiving institutions review the list and claim responsibility for capturing portions of it that are in line with their local policies and technical capabilities. After capture, the institutions’ holdings information is updated in Cobweb to show the various collections containing newly accessible content. Cobweb will collect only metadata; the actual archived web content would be managed by the individual collecting organizations. Notwithstanding, by sharing the work, more content will be captured more quickly with less effort than would usually be possible.
Cobweb is made possible in part by the Institute of Museum and Library Services.
