The 2024 End of Term Web Archive initiative has officially begun. The End of Term Web Archive is a collaborative effort which takes place every four years to preserve a record of U.S. government websites for historical and research purposes. The 2024 End of Term Web Archive partners include the Internet Archive, University of North Texas, Stanford University, Library of Congress, U.S. Government Publishing Office, and National Archives and Records Administration.
End of Term crawls have been completed for term transitions every four years since 2004. The results of these efforts are preserved in the End of Term Web Archive and can be explored here using full text search or downloaded as bulk datasets. In total, over 500 terabytes of government websites and data have been archived through the End of Term Web Archive efforts.
Top-level website domain URLs have been provided by the General Services Administration and taken from previous End of Term crawls. The federal web space is large, and agencies are invited to nominate lesser known URLs for inclusion in the 2024 End of Term crawl. URLs can be nominated by going here. Nominating URLs deep within government websites helps to make our web crawls as thorough and complete as possible.
Agencies should be aware that this initiative does not replace or supplant their recordkeeping requirements to manage and schedule their own web content. For related guidance, see the following: