# End of Term Web Archive

> Mediated Wiki article. Canonical URL: https://mediated.wiki/source/End_of_Term_Web_Archive
> Markdown URL: https://mediated.wiki/source/End_of_Term_Web_Archive.md
> Source: https://en.wikipedia.org/wiki/End_of_Term_Web_Archive
> Source revision: 1350581165
> License: Creative Commons Attribution-ShareAlike 4.0 International (https://creativecommons.org/licenses/by-sa/4.0/)

Project to archive US government websites

End of Term Web Archive (EOT Archive) A version of this USGS map was archived by project partner UNT in the 2008 End of Term collection. Mission statement "The End of Term Web Archive captures and saves U.S. Government websites at the end of presidential administrations." Commercial? No Type of project Collaborative government web archive Established 2008 Website eotarchive.org

The **End of Term [Web Archive](/source/Web_archiving)** is an archival project that preserves U.S. federal government websites during administration changes.[1]

## Background

The End of Term Web Archive was set up following a 2008 announcement from [National Archives and Records Administration](/source/National_Archives_and_Records_Administration) (NARA) that they would not be archiving government websites during [transition](/source/United_States_presidential_transition), after carrying out such crawls in 2000 and 2004.[2] The 2004 federal web harvest can be accessed alongside congressional web harvests, beginning with the [109th United States Congress](/source/109th_United_States_Congress), at [National Archives](https://webharvest.gov/).[3]

The first project partners were the [Library of Congress](/source/Library_of_Congress), [George Washington University](/source/George_Washington_University) Libraries, [Stanford University Libraries](/source/Stanford_University_Libraries), [University of North Texas Libraries](/source/University_of_North_Texas_Libraries), the [US Government Publishing Office](/source/US_Government_Publishing_Office), [California Digital Library](/source/California_Digital_Library) and the [Internet Archive](/source/Internet_Archive), all members of the [International Internet Preservation Consortium](/source/International_Internet_Preservation_Consortium). The project was initially sketched out after a General Assembly of the IIPC in 2008.[4] NARA and the Environmental Data & Governance Initiative ([EDGI](https://envirodatagov.org/)) joined the 2020/21 project.[5]

## The project

[Custom error page](/source/HTTP_404#Custom_error_pages) used to direct whitehouse.gov visitors as the website [changed in 2009](/source/United_States_presidential_transition#Bush–Obama)

The project archives websites and documents for public access and research use.[6] Data from archiving 2008, 2012, 2016, and 2020 End of Term datasets can be downloaded in bulk.[7] As of February 2025, the 2004 datasets are still being inventoried and there is plan to move a copy of all datasets into Amazon Web Services.[7]

A UNT study into the risk to document files found that 83% of [PDFs](/source/PDF) on the .gov domain in 2008 were missing four years later.[8] This is consistent with the requirement to [manage websites](/source/Website_governance#Governance_models), but their status means that changes may be of interest to the public and watchdog groups.[9] Evidence of the demand for continued access to historical web material can be found in an announcement made by the [EPA](/source/United_States_Environmental_Protection_Agency) in response to concerns about changes in 2017, stating that pages from the previous administration would be carefully archived.[10] These [snapshot](/source/Snapshot_(computer_storage)) pages were clearly marked to distinguish them from contemporary content.[11]

The archive prioritizes sites administering areas regarded as likely to be updated or removed over the period of transition.[12] The public are encouraged to nominate important sites and these are combined with broad crawls of government [domains](/source/Top-level_domain) to create the collection.[13][14] Although it is extensive - the 2016 crawl preserved 11,382 sites - it is not fully comprehensive.[15][16] Researchers have used these collections to examine the history of climate change policy and reuse of [suspended](/source/Twitter_suspensions) U.S. government Twitter accounts.[17][18]

The 2024 crawl began in January 2024, with a [URL Nomination Tool](https://digital2.library.unt.edu/nomination/eth2024/about/) developed by the University of North Texas.[19][20]

## See also

- [International Internet Preservation Consortium](/source/International_Internet_Preservation_Consortium)

- [List of Web archiving initiatives](/source/List_of_Web_archiving_initiatives)

## References

1. **[^](#cite_ref-1)** Dwyer, Jim (2016-12-02). ["Harvesting Government History, One Web Page at a Time (Published 2016)"](https://www.nytimes.com/2016/12/01/nyregion/harvesting-government-history-one-web-page-at-a-time.html). *The New York Times*. [ISSN](/source/ISSN_(identifier)) [0362-4331](https://search.worldcat.org/issn/0362-4331). [Archived](https://web.archive.org/web/20200118001901/https://www.nytimes.com/2016/12/01/nyregion/harvesting-government-history-one-web-page-at-a-time.html) from the original on 18 Jan 2020. Retrieved 2020-12-07.

1. **[^](#cite_ref-2)** Webster, Peter (2017). Brügger, Niels (ed.). ["Users, technologies, organisations: Towards a cultural history of world web archiving"](https://web.archive.org/web/20201021215748/https://hcommons.org/deposits/item/hc:26187/). *Web 25. Histories from 25 Years of the World Wide Web*: 179–190. [doi](/source/Doi_(identifier)):[10.3726/b11492](https://doi.org/10.3726%2Fb11492). [hdl](/source/Hdl_(identifier)):[2318/1770557](https://hdl.handle.net/2318%2F1770557). [ISBN](/source/ISBN_(identifier)) [9781433140655](https://en.wikipedia.org/wiki/Special:BookSources/9781433140655). Archived from [the original](https://hcommons.org/deposits/item/hc:26187/) on 2020-10-21.

1. **[^](#cite_ref-3)** ["National Archives"](https://webharvest.gov/). *Congressional & Federal Government Web Harvests*. [Archived](http://webarchive.loc.gov/all/20170918235110/https://www.webharvest.gov/) from the original on 2017-09-18. Retrieved 2021-01-18.

1. **[^](#cite_ref-4)** Seneca, Tracy; Grotke, Abbie; Hartman, Cathy Nelson; Carpenter, Kris (2012). ["It Takes a Village to Save the Web: The End of Term Web Archive"](https://web.archive.org/web/20150908001132/http://wikis.ala.org/godort/images/7/7d/DttP_40n1.pdf) (PDF). *DTTP: Documents to the People*. **40**: 16. [ISSN](/source/ISSN_(identifier)) [0091-2085](https://search.worldcat.org/issn/0091-2085). Archived from [the original](http://wikis.ala.org/godort/images/7/7d/DttP_40n1.pdf) (PDF) on 2015-09-08.

1. **[^](#cite_ref-5)** ["GitHub - end-of-term/eot2020"](https://github.com/end-of-term/eot2020). *[GitHub](/source/GitHub)*. [Archived](https://web.archive.org/web/20201205003120/https://github.com/end-of-term/eot2020) from the original on 2020-12-05. Retrieved 2020-12-14.

1. **[^](#cite_ref-6)** ["End of Term Web Archive: U.S. Government Websites"](http://eotarchive.cdlib.org/). 2020-12-06. [Archived](https://web.archive.org/web/20201206142930/http://eotarchive.cdlib.org/) from the original on 2020-12-06. Retrieved 2020-12-15.

1. ^ [***a***](#cite_ref-:0_7-0) [***b***](#cite_ref-:0_7-1) ["Datasets"](https://eotarchive.org/data/). *End of Term Web Archive*. Retrieved 2025-02-02.

1. **[^](#cite_ref-8)** Gilmore, Courtney (4 Dec 2020). ["UNT Part of Team Archiving Obama Administration Web Content"](https://www.nbcdfw.com/news/local/unt-part-of-team-archiving-president-obama-administration-web-content/2034483/). *NBC 5 Dallas-Fort Worth*. [Archived](https://web.archive.org/web/20201207132642/https://www.nbcdfw.com/news/local/unt-part-of-team-archiving-president-obama-administration-web-content/2034483/) from the original on 7 Dec 2020. Retrieved 2020-12-04.

1. **[^](#cite_ref-9)** ["Website Monitoring"](https://envirodatagov.org/website-monitoring/). *Environmental Data and Governance Initiative*. [Archived](https://web.archive.org/web/20201206101408/https://envirodatagov.org/website-monitoring/) from the original on 2020-12-06. Retrieved 2021-02-24.

1. **[^](#cite_ref-10)** Mooney, Chris; Eilperin, Juliet. ["EPA website removes climate science site from public view after two decades"](https://www.washingtonpost.com/news/energy-environment/wp/2017/04/28/epa-website-removes-climate-science-site-from-public-view-after-two-decades/). *Washington Post*. [ISSN](/source/ISSN_(identifier)) [0190-8286](https://search.worldcat.org/issn/0190-8286). [Archived](https://web.archive.org/web/20170429160537/https://www.washingtonpost.com/news/energy-environment/wp/2017/04/28/epa-website-removes-climate-science-site-from-public-view-after-two-decades/) from the original on 2017-04-29. Retrieved 2021-02-18.

1. **[^](#cite_ref-11)** ["Climate Change | US EPA"](https://web.archive.org/web/20170429202520/https://19january2017snapshot.epa.gov/climatechange_.html). 2017-04-29. Archived from [the original](https://19january2017snapshot.epa.gov/climatechange_.html) on 2017-04-29. Retrieved 2021-04-08.

1. **[^](#cite_ref-12)** ["Guerrilla Archiving"](https://politicsofevidence.wordpress.com/guerrilla-archiving/). *The Politics of Evidence*. 2016-12-05. [Archived](https://web.archive.org/web/20200804085020/https://politicsofevidence.wordpress.com/guerrilla-archiving/) from the original on 4 Aug 2020. Retrieved 2020-12-07.

1. **[^](#cite_ref-13)** Jacobs, James R. (2020-08-10). ["Nominations sought for the U.S. Federal Government Domain End of Term 2020 Web Archive"](https://freegovinfo.info/node/13820/). *Free Government Information (FGI)*. [Archived](https://web.archive.org/web/20201004150749/https://freegovinfo.info/node/13820) from the original on 4 Oct 2020. Retrieved 2020-12-07.

1. **[^](#cite_ref-14)** ["End of Term Archive on Twitter: "And so it begins. We have officially started crawling the websites nominated for the End of Term 2020 web archive! But don't worry, you still have time to nominate more! What are your favorite government sites? #WebArchiveWednesday #WebArchives #GovDocs""](https://twitter.com/eotarchive/status/1313945356623851521). 2020-10-07. [Archived](https://web.archive.org/web/20201007205728/https://twitter.com/eotarchive/status/1313945356623851521) from the original on 7 Oct 2020. Retrieved 2020-11-06.

1. **[^](#cite_ref-15)** O'Keefe, Ed (2015-10-08). ["How many .gov sites exist? Thousands. - The Washington Post"](https://www.washingtonpost.com/blogs/federal-eye/post/how-many-gov-sites-exist-thousands/2011/12/20/gIQAkGAG7O_blog.html). *[The Washington Post](/source/The_Washington_Post)*. [Archived](https://web.archive.org/web/20151008071818/https://www.washingtonpost.com/blogs/federal-eye/post/how-many-gov-sites-exist-thousands/2011/12/20/gIQAkGAG7O_blog.html) from the original on 8 Oct 2015. Retrieved 2020-12-04.

1. **[^](#cite_ref-16)** Young, Lauren J. ["The Librarians Saving The Internet"](https://apps.sciencefriday.com/data/librarians.html). *Science Friday*. [Archived](https://web.archive.org/web/20201109025646/https://apps.sciencefriday.com/data/librarians.html) from the original on 9 Nov 2020. Retrieved 2020-12-04.

1. **[^](#cite_ref-17)** EDGI, Toly Rinberg, Maya Anjur-Dietrich, Marcy Beck, Andrew Bergman, Justin Derry, Lindsey Dillon, Gretchen Gehrke, Rebecca Lave, Chris Sellers, Nick Shapiro, Anastasia Aizman, Dan Allan, Madelaine Britt, Raymond Cha, Janak Chadha, Morgan Currie, Sara Johns, Abby Klionsky, Stephanie Knutson, Katherine Kulik, Aaron Lemelin, Kevin Nguyen, Eric Nost, Kendra Ouellette, Lindsay Poirier, Sara Rubinow, Justin Schell, Lizz Ultee, Julia Upfal, Tyler Wedrosky, Jacob Wylie. ["Changing the Digital Climate"](https://100days.envirodatagov.org/changing-digital-climate/). *100days.envirodatagov.org*. [Archived](http://webarchive.loc.gov/all/20180404212805/https://100days.envirodatagov.org/changing-digital-climate/) from the original on 2018-04-04. Retrieved 2021-01-14.{{[cite web](https://en.wikipedia.org/wiki/Template:Cite_web)}}: CS1 maint: multiple names: authors list ([link](https://en.wikipedia.org/wiki/Category:CS1_maint:_multiple_names:_authors_list))

1. **[^](#cite_ref-18)** Littman, Justin (2017-11-04). ["Suspended U.S. government Twitter accounts"](https://gwu-libraries.github.io/sfm-ui/posts/2017-11-04-digital-registry). *Social Feed Manager*. [Archived](https://web.archive.org/web/20171107030127/https://gwu-libraries.github.io/sfm-ui/posts/2017-11-04-digital-registry) from the original on 2017-11-07. Retrieved 2020-12-07.

1. **[^](#cite_ref-19)** ["Nomination Tool: About Project"](https://digital2.library.unt.edu/nomination/eth2024/about/). *digital2.library.unt.edu*. Retrieved 2025-02-02.

1. **[^](#cite_ref-20)** Cron, Bethany (2024-06-24). ["Announcing the 2024 End of Term Web Archive Initiative"](https://records-express.blogs.archives.gov/2024/06/24/announcing-the-2024-end-of-term-web-archive-initiative/). *Records Express*. Retrieved 2025-02-02.

## External links

- [Official website](https://eotarchive.org/)

- [End-of-term](https://github.com/end-of-term) on [GitHub](/source/GitHub)

- [Collection](https://archive.org/details/EndofTermWebCrawls) at the [Internet Archive](/source/Internet_Archive)

v t e United States presidential transitions Transitions Abraham Lincoln (1860–61) Woodrow Wilson (1912–13) Warren G. Harding (1920–21) Herbert Hoover (1928–29) Franklin D. Roosevelt (1932–33) Dwight D. Eisenhower (1952–53) John F. Kennedy (1960–61) Richard Nixon (1968–69) Jimmy Carter (1976–77) Ronald Reagan (1980–81) George H. W. Bush (1988–89) Bill Clinton (1992–93) George W. Bush (2000–01) Barack Obama (2008–09) Donald Trump (2016–17) Joe Biden (2020–21) Donald Trump (2024–25) Planned transitions Michael Dukakis (1988) Bob Dole (1996) Al Gore (2000) John Kerry (2004) John McCain (2008) Mitt Romney (2012) Hillary Clinton (2016) Kamala Harris (2024) Related President-elect of the United States Vice President-elect of the United States End of Term Web Archive Midnight regulations Pre-Election Presidential Transition Act of 2010 Plum Book

---
Adapted from the Wikipedia article [End of Term Web Archive](https://en.wikipedia.org/wiki/End_of_Term_Web_Archive) by Wikipedia contributors ([contributor history](https://en.wikipedia.org/wiki/End_of_Term_Web_Archive?action=history)). Available under [Creative Commons Attribution-ShareAlike 4.0 International](https://creativecommons.org/licenses/by-sa/4.0/). Changes may have been made.