The CIA offers an electronic search engine that lets you mine about 11 million agency documents that have been declassified over the years. It’s called CREST, short for CIA Records Search Tool. But this represents only a portion the CIA’s declassified materials, and if you want unfettered access to the search engine, you’ll have to physically visit the National Archives at College Park, Maryland.
Using the Freedom of Information Act, historians and researchers have urged the CIA to provide them with their own copy of the CREST electronic database, so that they can seek greater insight into U.S. history and even build up additional checks and balances against the government’s approach to official secrecy. But the agency won’t do it. “Basically, the CIA is saying that the database of declassified documents is itself classified,” explains Steve Aftergood, a senior research analyst with the Federation of American Scientists, who oversees the federation’s government secrecy project.
It’s an irony that represents a much larger problem in the world of declassified government documents. According to Aftergood — a researcher some have called the “the Yoda of Official Secrecy” — most government agencies haven’t even gone as far as the CIA in providing online access to declassified documents, and as it stands, there’s no good way of electronically searching declassified documents from across disparate agencies.
“The state of the declassified archives is really stuck in the middle of the 20th Century,” says Aftergood. He calls it a “fairly dismal picture,” but he also says there’s an enormous opportunity to improve the way we research declassified materials — and improve it very quickly — through the use of modern technology.
That’s the aim of a new project launched by a team of historians, mathematicians, and computer scientists at Columbia University in New York City. Led by Matthew Connelly — a Columbia professor trained in diplomatic history — the project is known as The Declassification Engine, and it seeks to provide a single online database for declassified documents from across the federal government, including the CIA, the State Department, and potentially any other agency.
The project is still in the early stages, but the team has already assembled a database of documents that stretches back to the 1940s, and it has begun building new tools for analyzing these materials. In aggregating all documents into a single database, the researchers hope to not only provide quicker access to declassified materials, but to glean far more information from these documents than we otherwise could.
- The Declassification Engine: Your One-Stop Shop for Government Secrets (wired.com)
- A Search Engine For Government Documents (personalliberty.com)
- Building a Declassification Engine (pascophronesis.wordpress.com)
- Declassified Documents Reveal Extent of CIA Influence on ZERO DARK THIRTY Script (collider.com)