Computer-generated unfolding animation of sealed letter DB-1538. In our paper we describe how “virtual unfolding” was used to read the contents of sealed letterpackets from 17th-century Europe without physically opening them. Credit: Courtesy of the Unlocking History Research Group archive
History unfolds as an interdisciplinary research team uses computational tools to examine the contents of “locked” letters.
An international team of scholars has read an unopened letter from early modern Europe — without breaking its seal or damaging it in any way — using an automated computational flattening algorithm. The team, including MIT Libraries and Computer Science and Artificial Intelligence Laboratory (CSAIL) researchers and an MIT student and alumna, published their findings on March 2, 2021, in a Nature Communications article titled, “Unlocking history through automated virtual unfolding of sealed documents imaged by X-ray microtomography.”
The senders of these letters had closed them using “letterlocking,” the historical process of folding and securing a flat sheet of paper to become its own envelope. Jana Dambrogio, the Thomas F. Peterson Conservator at MIT Libraries, developed letterlocking as a field of study with Daniel Starza Smith, a lecturer in early modern English literature at King’s College London, and the Unlocking History research team. Since the papers’ folds, tucks, and slits are themselves valuable evidence for historians and conservators, being able to examine the letters’ contents without irrevocably damaging them is a major advancement in the study of historic documents.
“Letterlocking was an everyday activity for centuries, across cultures, borders, and social classes,” explains Dambrogio. “It plays an integral role in the history of secrecy systems as the missing link between physical communications security techniques from the ancient world and modern digital cryptography. This research takes us right into the heart of a locked letter.”
Using computational tools, a research team was able to virtually unfold an unopened letter from 1697. Credit: Courtesy of MIT Libraries
This breakthrough technique was the result of an international and interdisciplinary collaboration between conservators, historians, engineers, imaging experts, and other scholars. “The power of collaboration is that we can combine our different interests and tools to solve bigger problems,” says Martin Demaine, artist-in-residence in MIT’s Department of Electrical Engineering and Computer Science (EECS) and a member of the research team.
The algorithm that makes the virtual unfolding possible was developed by Amanda Ghassaei SM ’17 and Holly Jackson, an undergraduate student in electrical engineering and computer science and a participant in MIT’s Undergraduate Research Opportunity Program (UROP), both working at the Center for Bits and Atoms. The virtual unfolding code is openly available on GitHub.
“When we got back the first scans of the letter packets, we were instantly hooked,” says Ghassaei. “Sealed letters are very intriguing objects, and these examples are particularly interesting because of the special attention paid to securing them shut.”
Secrets revealed
“We’re X-raying history,” says team member David Mills, X-ray microtomography facilities manager at Queen Mary University of London. Mills, together with Graham Davis, professor of 3D X-ray imaging at Queen Mary, used machines specially designed for use in dentistry to scan unopened “locked” letters from the 17th century. This resulted in high-resolution volumetric scans, produced by high-contrast time delay integration X-ray microtomography.
“Who would have thought that a scanner designed to look at teeth would take us so far?” says Davis.
Computational flattening algorithms were then applied to the scans of the letters. This has been done successfully before with scrolls, books, and documents with one or two folds. The intricate folding configurations of the “locked” letters, however, posed unique technical challenges.
Caption:Researchers were able to read the contents of a letter from Jacques Sennacques to his cousin Pierre Le Pers, a French merchant in The Hague. Credit: MIT
“The algorithm ends up doing an impressive job at separating the layers of paper, despite their extreme thinness and tiny gaps between them, sometimes less than the resolution of the scan,” says Erik Demaine, professor of computer science at MIT and an expert in computational origami. “We weren’t sure it would be possible.”
The team’s approach utilizes a fully 3D geometric analysis that requires no prior information about the number or types of folds or letters in a letter packet. The virtual unfolding generates 2D and 3D reconstructions of the letters in both folded and flat states, plus images of the letters’ writing surfaces and crease patterns.
“One of coolest technical contributions of the work is a technique that explores the folded and flattened representations of a letter simultaneously,” says Holly Jackson. “Our new technology enables conservators to preserve a letter’s internal engineering, while still giving historians insight into the lives of the senders and recipients.”
This virtual unfolding technique was used to reveal the contents of a letter dated July 31, 1697. It contains a request from Jacques Sennacques to his cousin Pierre Le Pers, a French merchant in The Hague, for a certified copy of a death notice of one Daniel Le Pers. The letter comes from the Brienne Collection, a European postmaster’s trunk preserving 300-year-old undelivered mail, which has provided a rare opportunity for researchers to study sealed locked letters.
“The trunk is a unique time capsule,” says David van der Linden, assistant professor in early modern history, Radboud University Nijmegen. “It preserves precious insights into the lives of thousands of people from all levels of society, including itinerant musicians, diplomats, and religious refugees. As historians, we regularly explore the lives of people who lived in the past, but to read an intimate story that has never seen the light of day — and never even reached its recipient — is truly extraordinary.”
Advancing a new field
In the Nature Communications article, the team also unveils the first systematization of letterlocking techniques. After studying 250,000 historical letters, they devised a chart of categories and formats that assigns letter examples a security score. Understanding these security techniques of historical correspondence means archival collections can be conserved in ways that protect small but important material details, such as slits, locks, and creases.
“Sometimes the past resists scrutiny,” explains Daniel Starza Smith. “We could simply have cut these letters open, but instead we took the time to study them for their hidden, secret, and inaccessible qualities. We’ve learned that letters can be a lot more revealing when they are left unopened.”
The research team hopes to make a study collection of letterlocking examples available to scholars and students from a range of disciplines. The virtual unfolding algorithm could also have broad applications: Because it can handle flat, curved, and sharply folded materials, it can be used on many types of historical texts, including letters, scrolls, and books.
“What we have achieved is more than simply opening the unopenable, and reading the unreadable,” says Nadine Akkerman, reader in early modern English literature at Leiden University. “We have shown how truly interdisciplinary work breaks down boundaries to investigate what neither humanities nor the sciences can hope to understand alone.”
Computational tools promise to accelerate research on letterlocking as well as reveal new historical evidence. Thanks to this research, adds Rebekah Ahrendt, associate professor of musicology at Utrecht University, “we can now imagine new affective histories that physically connect the past and the present, the human and the nonhuman, the tangible and the digital.”
For more on this research, read Secrets of Unopened Letter From Renaissance Europe Revealed – Without Breaking Its Seal or Damaging It.
The research team includes Jana Dambrogio, Thomas F. Peterson Conservator, MIT Libraries; Amanda Ghassaei, research engineer at Adobe Research; Daniel Starza Smith, lecturer in early modern English literature at King’s College London; Holly Jackson, undergraduate student at MIT; Erik Demaine, professor in EECS; Martin Demaine, robotics engineer in CSAIL and Angelika and Barton Weller Artist-in-Residence in EECS; Graham Davis and David Mills, Queen Mary University of London’s Institute of Dentistry; Rebekah Ahrendt, associate professor of musicology at Utrecht University; Nadine Akkerman, reader in early modern English literature at Leiden University; and David van der Linden, assistant professor in early modern history at Radboud University Nijmegen.
This research was supported in part by grants from the Seaver Foundation, the Delmas Foundation, the British Academy, and the Nederlandse Organisatie voor Wetenschappelijk Onderzoek.
Reference: “Unlocking history through automated virtual unfolding of sealed documents imaged by X-ray microtomography” by Jana Dambrogio, Amanda Ghassaei, Daniel Starza Smith, Holly Jackson, Martin L. Demaine, Graham Davis, David Mills, Rebekah Ahrendt, Nadine Akkerman, David van der Linden and Erik D. Demaine, 2 March 2021, Nature Communications.DOI: 10.1038/s41467-021-21326-w