Showing posts with label NSA. Show all posts
Showing posts with label NSA. Show all posts

Sunday, May 31, 2020

My experience with the US FOIA program

Since I no longer have any active cases I think it’s time to write a summary of my experience with the US freedom of information act program.

The good:

1). Everyone can request files using the FOIA program. This is really useful for those of us that are non-US citizens.

2). The agencies involved respond in a professional manner, assign case numbers, send letters detailing the progress of the case etc.

3). The FOIA departments that I had contact with responded quickly to emails.

Overall, from 2012 till 2018 I received 1 file from the CIA FOIA department, 1 file from the US national archives FOIA department and 20 files from the NSA FOIA department.

Total page count for this material was about ~1.300. So, I’m satisfied with the material I received.

The bad

1). The main problem was that my cases took too long to be processed. Files that had been previously declassified were sent to me quickly, however new cases that required review of the documents took years to complete.

Most of the files that I received from the NSA were requested in early 2012 and released in the second half of 2017.

2). For several of my cases the NSA FOIA department’s response was that the relevant files had been sent to the US national archives (NARA) and that I should request them from them instead. However, the document transfer numbers they gave me were in all cases incorrect.

In fact, it was the opinion of the NARA FOIA staff that the NSA was purposefully misleading me. I do not believe that to be true, instead I believe that they simply do not always know what kind of material they are sending to NARA.

The ugly

For whatever reason some of the people at the US national archives FOIA department were rude and/or passive aggressive. I did not let that interfere with my research till 2018 when I finally had enough and I cancelled my remaining two cases.

Conclusion

In conclusion I’d like to say that I am grateful for the existence of the FOIA program since I received many interesting files that contained valuable information.

Ideally, I would have liked to receive this material years in advance but c'est la vie…

Having said that, if I had to use the FOIA program again today I wouldn’t do it due to the great delay in the processing of the cases and the NSA FOIA department’s strategy of ‘reviewing’ a case for years and then informing me that the file has been sent to NARA and giving me incorrect transfer numbers.

If you are a US citizen it’s best to use the mandatory declassification review program. If you (like me) are not a US citizen, then there are simply no good choices…

Thursday, May 28, 2020

Cancellation of my FOIA cases

My two remaining FOIA cases were filed in 2015 and 2018. I decided to cancel both of them because so much time has passed that this material is no longer of use to me.

Tuesday, July 16, 2019

Cryptologic history Symposium 2019

The program for the NSA’s Cryptologic history Symposium has been posted.

There seem to be some interesting presentations about WWII and the Cold war period. For example:

Dr. George Lasry Modern Codebreaking of Siemens and Halske T52

Mr. Jock Bruce What Happened Next? British Army Sigint, 1919-1939

Mr. Tony Comer GCHQ Centenary History

Dr. John Ferris GCHQ during the Cold War

Mr. Richard R. Lonergan Re-Evaluating the Cryptological Dividends of the Battle of Nomohan at 80: The Impact of Soviet Breakthroughs into Japanese Code and Cipher Systems

Dr. Francis Jordan-Rozwadowski What the Metadata Say: A Study of OKW/Chi Decrypts of Polish Intelligence Traffic

Dr. David Kenyon How Fishy was ULTRA? – The Role of Encrypted Teleprinter Traffic in the Intelligence for Operation OVERLORD

Mr. Marty Busse COMSEC Lietuvos Partizanų

Dr. Paul A. Thomsen Terminating the Signal: How SIGINT Turned the Tide against Axis Submarine Predation in World War II

Mr. Robert J. Hanyok Answering the Age-Old Commander’s Question: What the Hell is Going on out There? – The U.S. Army’s Signal Information and Monitoring Units and the
Phantom Service

I hope that they decide to publish their proceedings online, like Histocrypt did.

Wednesday, February 27, 2019

The missing NAAst 5 reports

Although I’ve given up on getting these files (for reasons that have already been mentioned) I will post this information in the hope that someone else will succeed.

At the US national archives, in the NSA transfer group TR-0457-2016-0017, box 45, folder 3953 there is a file titled ‘KOMMANDEUR DER NACHRICHTEN AUFKLARUNG 5, 1944 (S-013,494)’.

It is possible that this file contains the missing NAASt5 reports. Maybe someone can get hold of this file and solve the mystery.  

Saturday, October 13, 2018

Entry 9032 finding aid

I have uploaded the finding aid to US National Archives - collection RG 457 (Records of the National Security Agency) - entry 9032.

Note that this is not the only entry in collection RG 457.

Monday, February 19, 2018

Candle in the Dark: COMINT and Soviet Industrial Secrets, 1946-1956

The study ‘Candle in the Dark: COMINT and Soviet Industrial Secrets, 1946-1956’ by Carol B. Davis is available for download from the NSA website.

This version (unlike the copy at the Cryptologic Museum’s Library) is complete!

Wednesday, January 24, 2018

Army Security Agency operations in Early Cold War Germany

The interesting article ‘The U.S. Army Security Agency in Early Cold War Germany’ is available in the latest issue of Army History Magazine.

Sunday, November 26, 2017

Progress of my FOIA cases

So far in 2017 my following NSA FOIA cases have been processed:

1). TICOM report DF-229 ‘Three reports on the work of OKW/Chi’:


2). Request for any postwar interrogation reports on Georg Schroeder, head of the Forschungsamt’s cryptanalysis department:

I received a reference to files transferred to NARA in 2016. The NARA research department checked the reference and they could not locate any file on Schroeder.

3). Special Research History SRH-361 ‘History of the Signal Security Agency Volume Two: The General Cryptanalytic Problems’:


4). Request for two Japanese TICOM reports – ‘Report on Saburo Nomura’ and ‘Interrogation of mr Hayashi’:

I copied the first one from NARA. The second has also been sent to NARA but the reference points to 36 boxes that have not been indexed, so the file could not be located by my researcher. 

5). TICOM report I-170 ‘Report on French and Greek Systems by Oberwachtmeister Dr. Otto Karl Winkler of OKH/FNAST 4’:


6). TICOM report I-40:

I requested this file in 2015 and now it has been placed in the review queue.

7). Request for TICOM report DF-196 ‘Report on Russian decryption in the former German Army’ and TICOM document 2765 ‘Die Entwicklung des russ. Geheimschriftenwesens’:

DF-196 has been placed in the review queue. TICOM document 2765 cannot be located. 

However pages 31-37 of that report are available as TICOM DF-94 ‘The development of Russian cryptographic systems’.

8). Reports ‘E-Bericht der NAAst 5’ for second half 1944:


9). Report ‘Polish cipher systems - January 1945’ (S-007.253):

The NSA FOIA office gave me a reference which the NARA research department checked without success.

10). TICOM reports I-26, I-31, I-84, I-116, I-118, I-120, I-137, I-160, I-176, I-181:


11). TICOM report DF-240 ‘Characteristics, analysis and security of cryptographic systems’ and DF-241 ‘The Forschungsamt’:


12). Carlson-Goldsberry report:

It is still in the review queue.

Overall it’s been a very good year so far as I’ve received a lot of material. Let’s hope the rest of the reports are released soon.

Thursday, July 13, 2017

Working on the Dark Side of the Moon: Life Inside the National Security Agency

A new book on the NSA has been published recently. The book in question is ‘Working on the Dark Side of the Moon: Life Inside the National Security Agency’ by Thomas Reed Willemain.


Maitland, FL (May 19, 2017) –Working on the Dark Side of the Moon provides the first, ground-level look inside the super-secret National Security Agency (NSA) and a shadowy think tank affiliated with it. The author, a software entrepreneur and statistics professor, volunteered for a year-long sabbatical tour of duty in the NSA. He ended up spending several years moving between the business and academic worlds and the secret world. This book records his impressions of people and places never before described in such intimate detail.

A deeply personal account of the years spent within the most secretive organization in the world, Working on the Dark Side of the Moon explores the range of emotions an outsider experiences while crossing over to the “inside.” It also shows the positive side of an Agency whose secrecy hides dedicated men and women devoted to protecting the country while honoring the Constitution.

Willemain writes, "The very secrecy that enables NSA to be effective also cripples its ability to explain its positive contributions. Into this void are projected grossly distorted views of what NSA does and what NSA people are like. This book puts a human face on the people who work in this secret world: their character, motivations, frustrations, sense of humor. Readers can develop a more balanced and nuanced view of NSA and its people."

About the Author

Dr. Thomas Reed Willemain served as an Expert Statistical Consultant to the National Security Agency (NSA) at Ft. Meade, MD and as a member of the Adjunct Research Staff at an affiliated think-tank, the Institute for Defense Analyses Center for Computing Sciences (IDA/CCS). He is Professor Emeritus of Industrial and Systems Engineering at Rensselaer Polytechnic Institute, having previously held faculty positions at Harvard’s Kennedy School of Government and Massachusetts Institute of Technology. He is also co-founder and Senior Vice President/Research at Smart Software, Inc. He is a member of the Association of Former Intelligence Officers, the Military Operations Research Society, the American Statistical Association, and several other professional organizations. Willemain received the BSE degree (summa cum laude, Phi Beta Kappa) from Princeton University and the MS and PhD degrees from Massachusetts Institute of Technology.

His other books include: Statistical Methods for Planners, Emergency Medical Systems Analysis (with R. C. Larson), and 80 articles in peer-reviewed journals on topics in statistics, operations research, health care and other topics.

Q&A with Thomas Reed Willemain

The author was kind enough to answer some of my questions.

1). Can you give an overview of your career prior to working for the NSA?

I’ve had overlapping careers:  About 40 years as an academic, and about 30 years as a software entrepreneur. I have been a professor at Massachusetts Institute of Technology, Harvard Kennedy School of Government, and Rensselaer Polytechnic Institute. I am now Professor Emeritus of Industrial and Systems Engineering at RPI. I am also co-founder and Senior Vice President/Research at Smart Software, Inc. in Boston. A common thread has been the study of statistics, forecasting -- anything involving randomness.

2). How/why did you consider working for the NSA?

I was looking for a challenging and useful sabbatical leave. I’d previously spent a sabbatical leave at the Federal Aviation Administration and made some contributions there, even though I’d not had any formal background in aviation. I was wary of applying to NSA, since I was not in synch with the Bush administration. But I wanted another period of public service. I also knew that there would be no more intriguing place for a statistician to work. And I suspected, correctly, that when I came back to RPI I would have more to contribute to my students. That turned out to be correct, in that my courses were richer (and more computational) afterwards.

3). What did you expect working at the NSA would be like and were your expectations accurate or not?

I was very wrong about some things. One was politics, or the lack thereof. I mentioned my misgivings about President Bush. The woman who handled the sabbatical program was very diplomatic and not put off by my questions. When I finally met her in person, it turned out that she was a lesbian with an “Anybody but Bush” bumper sticker on her car – not at all fitting my stereotype of an NSA person. During the McCain-Obama election campaign, the bumper stickers in the vast parking lots were about 50:50, and there was no whiff of politics inside the wire. The only person who talked (incessantly) about the election was somebody from another country embedded with us. I did expect a high level of expertise, and that was definitely true.

Something I should have expected but did not was how radically different the culture was from my university life. I was going back and forth between “inside” and “outside”. The academic culture encourages the question “Hey, what are you working on?” I had to learn to not ask that question on the inside unless it was behind a locked door, and not always then.

Now, the NSA is a big place. And one of the people described in my book pointed out that I was in the Research Directorate, which is more like a playground for uber-geeks than most of the rest of the Agency, where a mix of civilians and service members grind out massive amounts of work every day. So my book must present a partial picture of “Life inside the National Security Agency”. I may have been the proverbial blind man feeling the best part of the proverbial elephant.

4). Why did you decide to write a book about your experiences working for the NSA and was it difficult to gain approval from the agency?

I’ll be 70 years old soon, and I found myself slowing down on the math side of things, so I looked for another way to contribute. I had a plan to begin substituting my words for my equations, and writing the book would be a good way to test the feasibility of that plan. But I was also motivated by a desire to continue serving as best I could. Most every depiction of NSA in the media has been negative, and distorted stereotypes about the people and the Agency are rampant. I wanted to offset that with an insider’s look at the reality. The Snowden affair in particular prompted me to try to offset that. It turned out that, without knowing what I was contributing to, some of my technical work helped the Agency offset some of the damage Snowden did. The book let me do more on that front.

Getting the book cleared through NSA’s pre-publication review was a slow-motion crucifixion. It delayed the book by five months and blacked out about 15% of the book. There was some lying and bullying involved. Call it a character-building moment. I wrote about the process in the LawFare blog and discussed it with the House Permanent Select Committee on Intelligence, who were already reviewing the pre-pub process. The basic problem is that the process knows only one word: “No”. I tried to get the strategic communications people involved so there would be someone to say “Yes” to the idea of permitting a pro-Agency book to be published, but so far no luck. The Agency claimed, with perhaps dubious legality, that anybody described in my book, though anonymously, could require me to remove them from the book. If they had all done so, there would have been no book. But only one insisted that she be removed. She is now a large black rectangle.

5). What new information is available from your book compared to previous studies of the NSA?

I’m fairly certain that this is the only grunt-level memoir of service in the NSA. There are a few faux-memoirs that are works of fiction. Folks at the top levels have written books (e.g., Michael Hayden), but daily life below the top has been, well, rather like the dark side of the moon. There have been policy-oriented and history-oriented books about NSA, but not people-oriented books. So what it feels like to work there has been mysterious. Much of my book is centered on descriptions of about 40 people that I worked with, and the book is about their stories as much as mine. I also paid a lot of attention to comparing life inside against life outside, especially regarding the intellectual and administrative climates (including personnel evaluation systems). There are not many “insider/outsider” stories to tell, and mine is the only one in print.

Actually, part way through my time inside, several of us academics were “traded” to NSA-affiliated think tanks. So my book is also the first to expose the inner workings of the Institute for Defense Analyses Center for Computing Sciences. That must be the world’s most comfortable SCIF, and it’s full of sharp, colorful characters. I think the director of IDA/CCS was even more opposed to publication of my book than the NSA itself, even though my book might be very helpful to recruiting people to take my place there.

6). What is your opinion on the recent Snowden revelations regarding the NSA interception of US civilian communications?

I have mixed feeling about Snowden, mostly negative. Perhaps some of his motivation was idealistic. But what he did was very damaging to the tracking of foreign targets, so he definitely belongs in jail. He also appears to be a narcissistic liar. He permitted a persona to be presented in the movie “Snowden” that was just not true. As I watched the movie, I kept thinking “That’s not true. And that’s not true. And that doesn’t really happen.” For instance, I write about my struggles to pass the repeated exams I had to take to certify that I knew about the practical implementation of the Fourth Amendment prohibitions as applied to foreign intelligence. The public should know how seriously the Agency regards those things. It is certain that something as powerful as the NSA bears constant watching, but facts ought to be the basis for judgment.

Thursday, May 18, 2017

The progress of my old NSA freedom of information act cases or alternatively ήμουν νιος και γέρασα…

So far my remaining cases with the NSA FOIA office can be broken into two groups. One concerns requests I made in 2015 and these seem to be progressing slowly but I expect I will get responses this year.

The problem is that my old cases from 2012 seem to be stuck in time. Back then I requested several TICOM reports and even agreed to pay for two large files (~500 pages).

Since then I’ve been told that these cases are being processed, then they were in the review queue, then final review etc.

Picture of NSA foia requester waiting for the declassification of TICOM reports:


Thursday, September 1, 2016

What happened to my FOIA requests? Progress report

When I started researching WWII cryptologic history I not only copied stuff from the archives but I also requested a lot of material from the NSA’s FOIA office.

Although I have received some interesting reports from them (I-172, I-89, DF-111, DF-105, DF-176, DF-169) they are still reviewing a lot of the TICOM files that I’ve requested. Why do they need to ‘review’ material from the 1940’s? I don’t know.,,

So what’s the progress of these cases?

Let’s see, so far in 2016 i have received information on the following cases:

State Department M-138-A instructions

The M-138-A strip cipher system was used by the State Department during WWII for enciphering messages classified SECRET. The 1944 instructions can be found at NARA but the previous editions from 1939 and 1942 are not there (or at least I haven’t been able to find them).

The NSA FOIA office stated that ‘a thorough search of our archival files was conducted but no records responsive to your requests were located’.

However the 1939 instructions can be found in TICOM report DF-15 so that’s not a complete loss.

Note that the 1939 instructions describe the straight board system (30 letters taken from one cipher column) while the 1944 instructions state that channel elimination is to be used for each message.

Dr Wilhelm Vauck, head of Referat 12 (Agents section)

In 1942 the German Army’s codebreaking agency OKH/Inspectorate 7/VI created a new department tasked with the solution of enemy agents codes. This was Referat 12 (Department 12), headed by the mathematician dr Wilhelm Vauck. According to the short bio of dr Vauck found at the website of Dresden University he survived the war and was a POW for the years 1945-48.

I thought that in that period he would have been interrogated by the Allies about his wartime activities so I requested information from the NSA. The recent response was ‘a thorough search of our historical files was conducted but no records responsive to your request were located’.

Still it is possible that other agencies might have some information on Vauck. We’ll see…

Dr Herbert Lotze, head of Wa Pruef 7/IV/E

Dr Lotze was head of research on speech privacy systems at the German Army’s Ordnance, Development and Testing Group, Signal Branch Group IVe. His team solved the US Bell Labs A-3 speech scrambler and similar Soviet devices.

The response of the NSA to my request for any postwar interrogations of dr Lotze was ‘a thorough search of our historical files was conducted but no records responsive to your request were located’.

However there seems to be material on Lotze at NARA so this isn’t the end of this case.

Other cases

During the year I was able to copy from NARA some of the reports that I had requested from the FOIA office years ago. This is material that was given to NARA in 2015.

Apart from these cases there are about a dozen TICOM reports that are being reviewed by the FOIA office. Let’s hope that they are released soon.