NARA rolls made digital

[Tom Peters]

Im just coming into this thread now, but from what I gather, most of the digitized material has to be downloaded 1 frame at a time ? I can always automate the process, but I would imagine most people prefer a download of the entire roll with a single click.

Mad Dog

T77 and T178 - no PDFs
T84, T354, T501 - can be downloaded as 1-2 PDFs per reel

Im in T84, but I cant find a way to get a PDF....is this just part of T84 that has this?

thanks,

Mad Dog

Look under the image display and strip display to see 'documents' and click on the PDF icon. This then creates a download icon just below the main image, while the main image starts loading like a PDF browser, either can be used to start the download. Sometimes clicking to download opens the file up in a new window, sometimes it just starts downloading.
https://catalog.archives.gov/id/254675062

Thanks !

Mad Dog

[Polizei51]

Can one of you guys post a direct link to T-354 and to T-77 at Nara.
Many thanks in advance.

Peter Hert

[nickterry]

Some real momentum with digitising RG 242 over at NARA; they have added T77 OKW
https://catalog.archives.gov/search?q=* ... Sort%20asc

There are 1908 'hits' within T77, versus 1687 reels, so with split reels the collection does not look 100% finished, however searches for keywords for several staffs under the OKW umbrella, like Wirtschaftsstab and Abwehr, got 600+ hits, so many runs of reels are evidently complete.

Also... T354!
https://catalog.archives.gov/search?q=* ... Sort%20asc
799 reels vs 1147 hits within T354, again split reels

This is only a few weeks after T84 was uploaded, so the uploading of digitised microfilms has snowballed considerably. Even if T77 and T354 aren't complete, NARA added over 3,000 half-reels and full reels in just this one upload.

For Polizei51

I maintain an index of links to online archives and sources with US archives and thus NARA first, and Germany and thus the Bundesarchiv close to the top. Despite the URL title, the list is increasingly WWII/Third Reich as well.
http://holocaustcontroversies.blogspot. ... s-and.html

[UlrichH]

Hello

@nickterry

you made my day, many thanks for the two links. I can now complete my missing rolls.

[UlrichH]

Hello

For those who are interested in loading one or the other reel in its original state, here is a little how to
this is applicable to T501, T84,T77 and T354, possibly also for all following series.


Press the Windows key and R
enter CMD in the line
first command: cd \
2: cd windows/temp
3.md T77R1093
4. cd T77R1093
5: curl -O -J https://s3.amazonaws.com/NARAprodstorag ... /T77-1093-[0001-1067].jpg
6. Send with return key7. leave the command window to run until the end, until it indicates a folder extension.
8. Go to the folder extension (C/Users/yourname/folder title) to check it
9. close the command window
10. you can now move the folder wherever you like.


applies to T77:

in the curl command the images from 0001-end according to the catalogue

One command line per roll

T354

Rolls with up to 1300 files, one command Line.
No letter A or B necessarynecessary

curl -O -J https://s3.amazonaws.com/NARAprodstorag ... /T354-153-[0001-1261].jpg

T354
Roles with more than 1300 files, two commands are necessary.
To be recognised in the catalogue by Part 1 and Part 2

command are then as follows:

curl -O -J https://s3.amazonaws.com/NARAprodstorag ... /T354-157-[0001-1000].jpg

curl -O -J https://s3.amazonaws.com/NARAprodstorag ... /T354-157-[1001-1313].jpg

[nickterry]

Thank you very much for this, Uli, and for talking me through this just now before publicising it.

The procedure works - times vary, it can be up to 20 minutes on some occasions, others seem faster - but it works.

Hopefully there are not so many of us doing the multi-file downloads that either NARA or the Amazon Cloud react, but they damn well should have made those T77 reels available as PDFs....

The destination folder can be titled however you like - I have now tried T77R1093 and T771094 with equal success.

Some reels will allow individual file downloads whereas others pop up a new window for an individual jpg - having one of those to hand is helpful to set up the [0001-1475].jpg part, e.g. this one - you can alter the reel number and insert the frame range quite easily with something like this open in another tab.
https://s3.amazonaws.com/NARAprodstorag ... 2-0434.jpg

[UlrichH]

Hello Nick

Thank you for your support for the howto

If you look at the series that have been released so far, we are talking about several TB, T501 alone is 1.8TB.
With the other series, we're well over 6TB, so it's only worth downloading specifically to advance your research.
I've thought about it, I'll download one or two reels, but not everything. It blows up the local storage space as well as that of the server.

[nickterry]

It's much appreciated that you walked me through the steps.

The NARA uploads are here to stay, so one can use them as a library and download as needed. But the reels are coming in at only 2-3 GB, so one can cast a wider net if exploring a thematic topic. The NARA catalog search engine uses OCR so pinpoints reels and files with specific keywords, which will become an increasingly powerful research tool the more that is uploaded.

[Mori]

Hello

For those who are interested in loading one or the other reel in its original state, here is a little how to
this is applicable to T501, T84,T77 and T354, possibly also for all following series.

Even easier is to use DownThemAll!, the famous firefox add-on. It's designed for such site.

[UlrichH]

Hello Mori

i know this tool. maybe i'm making a mistake, but it only loads me the thumbnails. How about a howto to load the complete images. Besides, I don't save the rolls locally, but on a separate linux server without clicki interface, so there is only the cli to download via curl.

[Mori]

Short tutorial for DownThemAll!
Image URL is accessible through right-click on "download full size image":
(note: I add a space after http:// to display the URL in full, remove it if you copy/paste)
https:// catalog.archives.gov/catalogmedia/lz/dc-metro/rg-242/7820260/T77/T77-0001/T77-0001-0001.jpg

Go to "Manager" of DtA!
Click on the blue cross ("Add download")
Paste the URL
Make it a range thanks to edits in bold:
https:// catalog.archives.gov/catalogmedia/lz/dc-metro/rg-242/7820260/T77/T77-0001/T77-0001-[0001:1500].jpg

Press Enter twice, and download starts.

***

Since the syntax is consistent across the rolls, you can move to the next roll by changing a couple of underlined digits:

https:// catalog.archives.gov/catalogmedia/lz/dc-metro/rg-242/7820260/T77/T77-0002/T77-0002-[0001:1500].jpg

The occasional rolls with more than 1,500 frames require to copy/paste another URL.

[rustyle_nvrsk]

Hello!
Can anybody help with:
T315 R1066 - 73 I.D.
and T315 R518 - 9 I.D.?

[copiloto]

Hello, it would be great if NARA upload the A3356 series.

Regards

[nickterry]

NARA's digitisation has forged ahead even faster than I expected. I did some keyword searches across the whole catalog on Friday with no changes, today, the hits grew and they have added, on the weekend no less:

T311 army groups - 305 reels, divided into 344 reels and part-reels, sampling reel 1 these have PDF downloads
https://catalog.archives.gov/search?q=* ... Sort%20asc

T175 Reichsfuehrer-SS, RSHA and other SS records - 678 reels, divided into 923 reels and part-reels - sampling reel 1, these do not have PDF downloads,
https://catalog.archives.gov/search?q=* ... Sort%20asc

My sample search for 'Heeresgruppe' went from 1840 to 2393 hits within RG 242.

This makes 7 series uploaded so far, out of 38 originally microfilmed in Alexandria, VA, thus not counting BDC, Navy, Foreign Office series. (Technically, one BDC series has been uploaded as well, name lists of denaturalized German Jews.)

It seems likely further series will be uploaded imminently, within days, weeks and months, so this will be like Christmas coming early for many researchers.

I have updated my index of online archives so there is a handy one-stop shop for links to the individual series (and yes, I need to add T178...)
http://holocaustcontroversies.blogspot. ... s-and.html

[Mori]

T311 army groups - 305 reels, divided into 344 reels and part-reels, sampling reel 1 these have PDF downloads
https://catalog.archives.gov/search?q=* ... Sort%20asc

Just great!

And somewhat perfect coordination with BAMA, where RH19 Heeresgruppen is just being added online these months