Pamyat Naroda indexes. 3,400,000+ records processed

Discussions on archives and similar issues. Hosted by Jeff Leach.
Mori
Member
Posts: 1632
Joined: 25 Oct 2014, 12:04
Location: Europe

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#61

Post by Mori » 03 Apr 2019, 09:54

fisenfender wrote:
02 Apr 2019, 23:58
Pamyat Naroda is a unique site. I do not think that there are similar websites in the world with so many documents.
The Canadian site is even better. Also with a impressive mass of documents, not only Canadian proper but also everything they got cc-ed of from Americans and British.

Mori
Member
Posts: 1632
Joined: 25 Oct 2014, 12:04
Location: Europe

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#62

Post by Mori » 03 Apr 2019, 09:56

fisenfender wrote:
02 Apr 2019, 23:58
But the site at any time may cease to exist and close, despite the financing of the state. There are a lot of things held up by enthusiasm.(...)
There are several cases downloaded from there, so if anyone needs or is interested, write me.
I believe several people already "scrapped" the site, ie made a systematic download of everything there is.

Is your proposal commercial?


User avatar
Jeff Leach
Host - Archive section
Posts: 1433
Joined: 19 Jan 2010, 10:08
Location: Stockholm, Sweden

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#63

Post by Jeff Leach » 04 Apr 2019, 08:35

Mori wrote:
03 Apr 2019, 09:56
fisenfender wrote:
02 Apr 2019, 23:58
But the site at any time may cease to exist and close, despite the financing of the state. There are a lot of things held up by enthusiasm.(...)
There are several cases downloaded from there, so if anyone needs or is interested, write me.
I believe several people already "scrapped" the site, ie made a systematic download of everything there is.
I doubt that there are 'complete' copies in private hands. They might be 80-90% complete. New material is being added all the time and without a release schedual, you would need to scan the site regularly. If they are using dynamic links, then you would need to compare the actual files instead of the link addresses. Someone, I know was trying to download all the files and they had around 25 TB of material.

My greatest worry, is that the site will close unexpectedly. I try and keep an updated catalogue of the files I need for my research but it is still a pain just checking on the 10 - 20,000 pages of documents that interest me.

User avatar
AMVAS
Member
Posts: 550
Joined: 02 Aug 2004, 14:58
Location: Moscow
Contact:

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#64

Post by AMVAS » 04 Apr 2019, 19:41

I doubt that there are 'complete' copies in private hands. They might be 80-90% complete.
Even less. About 50% of operative records cost me 28 Tb. Hardly too much personalities have similar HDD capacities.
New material is being added all the time and without a release schedual, you would need to scan the site regularly.
It's enough to scan annually. No need to do this every month.
The problem is they have changed their search engine and one need to make a special research to learn how to get access to it.
If they are using dynamic links, then you would need to compare the actual files instead of the link addresses. Someone, I know was trying to download all the files and they had around 25 TB of material.
Probably it was me ))
My greatest worry, is that the site will close unexpectedly. I try and keep an updated catalogue of the files I need for my research but it is still a pain just checking on the 10 - 20,000 pages of documents that interest me.
Moreover they quite often delete some files from access without any informatiopm about this.

Mihai Pica
Member
Posts: 59
Joined: 21 Apr 2017, 13:25
Location: Bucharest, Romania

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#65

Post by Mihai Pica » 16 Dec 2020, 10:15

Sorry for the bump, does anyone know if there is any way to check only for the newer files ( if any ? )

User avatar
AMVAS
Member
Posts: 550
Joined: 02 Aug 2004, 14:58
Location: Moscow
Contact:

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#66

Post by AMVAS » 16 Dec 2020, 11:00

Mihai Pica wrote:
16 Dec 2020, 10:15
Sorry for the bump, does anyone know if there is any way to check only for the newer files ( if any ? )
This is one of the main puzzles for this site :D

Mihai Pica
Member
Posts: 59
Joined: 21 Apr 2017, 13:25
Location: Bucharest, Romania

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#67

Post by Mihai Pica » 16 Dec 2020, 12:52

Well..what can I say..will keep playing the game :D

User avatar
AMVAS
Member
Posts: 550
Joined: 02 Aug 2004, 14:58
Location: Moscow
Contact:

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#68

Post by AMVAS » 16 Dec 2020, 14:29

Mihai Pica wrote:
16 Dec 2020, 12:52
Well..what can I say..will keep playing the game :D
I tried to index their records. But that %^$$% made dynamic address for search engine! I never met such a level of paranoia :D So I have only index for 2016 year

User avatar
Der Alte Fritz
Member
Posts: 2171
Joined: 13 Dec 2007, 22:43
Location: Kent United Kingdom
Contact:

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#69

Post by Der Alte Fritz » 18 Dec 2020, 08:14

Site recently lost the download button and image files can be downloaded directly from screen with a left click of mouse button so an index scan is now possible.

User avatar
AMVAS
Member
Posts: 550
Joined: 02 Aug 2004, 14:58
Location: Moscow
Contact:

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#70

Post by AMVAS » 18 Dec 2020, 10:59

Der Alte Fritz wrote:
18 Dec 2020, 08:14
Site recently lost the download button and image files can be downloaded directly from screen with a left click of mouse button so an index scan is now possible.
before loadings they must be found first.

Lefty2000
Member
Posts: 4
Joined: 25 Mar 2015, 16:10
Location: Moscow

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#71

Post by Lefty2000 » 29 Dec 2020, 08:22

Mihai Pica wrote:
16 Dec 2020, 10:15
Sorry for the bump, does anyone know if there is any way to check only for the newer files ( if any ? )
Newer files have higher IDs. I've recently updated indexes, you can download it here.

You can also sort by ID on https://vnr.github.io/pamyat-naroda-search/ (unfortunately that site might stop functioning at any time if pamyat-naroda changes the algorithm to access its database once again).

Mihai Pica
Member
Posts: 59
Joined: 21 Apr 2017, 13:25
Location: Bucharest, Romania

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#72

Post by Mihai Pica » 29 Dec 2020, 10:47

Lefty2000 wrote:
29 Dec 2020, 08:22

Newer files have higher IDs. I've recently updated indexes, you can download it here.

You can also sort by ID on https://vnr.github.io/pamyat-naroda-search/ (unfortunately that site might stop functioning at any time if pamyat-naroda changes the algorithm to access its database once again).
Lefty thanks so much ! This seems super useful, will try right away !

PS: I seem to find very few aviation units, are these excluded from you search engine ?

Lefty2000
Member
Posts: 4
Joined: 25 Mar 2015, 16:10
Location: Moscow

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#73

Post by Lefty2000 » 29 Dec 2020, 19:06

Mihai Pica wrote:
29 Dec 2020, 10:47
PS: I seem to find very few aviation units, are these excluded from you search engine ?
Are you sure that some aviation units documents exist on https://pamyat-naroda.ru/documents/ but missed on github? Could you provide me with an example?

Mihai Pica
Member
Posts: 59
Joined: 21 Apr 2017, 13:25
Location: Bucharest, Romania

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#74

Post by Mihai Pica » 30 Dec 2020, 12:29

You are right, everything is in order, my bad russian skills are to blame, some documents come up when I search for the "Military Unit", but forgot about those where the unit is in the "Document Author" field.

Thanks !

bugor76
Member
Posts: 24
Joined: 10 Nov 2020, 17:20
Location: Ukraine

Re: Pamyat Naroda indexes. 3,400,000+ records processed

#75

Post by bugor76 » 21 Nov 2021, 05:51

Hello everyone! Maybe someone will come in handy. I would like to share a link to the site where the numbers of the funds of units and formations of the Red Army are indicated in the form of a table. http://www.teatrskazka.com/Raznoe/Fondy ... aroda.html
Good luck!

Post Reply

Return to “Archives”