{"id":32670,"date":"2019-10-31T21:48:18","date_gmt":"2019-10-31T18:48:18","guid":{"rendered":"https:\/\/prohoster.info\/blog\/hranenie-rezervnoe-kopirovanie-i-katalogizatsiya-fotografij\/"},"modified":"2019-10-31T21:48:18","modified_gmt":"2019-10-31T18:48:18","slug":"hranenie-rezervnoe-kopirovanie-i-katalogizatsiya-fotografij","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/hranenie-rezervnoe-kopirovanie-i-katalogizatsiya-fotografij","title":{"rendered":"Storage, Backup, and Cataloging of Photos","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

Here, people often write posts about how they store and back up their photos \u2014 as well as just files. In the last such post, I wrote a fairly long comment, did some thinking, and decided to expand it into a post. Moreover, I have changed my backup method to the cloud a bit; it might be useful for someone.<\/p>\n

Home server<\/a>, where much of what is described below happens:<\/p>\n

\"Storage,
\n<\/p>\n

What needs to be saved?<\/h3>\n

\nThe most important and voluminous for me are the photos. Occasionally videos, but very rarely \u2014 they take up too much space and time, so I don\u2019t like them much. I only shoot short clips that pile up in the same heap as the photos. Currently, my photo archive takes up about 1.6 terabytes and grows by around 200 gigabytes a year. Other important items are much less bulky, and there are fewer questions regarding their storage and backup. A dozen or two gigabytes can be spread across numerous free or very cheap spaces, from DVDs to flash drives and clouds.
\n<\/a><\/noindex><\/p>\n

How is it stored and backed up?<\/h3>\n

\nMy entire photo archive currently occupies about 1.6 terabytes. The master copy is stored on a two-terabyte SSD in my home computer. I try not to keep photos on memory cards longer than necessary and transfer them to my desktop or laptop as soon as possible (when on the go). However, I don't delete them from the flash drive if there's still space. An extra copy never hurts. Once home, everything from the laptop is also transferred to the desktop.<\/p>\n

\"Storage,
\n
\nA copy of the photo folder is made daily on my home server (with a type of mirror based on Drivepool, where important folders are set up for duplication). By the way, I still recommend Drivepool \u2014 in all the years of use, I\u2019ve had no glitches. It just works. You just shouldn\u2019t pay attention to its Russian interface; I sent the developers a more decent translation, but I don\u2019t know when they\u2019ll implement it. Meanwhile, in Russian, this program is for managing a pool.<\/p>\n

\"Storage,
\n
\nOf course, copies can be made more often. If a lot of work is done in a day, I can manually trigger a backup task. Although now, I\u2019m considering starting to run backups based on file changes; I want to stop keeping the desktop running 24\/7 and let the server do more work. The program is GoodSync.<\/p>\n

\"Storage,
\n
\nUntil recently, files were uploaded to the OneDrive cloud from the same desktop using GoodSync. Most of the files are not personal, so I uploaded them as is, without encryption. The personal files were uploaded separately, with encryption. <\/p>\n

OneDrive was chosen because the Office 365 Home Premium subscription for 2000 a year offered five (now six) terabytes in the cloud. Even if in chunks of one terabyte. Now, unfortunately, the deal has become a bit more expensive, but a few weeks ago there were still options for 2600-2700 a year (must check with retailers). I anticipated this when MS raised prices last year and even stopped selling subscriptions on their website, so I activated a five-year subscription in advance while there were still boxes available for 1800-2000 (I could have taken a few boxes for backup, but I didn't dare plan that far ahead).<\/p>\n

\"Storage,
\n
\nThe upload speed is maximum for my plan, 4-5 megabytes\/sec., at night up to 10. I once looked at CrashPlan \u2014 it was good if it was loading at a megabyte per second.<\/p>\n

Lifetime 5TB for 2-3$ from eBay is a very random thing. The lifespan can turn out to be very short; three months is the record so far. It\u2019s not a good idea to back up to a place that could shut down at any moment, even for pennies.<\/p>\n

\"Storage,
\n
\nHowever, now that I\u2019ve decided to move some tasks from the desktop to the server, I\u2019ve switched the copying to OneDrive to Duplicati. It may still be in beta, but I\u2019ve been using it for several months and it has been quite stable so far. Since Duplicati stores its backups in archives rather than loose files, I decided to encrypt everything being uploaded with the built-in tools. After all, if something goes wrong, I\u2019ll have to restore through Duplicati anyway. So let it encrypt everything.<\/p>\n

Considering that my terabytes are in chunks, the cloud backup consists of several tasks. Here, the backup is being re-uploaded to the cloud. 2019 uploaded quickly \u2014 there were about fifty photos in just a couple of days; I didn\u2019t travel much at that time, and 2018 is gradually uploading. The current upload speed is not at its maximum \u2014 it\u2019s during the day, the channels are busy, and all that.<\/p>\n

\"Storage,
\n
\nIn the cloud, the backup folder looks like this \u2014 many zip archives, the size of the archive is adjustable when the task is created:<\/p>\n

\"Storage,
\n
\nAbout once a month, I back up to an external drive that is kept in a cabinet. I connect it and manually start the task with GoodSync. Although, of course, you can set it up to start automatically when the drive is connected \u2014 but I don't always need to make a backup when I connect the drive.<\/p>\n

Ideally, I would need another remote storage location \u2014 my own and not overly cloud-based. On my server<\/a>, which is located on the provider's platform, I've had a drive set up for this purpose for a long time, but I haven't gotten around to it. However, since I've started moving everything to Duplicati, I think I'll take care of this now, after I re-upload everything to OneDrive.<\/p>\n

\"Storage,
\n<\/p>\n

How is it cataloged?<\/h3>\n

\nThis question splits into two parts \u2014 the file system level, where cataloging is done at the level of folders, and logical cataloging based on a greater number of parameters, because the folder tree is still limited in capabilities.<\/p>\n

Yes, I shoot in RAW. Because from RAW you can create a JPG at any time, but not vice versa. I used to shoot in RAW+JPG to have the option to quickly transfer photos to my phone and send them online (it was hard to transfer RAW to my phone). I would then delete the JPGs when copying to my desktop. But now I find my phone satisfactory in terms of photo quality (for posting online), so I've completely eliminated JPG images on my cameras. The remaining ones are either from the time when I didn't have a mirrorless camera or come from my phone.<\/p>\n

\"Storage,
\n
\nAt the file system level, it looks like this: at the top level of folders \u2014 the source. Usually the names of photographers.<\/p>\n

\"Storage,
\n
\nOne level down \u2014 themes. They are generally similar, but there can be personal themes (for example, \"Dogs\"), and some themes might not exist.<\/p>\n

\"Storage,
\n
\nNext are the years. Inside each year, folders are organized by days. Within a folder, there can be separate photo sessions if the photos for the day are categorized by theme.<\/p>\n

As a result, the path to a file might look something like this: MyTrips20182018-04-11 BerlinFrench StationP4110029.ORF<\/b><\/p>\n

I shoot with two cameras, typically alternating between them, but occasionally I take both with me \u2014 then I dump the photos from both into one folder. The main thing is to keep the time synchronized; otherwise, I have to calculate the difference and adjust the shooting date for all files (it\u2019s easy in Lightroom, but tedious to calculate the time difference).<\/p>\n

There is a separate folder for photos from the phone on the second level, but if necessary, a photo can be sent to a thematic folder.<\/p>\n

Logical cataloging over folders \u2014 Adobe Lightroom<\/b>. Of course, there are quite a few programs for cataloging and processing, but Lightroom works for me, it is reasonably priced (and they even offer Photoshop in the bundle), and in the last couple of years, it has become less laggy. Though, of course, the full transition to SSD also helped.<\/p>\n

All photos reside in one directory. The folder structure from the previous point is used as a base, with additional information like EXIF data, geotags, tags, and color markers added on top. Face recognition can also be enabled, but I don\u2019t use it. <\/p>\n

Based on all of the above, you can create \u2018smart collections\u2019 \u2014 dynamic samples based on certain file properties \u2014 from shooting parameters to text in comments.<\/p>\n

\"Storage,
\n
\nAll tags are stored in files, editing history is in XMP files next to the RAWs. The Lightroom catalog is backed up by Lightroom\u2019s own tools once a week to a specific folder, from which it is then uploaded to OneDrive. Additionally, the system disk of the desktop is backed up daily to the server via Veeam Agent, as the catalog is stored on the system disk.<\/p>\n

Is it all about photos? Are there no other types of files?<\/h3>\n

\nYes, there are. The backup methods do not differ (if backup is even needed), while the cataloging methods depend on the type of content. <\/p>\n

Generally, folder-level sorting is sufficient; tags are not needed. Only a separate cataloger is used for movies and series. \u2014 Plex Media Server. It also serves as the media server, as the name suggests. However, it hasn\u2019t been very effective; only about a quarter of the library is sorted well, while the rest is left in the folder «!to sort».
\n
Source: habr.com<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u0422\u0443\u0442 \u043f\u0435\u0440\u0438\u043e\u0434\u0438\u0447\u0435\u0441\u043a\u0438 \u043f\u0438\u0448\u0443\u0442 \u043f\u043e\u0441\u0442\u044b \u043f\u0440\u043e \u0442\u043e, \u043a\u0430\u043a \u0445\u0440\u0430\u043d\u044f\u0442 \u0438 \u0431\u044d\u043a\u0430\u043f\u044f\u0442 \u0441\u0432\u043e\u0438 \u0444\u043e\u0442\u043e\u0433\u0440\u0430\u0444\u0438\u0438 \u2014 \u043d\u0443 \u0438 \u043f\u0440\u043e\u0441\u0442\u043e \u0444\u0430\u0439\u043b\u044b. \u0412 \u043f\u043e\u0441\u043b\u0435\u0434\u043d\u0435\u043c \u0442\u0430\u043a\u043e\u043c \u043f\u043e\u0441\u0442\u0435 \u043d\u0430\u043f\u0438\u0441\u0430\u043b \u0434\u043e\u0441\u0442\u0430\u0442\u043e\u0447\u043d\u043e \u0434\u043b\u0438\u043d\u043d\u044b\u0439 \u043a\u043e\u043c\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439, \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u043f\u043e\u0434\u0443\u043c\u0430\u043b \u0438 \u0440\u0435\u0448\u0438\u043b \u0432\u0441\u0451 \u0436\u0435 \u0440\u0430\u0437\u0432\u0435\u0440\u043d\u0443\u0442\u044c \u0435\u0433\u043e \u0432 \u043f\u043e\u0441\u0442. \u0422\u0435\u043c \u0431\u043e\u043b\u0435\u0435, \u0447\u0442\u043e \u043d\u0435\u0441\u043a\u043e\u043b\u044c\u043a\u043e \u043f\u043e\u043c\u0435\u043d\u044f\u043b \u043c\u0435\u0442\u043e\u0434 \u0431\u044d\u043a\u0430\u043f\u0430 \u0432 \u043e\u0431\u043b\u0430\u043a\u043e, \u043c\u043e\u0436\u0435\u0442 \u0431\u0443\u0434\u0435\u0442 \u043f\u043e\u043b\u0435\u0437\u043d\u043e \u043a\u043e\u043c\u0443. \u0414\u043e\u043c\u0430\u0448\u043d\u0438\u0439 \u0441\u0435\u0440\u0432\u0435\u0440, \u0433\u0434\u0435 \u043f\u0440\u043e\u0438\u0441\u0445\u043e\u0434\u0438\u0442 \u043c\u043d\u043e\u0433\u043e\u0435 \u0438\u0437 \u043e\u043f\u0438\u0441\u0430\u043d\u043d\u043e\u0433\u043e […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":24458,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[688],"tags":[],"class_list":["post-32670","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-administrirovanie"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Storage, Backup, and Cataloging of Photos | ProHoster","description":"From time to time, posts are written here about how people store and back up their photos \u2014 as well as just files. In the last such post, I wrote a fairly long comment, thought a bit, and decided to expand it into a post.","canonical_url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/hranenie-rezervnoe-kopirovanie-i-katalogizatsiya-fotografij","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0425\u0440\u0430\u043d\u0435\u043d\u0438\u0435, \u0440\u0435\u0437\u0435\u0440\u0432\u043d\u043e\u0435 \u043a\u043e\u043f\u0438\u0440\u043e\u0432\u0430\u043d\u0438\u0435 \u0438 \u043a\u0430\u0442\u0430\u043b\u043e\u0433\u0438\u0437\u0430\u0446\u0438\u044f \u0444\u043e\u0442\u043e\u0433\u0440\u0430\u0444\u0438\u0439 | ProHoster","og:description":"\u0422\u0443\u0442 \u043f\u0435\u0440\u0438\u043e\u0434\u0438\u0447\u0435\u0441\u043a\u0438 \u043f\u0438\u0448\u0443\u0442 \u043f\u043e\u0441\u0442\u044b \u043f\u0440\u043e \u0442\u043e, \u043a\u0430\u043a \u0445\u0440\u0430\u043d\u044f\u0442 \u0438 \u0431\u044d\u043a\u0430\u043f\u044f\u0442 \u0441\u0432\u043e\u0438 \u0444\u043e\u0442\u043e\u0433\u0440\u0430\u0444\u0438\u0438 \u2014 \u043d\u0443 \u0438 \u043f\u0440\u043e\u0441\u0442\u043e \u0444\u0430\u0439\u043b\u044b. \u0412 \u043f\u043e\u0441\u043b\u0435\u0434\u043d\u0435\u043c \u0442\u0430\u043a\u043e\u043c \u043f\u043e\u0441\u0442\u0435 \u043d\u0430\u043f\u0438\u0441\u0430\u043b \u0434\u043e\u0441\u0442\u0430\u0442\u043e\u0447\u043d\u043e \u0434\u043b\u0438\u043d\u043d\u044b\u0439 \u043a\u043e\u043c\u043c\u0435\u043d\u0442\u0430\u0440\u0438\u0439, \u043d\u0435\u043c\u043d\u043e\u0433\u043e \u043f\u043e\u0434\u0443\u043c\u0430\u043b \u0438 \u0440\u0435\u0448\u0438\u043b \u0432\u0441\u0451 \u0436\u0435 \u0440\u0430\u0437\u0432\u0435\u0440\u043d\u0443\u0442\u044c \u0435\u0433\u043e \u0432 \u043f\u043e\u0441\u0442.","og:url":"https:\/\/prohoster.info\/en\/blog\/administrirovanie\/hranenie-rezervnoe-kopirovanie-i-katalogizatsiya-fotografij","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2019-10-31T18:48:18+00:00","article:modified_time":"2019-10-31T18:48:18+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"32670","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":"2026-02-09 21:45:03","breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-03-01 02:54:26","updated":"2026-02-09 21:45:03","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/32670","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=32670"}],"version-history":[{"count":2,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/32670\/revisions"}],"predecessor-version":[{"id":172806,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/32670\/revisions\/172806"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media\/24458"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=32670"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=32670"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=32670"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}