Consolidating Photo Libraries On

Steven Graeber just upgraded to El Capitan and wants to move his photos from iPhoto to Photos for OS X, but:

  1. Consolidating Photo Libraries Online
  2. Consolidating Photo Libraries On The Internet
  3. Stock Photo Libraries

May 09, 2019 Once the photos have all uploaded, go back to Step 1 with your next Photos library. When you’re done, the last Photos library becomes the one you’ll keep, and you can delete the others. Needless to say, make sure you have good backups first! Merge with PowerPhotos. The $30 PowerPhotos from Fat Cat Software provides a variety of extra. The first step in any digital organizing project is consolidation. This task can often seem quite daunting, especially when photos may be scattered across a myriad of devices: computers, hard drives, cloud accounts such as Shutterfly or Dropbox, SD cards, discs, cell phones, old video cameras, and perhaps even some floppy discs that have been. See full list on macworld.com. See full list on citymac.com.

Photos gave me an option of 5 different libraries to choose from. Why is there more than one? I have never used multiple libraries. And the dates on these are from times I wasn’t using iPhoto at all.

You’ve got a couple of approaches to solve this.

Stock

I’d try to figure out first what’s in those libraries, to make sure they aren’t holding pictures or video you want.

Consolidate
  1. Quit iPhoto if it’s open.
  2. Hold down the Option key.
  3. In the dialog box that appears, select an iPhoto library. If they don’t all show up, use Open Other to find them.
  4. See what’s in the library and whether it contains anything you’re missing.
  5. Repeat steps 1 to 4 for each iPhoto library.

If you find that you have material in each library you want to merge, instead of multiple copies of the same library or empty libraries, you can pick one of the following:

  • Import each into Photos and maintain multiple Photos libraries.

  • Pick the biggest iPhoto library and import the entire library into Photos. Then export the media from each of the other iPhoto libraries and import all the media into your master Photos library. (Here’s my advice from last year about handling that.)

  • Spend $30 and get iPhoto Library Manager and PowerPhotos, a bundle that lets you merge iPhoto libraries and Photos libraries, among other advanced tasks, including removing duplicate photos.

Ask Mac 911

We’re always looking for problems to solve! Email yours to mac911@macworld.com including screen captures as appropriate. Mac 911 cannot reply to email with troubleshooting advice nor can we publish answers to every question.

This explains how I consolidated & de-duped about 45,000 pictures andmovies from four iPhoto libraries on two different machines and variousdirectories full of images on USB drives into one 33,000 file library.

We had about 25,000 photos in one library from a previous (unsuccessful)attempt at consolidating libraries. We had two further librariescontaining about 13,000 and 10,000 images each, and a fourth iPhotolibrary on a separate machine, plus the aforementioned random grab-bagof directories full of images. (I didn't count how many these were, butthey numbered in the thousands.) After consolidation we ended up with33,000 images and movies in one iPhoto library.

iPhoto has a menu item for finding duplicates, but I was not been ableto make it work; it would just hang trying to find duplicates in one ofthe smaller libraries. And even if I could get that to work I didn'thave the space to copy all the images into one giant library and letiPhoto sort it out. So I wrote a program to help me.

One problem was that the same picture would exist with different filenames, probably due to being imported from devices into multipledifferent iPhoto libraries or to being exported & then imported again inthe aforementioned failed consolidation attempt. We also had differentimages existing with the same name, due to the counter on the cameralooping around. This was OK since iPhoto stores images from differentimports in different directories, but it meant that we couldn't justcopy all the files into one directory and use the names to de-duplicatethem.

Libraries

I wrote a simple program to iterate over all image & movie files in adirectory and create a copy of each named after theMD5 hash of its content. Thusfiles whose content were identical, but had different names, would nowend up with the same name. I did not want to end up with tens ofthousands of files in one directory, so I made my program put each filein a directory named after the 2 first characters of each file's name.Here it is:

Since I didn't have enough disk space to duplicate all the images, Iused hardlinks. This essentially means you just create a new filenamepointing to the same data on disk, without taking up extra data. I alsomade the program create a log file containing the location of each fileand its MD5 hash so I could find out how many files were processed andhow many duplicates were found.

A problem with the MD5 hash approach would be if duplicate copies ofimages had different image metadata. This could be the case is somecopies had had their dates adjusted or if iPhoto where changing the EXIFinformation when you star photos or tag faces in them. Fortunately, alittle experimentation showed that iPhoto does not change the imagefiles but stores this extra information in a separate database. Myapproach would thus mean that we would lose stars & face tags, but weconsidered this an acceptable trade off. Consolidating and de-duping thelibraries would be worth it.

What if the EXIF information had been edited? (Some image managersdo.) Would all hope be lost? No, it would not. The Imagemagick suite oftools comes with the identify program, which allows you to get a hashof just the image data. This would allow us to find more duplicates,even if the EXIF information had been edited; however it runs much,much slower than just using MD5 so I chose not to use it.

One worry I had was how to make sure I got hold of all the originalsfrom iPhoto. Due to the aforementioned space constraint I couldn't justexport all the photos and thus create new copies. However, this turnedout not to be an issue. iPhoto stores its originals in a Mastersdirectory, along parallel directories for Previews and Thumbnails.Thus I just ran my program on the Masters directory. One risk would belosing edits to images, but I was OK with this.

In the end I had 255 directories with on average 130 files in each. Iimported these directories into a brand new iPhoto library roughly tenat a time. Since iPhoto doesn't use hardlinks but copies the photos intoits library (to avoid nasty surprises if someone decided to edit thefile in a different location, no doubt) this ate up disk fast; and I hadto delete the existing libraries under the different accounts to makeroom. Since I had Time Machine backups (yes, plural—I rotate two TimeMachine disks) I felt OK doing this.

We are really happy with the result :-)

Update 2014/05/08: A few days ago I received a question to this postfrom Jeff Ruth. Because it, and its answer, may be useful to more peopleI asked if I could reproduce it here.

Hello and thanks for the post about your iPhoto consolidation andde-duping. I'd love to do something similar. We have three Applelaptops (two MacBooks from 2008 and 2009) and a new Macbook ProRetina. In all, about 3-5 iPHoto libraries, I think. Your projectseems to be what we'd like to do. However, I'm not sure how to do it.If you have a minute, could you please tell me how I can use yourcode, or do this a different way, without the program? I am not aprogrammer, but have used Terminal now and then and am not afraid toexperiment if necessary. Thanks a lot, in advance.

Jeff Ruth

My response:

Do your libraries contain duplicates? If not, I wouldn't bother withthis approach. We only needed to because we had imported the samephotos into multiple photo albums.

The script was intended for developers, but if you want to try youhave to copy the file (dedupe-media.sh) to your local disk, then makeit executable. In Terminal, you do that with ‘chmod +xdedupe-media.sh'. (Without the quotes.) You then run the script likeso:

/path/to/dedupe-media.sh /path/to/iPhotoLibrary/Masters /destination/path

If you want to run this on multiple laptops you may want to make thedestination a single USB disk (or something) so probably/Volumes/MyUSBDiskName. This disk will accumulate unique photos.The product is just a big folder of files, which will have to importedinto a new library. All metadata (faces, etc) will have to attachedagain.

Please note this script comes with NO WARRANTY OF ANY KIND. You musttake adequate backup of your libraries before running the above.Although I have made my best attempt at making the script work (and itdoes for me!), I take no responsibility for any data loss you mayexperience.

Consolidating Photo Libraries Online

Consolidating photo libraries on mac

Consolidating Photo Libraries On The Internet

Update 2015/08/16: One annoyance under iTunes is that the 'rolls' or'albums' feature is utterly meaningless, because you've got 255 albumsnamed '00', '01', '..', 'fe', 'ff'. However, you can fix that by runningexiftool over the resulting files to have them grouped by year andmonth (there aremoreexamples in the exiftool documentation):

Stock Photo Libraries

This moves the images found in DIR_OF_FILES into a directory structurebased on the year and month the data was taken, as taken from the Exifdata in the image itself. The structure will be like so: