Don't let this happen to you...Backup, Backup & Backup! [Sitemap]

wildviper

Oct-15-2007, 07:38 PM

I am stickler for backing up. I have had too many people around me complain about data loss and so on.

My backup strategy was to keep 2 full rez copies of ALL my pictures on 2 separate hard drives. Updated regularly to ensure they both were synced. I also have DVDs of these pictures stored safely. However, due to the inherent slow nature of making DVDs, I had fallen behind. I was 1 year behind with about 4,000 pictures taken in one year. Also, smugmug account has a lot of them..but smugmug doesn't keep my originals as originals...they do some modification.

You would have thought I was covered! You would be slightly Wrong!!!! :scratch

Few days ago, my computer crashed. It took down 3 of my drives that were in there. 2 of them were full of ALL my pictures(like I said above). 3rd drive was for my mp3s and home movies. Can you imagine my shock when I started the computer to read "Disk Read Error" and "OS can't be found" and so on???

After spending 6 days working 8 hours or so on the computer, I was able to salvage all my pictures. Phew!!! :barb THe only reason I was able to save the pictures was because I knew what NOT to do in case of a crash. (I am writing my experiences down and will post a link to a forum where I participate with that info).

So, if any of you think that you are safe with backups on two separate drives, think again. My drives were made by Maxtor and Seagate(the latest one). And I had made NO changes to the computer. I have not been able to uncover the specific reason this happened, but, suffice it to say, it scared the hell out of me.

I began thinking...what if I had lost my year's worth of pictures? What if I had lost it all due to DVDs not being able to be read???? What will i show my kids, my grandkids when I have them ??????? Sorry, but I only have four or five pictures to show you??!!??

While digital is great, like many of you, I do not print a majority of the pictures. This is the BIG problem that everyone should be fully aware of. In fact, I would think that camera manufacturers should put in an informational sheet with all these digital cameras.

SO this is a post to warn you all. Don't think you are safe.

Backup, Backup and Backup.

Here is my new strategy: I have a PDF that hopefully I can attach here.

Have 3 full replicas of All my pictures on 3 separate drives by 3 different manufacturers. 1 External that is only connected to backup.
Have 1 set of DVD backups of JPEG versions of these pictures. Store externally.
Have 1 set on another HD of JPEGs only again. Store externally.
Regular backups and keep to the schedule.That may sound like overkill for many of you, but, after having 3 drives crash at the same time is kinda scary.

I will attach a PDF chart that I made so that it may help someone else. Let's see if this allows me to attach.
Edit: I have to reduce the file size...let's see

DavidTO

Oct-15-2007, 08:03 PM

wildviper

Oct-15-2007, 08:15 PM

Cool PDF!

I've been using JungleDisk with Amazon S3. Not so speedy (hah!), but safe as can be, IMO.

I also have a local back up. I refuse to use optical media. Don't trust it, don't like it. I'd rather have 10 HDs than one DVD. :D But that's just me.

Thanx. I had to do this so that everyone in my family understands the steps necessary. I am planning to make it very simple for everyone to move images from laptops to desktop. so far I have the process down to 2 clicks.

I thought about online storage, but, my Jpegs alone are 25 gigs! They are not low rez though. I can't even imagine the time it would take to upload that. So I gave up on that idea. It appeals to me though if they offered "Send us DVDs/HDs and they will upload the pictures". Then I don't have to worry about uploading 25gigs!!!

DavidTO

Oct-15-2007, 08:29 PM

I uploaded 60 GB. I'm not saying it's the best solution, but it worked for me!

The thing I'm excited about for backing up the family is running Time Machine in Leopard on a networked drive via the wireless network. Set it, and forget it! :ivar

claudermilk

Oct-16-2007, 08:51 AM

Interesting story. Glad you wer eable to salvage your data. One thing is not clear though.
You said you had everything backed up to two drives, yet you lost your backups? :scratch How? Or was it just two copies of files all on the main PC?

Might I make another suggestion? It sounds like your OS and data files are all on the same volume. Separate them. Get a small, fast drive reserved solely for loading the OS and programs on. Then, when that dreaded "OS not found" error pops up, you only have to deal with wiping that drive. Your data is on a completely separate, untouched drive waiting for the OS to come back and find it again.

wildviper

Oct-16-2007, 09:15 AM

Interesting story. Glad you wer eable to salvage your data. One thing is not clear though.
You said you had everything backed up to two drives, yet you lost your backups? :scratch How? Or was it just two copies of files all on the main PC?

Might I make another suggestion? It sounds like your OS and data files are all on the same volume. Separate them. Get a small, fast drive reserved solely for loading the OS and programs on. Then, when that dreaded "OS not found" error pops up, you only have to deal with wiping that drive. Your data is on a completely separate, untouched drive waiting for the OS to come back and find it again.

I had lost everything since my main files and backup files were on the 2 drives. I only had DVD backups and they were at least a year old. So I would have lost 1 year data + any DVDs that would give me the dreaded CRC checksum errors.

ANd thanx for the suggestion of the OS being on a separate drive. I had it on separate partition, but not separate drive. Will have to do that.

mrcoons

Oct-16-2007, 09:54 AM

Cool PDF!

I've been using JungleDisk with Amazon S3. Not so speedy (hah!), but safe as can be, IMO.

I also have a local back up. I refuse to use optical media. Don't trust it, don't like it. I'd rather have 10 HDs than one DVD. :D But that's just me.

I had not heard of this David but I think I will check it out. I have 1 internal large capacity drive and 3 externals but one external drive died last month. This drive was over 5 years old so I had moved most of the data off it and only used it for downloading video. A good thing too.

But this had made me start thinking about photo storage a little harder. I too do not trust optical media because of the recent changes in optical hardware. No telling how long existing CD/DVD's will be 'readable'.

I'm also leary of external drives. Once I fill a 500GB drive or once it gets 3 to 4 years old the prospect of copying the contents to a newer drive is not something I'd look forward too.

So I think I'll give JungleDisk a good hard look. Thanks again for the info.:bow

LiquidAir

Oct-16-2007, 10:11 AM

It was probably a glitch the power supply that took down both your drives at the same time. I much prefer using USB drives for backup because they are disconnected most of the time. Live drives are much more vunlerable both to power issues (e.g. lightning striking a power pole) and software issues (e.g. malicious viruses).

I have shifted to using a network attached storage device for my nightly backup (a Synology DS-207 configured for RAID 1) because it lets me get at my data from anywhere, but I still back it up weekly to a USB drive which I keep offsite.

LiquidAir

Oct-16-2007, 10:21 AM

Might I make another suggestion? It sounds like your OS and data files are all on the same volume. Separate them. Get a small, fast drive reserved solely for loading the OS and programs on. Then, when that dreaded "OS not found" error pops up, you only have to deal with wiping that drive. Your data is on a completely separate, untouched drive waiting for the OS to come back and find it again.

Yes indeedy. For the OS, the best strategy I know of is to get small fast drives. Put one in your machine, the other in an external USB box. If your OS drive goes south, all you have to do is put the external one in its place and you are up and running again.

Foochar

Oct-16-2007, 10:32 AM

Interesting story. Glad you wer eable to salvage your data. One thing is not clear though.
You said you had everything backed up to two drives, yet you lost your backups? :scratch How? Or was it just two copies of files all on the main PC?

I'm also trying to figure this out:scratch, I work in I.T. and although I've seen plenty of cases where a drive fails in such a way that the data on that one drive is irrecoverable, the odds are pretty long that multiple drives would fail at the same time... There are some failure modes that could cause this, the big one being a storage controller failure that ends up causing data corruption on both drives, or as LiquidAir pointed out a power supply glitch, but both of those are pretty rare. And if it was either of things wildviper needs to seriously consider replacing some hardware in addition to the failed drives, because there is no telling when the problem might show up again. If it was just that the O.S. files that became corrupt (I've seen this many times and it would give an error similar to what wildviper describes) and the hardware was ok, it should have been possible to do a parallel install of windows (install to C:\WinRetry on any other non default path) and all the data on the drives should have still been there, so long as you didn't format or repartition the drives.

That being said any storage method that keeps all the backups in the same location is inherently flawed, what happens if your house catches fire, is leveled by a tornado etc. I'm guilty of this myself, and I really need to get back in the habit of keeping a copy of everything on a USB drive at work as well as at home, or take a serious look at jungledisk, even if it does mean a month of uploads at cable modem speeds. At the end of the day you've got to examine your backup strategies in light of the value you place on your images, the level of risk there is to those images and the cost to reduce that risk.

Travis

Oct-16-2007, 10:50 AM

It was probably a glitch the power supply that took down both your drives at the same time.

6 months ago I had the pleasure of having my power supply pop. It took with it the video card, motherboard, and 2-250gb hard drives. Luckily the computer was fairly new and I only lost a couple months worth of photos but it shocked me nontheless. I made the idiotic assumption that I was safe because I had the primary har drive mirrored by the second. Doh! Doesn't help much when both fry. Since then I've moved to external hard drive AND DVD backups. It sounds like overkill but It is well worth the potential risk.

dmmattix

Oct-16-2007, 10:54 AM

Exactly the point I have been trying to make over in another thread but you know DvDs are evil:D

Regards,

Mike

Who has external hard drives and just bought a 100pack of DvD-Rs...

Dogdots

Oct-16-2007, 11:46 AM

Wildviper I couldn't get your chart up. Any ideas? I'm really interested in seeing it.

wildviper

Oct-16-2007, 01:26 PM

Wildviper I couldn't get your chart up. Any ideas? I'm really interested in seeing it.

I am not sure why not. No one else seems to have that issue. Maybe your Popup blocker??

In anycase, send me a PM with your email address and I can attach it and send it.

++++++++++++++++++++

I am not sure why and how this happened to me. This is Day 7 or 8 now that I am trying to figure this out. I have run a lot of burn-in type tests and it is all ok.

The only one that crashes is SpinRite. It gives me some strange error and says it can't continue anymore. Now, either SpinRite is very advanced and knows something that it doesn't want to share with me...or it is being tripped up by something small.

It maybe my IDE controller on the board, but I have done soo many read/write tests and nothing(except for SpinRite).

I just want to bring people's attention to this issue. Don't think you are safe cause you got a RAID or you got multiple drives in your system. Things can go wrong....3 drives for me copped out at the same time! Who would have thought??

Edit: As much as I do not like the idea of uploading all pictures to a server due to time constraints..I think I may. Time to research JungleDisk and others.

NavyMoose

Oct-16-2007, 08:41 PM

I am not sure why not. No one else seems to have that issue. Maybe your Popup blocker??

In anycase, send me a PM with your email address and I can attach it and send it.

++++++++++++++++++++

I am not sure why and how this happened to me. This is Day 7 or 8 now that I am trying to figure this out. I have run a lot of burn-in type tests and it is all ok.

The only one that crashes is SpinRite. It gives me some strange error and says it can't continue anymore. Now, either SpinRite is very advanced and knows something that it doesn't want to share with me...or it is being tripped up by something small.

It maybe my IDE controller on the board, but I have done soo many read/write tests and nothing(except for SpinRite).

I just want to bring people's attention to this issue. Don't think you are safe cause you got a RAID or you got multiple drives in your system. Things can go wrong....3 drives for me copped out at the same time! Who would have thought??

Edit: As much as I do not like the idea of uploading all pictures to a server due to time constraints..I think I may. Time to research JungleDisk and others.

I work in IT as well and I'm a firm believer in having multiple redundancies :D

On my Photoshop computer, I have two Seagate 500Gb drives in RAID 1 configuration. To those non techies, this means one drive is the mirror of the other. I have an external drive that I backup my photos and LR catalogs to using NT Backup. Everytime I do anything to photos, I run an incremental backup. Each month I run a full backup.

I also keep a seperate partition for my photographs. The OS and apps are on the C:\ drive and the photos are on the D:\ drive. In the event of an OS failure, I can rebuild and my photos will be relatively safe.

I also use Amazon S3 and I will echo how slow it is, especially with a cable modem. It is the ultimate in offsite storage, and very low cost.

Navy Moose

claudermilk

Oct-17-2007, 08:03 AM

I had lost everything since my main files and backup files were on the 2 drives. I only had DVD backups and they were at least a year old. So I would have lost 1 year data + any DVDs that would give me the dreaded CRC checksum errors.

ANd thanx for the suggestion of the OS being on a separate drive. I had it on separate partition, but not separate drive. Will have to do that.

OK makes more sense now. So, now we've all learned that 2 copies of the files all on internal drivers really are not "backups." Backups have to be offline, and separate from the PC. This is what both makes them effective & inconvenient. Removable/external drives are the most convenient compromise as they put online & pulled offline quickly & painlessly.

Dogdots

Oct-17-2007, 08:43 AM

denisegoldberg

Oct-17-2007, 09:52 AM

I also use Amazon S3 and I will echo how slow it is, especially with a cable modem. It is the ultimate in offsite storage, and very low cost.
I suspect that Amazon has the upload speed capped somehow. If I upload the same files to smugmug that I do to S3 and compare the times, S3 takes much longer. The only time it was really an issue for me was when I first backed up my files.

--- Denise

mrcoons

Oct-17-2007, 10:12 AM

I suspect that Amazon has the upload speed capped somehow. If I upload the same files to smugmug that I do to S3 and compare the times, S3 takes much longer. The only time it was really an issue for me was when I first backed up my files.

--- Denise

I agree. Shouldn't be a major problem for me once I get my old data uploaded though. Which it appears that will be in a few days!:D

wildviper

Oct-17-2007, 11:17 AM

I agree. Shouldn't be a major problem for me once I get my old data uploaded though. Which it appears that will be in a few days!:D

Well I just calculated the cost of Jungledisk service through Amazon S3. For 100 Gigs with no transfers it is $15 per month. $15 x 12 = $180 per year with no transfers.

I just bought a Esata/USB 2.0 500 Gig External HD for $140. Internals are even cheaper.

Why would this service make sense for paying so much? It takes time to upload, I can't access it anywhere(Cybercafe and so on)due to the software limitation.

I am still researching.

BradfordBenn

Oct-17-2007, 01:18 PM

Glad you got your stuff back.

I had a similiar problem on my work laptop. I am pretty good about keeping data on the network drive, backup before every trip, upload critical stuff every night at the hotel (not a photographer but still deal with 10 to 100MB files)... but one time my hard drive booted up with the dreaded "OS not found" error. One could actually hear the drive scraping while spinning. Oh <insert expletive of choice here>!

So I went to a coworker's laptop and downloaded Knoppix (http://www.knoppix.org/) and created a bootable CD. This allows one to launch a version of Linux from the CD drive and mount the internal drive (without having to reformat it). I then hooked up an external USB hard drive. I then copied all the drive contents to it I could, the critical stuff went to a USB flash drive as well.

It saved the trip, all I lost was a few e-mails. I have read that it can be done from a USB drive but I have not tried. It might be worth keeping that CD around.

Sorry to hear about the problems, glad you got it back.

draggin

Oct-17-2007, 01:45 PM

anderiv

Oct-17-2007, 01:53 PM

Well I just calculated the cost of Jungledisk service through Amazon S3. For 100 Gigs with no transfers it is $15 per month. $15 x 12 = $180 per year with no transfers.

I just bought a Esata/USB 2.0 500 Gig External HD for $140. Internals are even cheaper.

Why would this service make sense for paying so much? It takes time to upload, I can't access it anywhere(Cybercafe and so on)due to the software limitation.

I am still researching.
I'm going to give a shout out for Mozy (http://mozy.com). I've used their backup service for about 6 months now and I love it. Mozy charges ~5 USD/month for unlimited data backup. They have a little app that runs in your system tray, automatically backing up any new/modified files that appear on your system. This app is available for both Windows and Mac.

Previous to Mozy, my backup strategy was to sync my master media folder with an external server at home as well as with a server at work. Fortunately I never had a hardware failure that forced me to use one of these backups, but I couldn't help but think about what would happen if I forgot to sync up for a few weeks and then had a hardware failure. That would be *bad* news. That's when I decided it was well worth the monthly charge to sign up for Mozy and have a backup solution that I didn't have to think about. For me, the peace of mind that comes along with constant, reliable, hands-off, offsite backups is worth far more than what it costs.

My media folder is currently just under 100 GB. The initial backup took about 1 week to complete, after which it only transfers new/modified files.

...just my $0.02.

NavyMoose

Oct-17-2007, 03:13 PM

Navymoose what do you mean by saying your photos will be relatively safe?

Let me know if I have this right.

--I hook my external up to the d drive so the OS doesn't effect it. So if anything happens to the OS when I'm hooked up it won't effect my photos cuz they are hook to another drive?

Oops---typical womans question---running in circles. Please forgive
me :rofl

----Mary

Hi Mary,

What I meant, if I have to re-install the OS I only have to format the C:\ partition, where the OS lives, and the second partition, where the photos live, would not be touched. You just have to be careful and read everything twice before hitting the "enter" key.

The backup files on an external drive that is powered off and disconnected from my computer unless I'm running the backup.

I suggest using the external drive to keep the backup file and leaves the photos local on the computer. Before I built my photoshop computer, I kept the photos on an external drive and slow doesn't begin to describe the performance.

My gut says the OS can still possibly hurt the photos on the external drive while it is connected to the computer. This is one of the reasons I don't leave it connected unless I'm actually using it.

Are you using WinXP Pro or Home versions? If you are using the Home flavor, you can get the Windows backup utility off the OS CD, I think in the "extras" folder. The Pro version has this installed by default. This is a good tool for the home user to backup important files. You can also save backup jobs to run at a later date.

If you have any other questions, feel free to ask.

Navy Moose

CAFields

Oct-17-2007, 06:02 PM

I've read through this thread with interest and thought I should make a suggestion.

I recently retired from my computer maintenance and repair business and have seen a lot of situations involving crashes and backups, etc. The information that I've read in this thread regarding external backup drives and off-site storage is good.

My suggestion is to choose your backup software very carefully. Most people let the software compress their files during a backup, and if they have to perform a restore procedure, the software uncompresses the files during restore. The problem here is if you create a backup with Brand X backup software and compress the data, will you still have Brand X software 10 years from now if you want to retrieve a photo or file? Chances are whatever program you're using at that time might not read the compressed backup file(s) that you created with Brand X software. If you then pull out the install disk for the Brand X software so that you can load the program to do a restore, will the software run on the OS of 10 years in the future? How many various programs of a couple of years back won't run on Vista now? Think of a backup done with a Windows 95 or 98 software and trying to restore it with one running under Vista, etc. etc. Maybe it will work, but we can't afford to assume that it will. I've seen backups created by Windows95 and 98 built-in backup programs that can't be read by later OS's.

My suggestion is to be sure to perform your backup to the external drive or DVD without compressing the files so that the backup program re-creates the actual directory structure and files on the backup device. You can then view and access those files on the backup device through Windows Explorer or load them directly into your photo editing program without performing a restore procedure, just the same as if they were copied to the disk by copy/paste or dragging/dropping. This type of backup uses more disk space, but for me it's worth it.

Personally I use Nero Backup when I write to DVD's as it will do the above and also allow the backup to be spanned across multiple disks. I use a free utility called SyncBack to copy my photos to my external USB hard drives.
http://www.2brightsparks.com/downloads.html#freeware
There's other software (free and otherwise) that will do the same things as the ones mentioned above, but these are the ones I use. The main thing is to be sure that whatever program you use will backup your data in a way that will allow you to read or open your files directly from the backup disk(s) at any time.

C.A.Fields

http://cafields.com

BradfordBenn

Oct-17-2007, 07:33 PM

LiquidAir

Oct-17-2007, 07:40 PM

Found one that might be helpful for those running Windows. Microsoft has a tool called SyncToy (http://www.microsoft.com/windowsxp/using/digitalphotography/prophoto/synctoy.mspx) that will do scheduled file copies and one can pick how the move goes. No experience yet but one day at the office and it seems okay so far.

That's what I use and it has been working fine so far. If you use it to sync a USB drive, you want to fix the drive letter for the external drive. I set my backup volumes as Z:

wildviper

Oct-17-2007, 09:09 PM

CAFields, excellent point. I remember that for my office we used to use HP Simple Backup. I now have CDs that I can't access unless I get that software. What a Pain?!?

I use SyncToy. It is awesome, and it is free from Microsoft. There is no compression bs. It copies the files as they are.

It can even copy files with certain extensions only. So in my case, for my JPEG backup strategy, I just choose *.Jpg and voila! It goes in each folder, recreates the folder and copies the jpegs in there.

--------

On the online storage deal. I will check out mozy. My concern is what if they go out of business? By they, I mean any one of the online storage companies. Don't tell me Amazon won't go out of business...look at Enron. So anything can happen. What then?

By the way, I am playing devil's advocate..I just want to see good reasons with a lot of the bases covered for online storage.

Oh, and by the way, I will store one of the drives off-site and the DVDs off-site in a safety deposit box.

Dogdots

Oct-18-2007, 11:37 AM

NavyMoose

Oct-18-2007, 12:09 PM

Navymoose I have windows xp home version. After reading all this information I think---and it is only thinking---I may see how to do this.

But....what happens when my computer goes and I have to do a destructive restore? I have had to do this 4 times already on my computer. This is where my fear really is with all the photos.

What are xmp files?

I will check out Mozy and and the others mentioned.

----Mary

Hi Mary,

I perfer to use the native Windows backup solution. First because it is free, second it is easy to use. I do not know if it compresses the data or not. The application has been around since the old Windows NT days.

Please read the following article (http://www.microsoft.com/windowsxp/using/setup/learnmore/bott_03july14.mspx) for instructions on how to install the Windows XP backup utility plus there are instructions on how to backup files.

XMP files are created by Adobe Lightroom as a record of changes to the image file. These are kept alongside the actual image file.

If your photographs are kept on a different partition from the OS, they will be safe during a destructive installation. During the re-installation, just tell the system to use the existing C:\ partition.

I have had to rebuild the OS on servers that got hosed and the data files were safe because they were on a different partition. You have to be careful and read everything to make sure you're selecting the correct partition.

I hope this answers your questions.

Navy Moose

Dogdots

Oct-18-2007, 12:40 PM

NavyMoose

Oct-18-2007, 01:31 PM

Thanks Navymoose :D

When I am saving my photos to disc do I have to save the XMP files to? I somehow got XMP files along with my RAW and JPEG files when I downloaded them into Bridge (following my new CS3 book)---I can't get it open tho. It says it doesn't know the program that it came from.

----Mary

I would save the XMP files.

I'm not familiar with Bridge. I use Lightroom and CS3 in my workflow. LR creates XMP files, I do not know if Bridge does as well.

Have a great day :D

Navy Moose

Dogdots

Oct-18-2007, 06:56 PM

Navymoose,

Save the XMP files...ok....do I save them with the RAW pictures on the disc or on the JPEG disc? I have two seperate discs for each kind and don't know which photo this goes to. Dang, I don't even know what it is :scratch .

What is in the XMP file and why can't I open it into CS3? Is it something that doesn't open, but just is kinda like the and info thumb (don't know if that is the right term)?

----Mary

DavidTO

Oct-18-2007, 06:59 PM

You can't write data to RAW files like you can JPEG, so the XMP are the files that save your settings for RAW processing. So, save it with the RAWs.

Dogdots

Oct-18-2007, 07:14 PM

You can't write data to RAW files like you can JPEG, so the XMP are the files that save your settings for RAW processing. So, save it with the RAWs.

Hi,

Now that makes sense to me---they will go on the Raw disc:D

----Mary

wildviper

Oct-19-2007, 04:26 PM

Dogdots

Oct-19-2007, 04:50 PM

CAFields

Oct-19-2007, 07:23 PM

Now, I found out one more thing....one copy I made to my HD had some corrupted files. I found that out by mistake. I had a photo I needed and by mistake I tried to open it from the backup drive. It wouldn't open.

Sooooo, another word of caution: Check your backups after you copy them. They may have gotten corrupted during transfer.
A few thoughts:

If a backup program such as Nero Backup that comes with the Nero Suite is used, then it has the option to verify your files after performing the backup, which will tell instantly if a file was corrupted in the backup process. (Reminder: don't use compression).

Some computers come bundled with Roxio which might have a similar backup utility, but I'm using Nero v.6 simply because it came as a software bundle with a DVD drive that I installed.

One note about Backup vs Archive: A backup is used for restoration in case of catasrophe, an archive is created for long term storage for the ability to access the data years from now. I personally perform all backups of my photos as if I intended to use them for archive storage (hence the no-compression use). That way I'm covered in all directions just in case I need to access the photos years from now or in case my HD dies tomorrow. Lately I've been keeping a separate USB HD for each year's photos archive and also 2 DVD sets of the same archives.

The advice in a previous post to place all photos on a separate partition is good advice in case the OS needs to be re-installed. I personally have a second IDE HD inside my computer that holds photos and important data only, and the primary C: drive is for the OS and programs only, so that I can "nuke" (format) the whole drive or replace it in case of failure, virus, etc. without having to sweat about the photos and data.

C.A.Fields

http://cafields.com

Dogdots

Oct-19-2007, 08:08 PM

CAFields

Oct-19-2007, 08:48 PM

CAFIELDS: How do you do it with out compression? That I know nothing about.

When you copy them to DVD is there compression? Or external? Or do you have to set something first so it does not compress?
I use Nero Backup for archiving to DVD and there's a check box in the preferences section of that program that allows writing with no compression which then preserves the original file and directory structure (when writing to DVD's).

After writing my previous post, I decided to check Nero to see if it will create an archive to the HD without compression while creating a directory structure with files and it will not (but it will to DVD's). So now I remember why I began using SyncBack to write my archives to the HD, as SyncBack copies files and folders to the HD which is what I require for an archive. I also checked Win2000's built in backup, Stomp Backup MY PC and a freeware backup pgm, and none of them will create the archive on the backup HD with the original directory structure. They all write a huge file to the HD with a .QIC or similar extension which means that to restore a file it must be extracted from the .QIC file with the backup program during a restore procedure. This is OK for a backup, but not good IMHO for a long term storage archive.

I also did a real quick check of SyncToy and could not find anything about verifiying the files after copying. (It might have a verify option that I couldn't find so someone else might have some info). I dug into the SyncBack options and found that it does have an option to verify the files after copying (which I did NOT have checked!!) (It is now)! :dunno.

Please pardon the long winded reply to your post, but I'm using the opportunity to update my previous post.

The bottom line for me personally at this point in time is Nero with the "do not compress" option checked for DVD's and SyncBack with the verify option checked for HD archives.

C.A.Fields

http://cafields.com

NavyMoose

Oct-20-2007, 07:58 AM

The native Windows backup utility has a "verify" feature. :D

CAFields

Oct-20-2007, 08:24 AM

The native Windows backup utility has a "verify" feature. :D

Very true, and the native Windows backup utility is great for backups in case of disaster. Unfortunately for me it won't copy the files using the standard file and directory structure as if it were simply cutting and pasting. That's what I need for a long term archive as opposed to a backup, so a utility like SyncBack (or other comparable utility) is the solution that I personally use for archives on HD and Nero for the DVD's.

I gave up on the native Windows backup in the Win2000 days and haven't even looked at the one with XP or Vista, so I might be all wrong with the later versions. I always reserve the right to be wrong :D.

BTW, I like the advice you've given in this thread. :thumb

C.A.Fields

http://cafields.com

Dogdots

Oct-20-2007, 08:52 AM

Thanks to both of you Navymoose and CAFields. You have given me good information that I understand :D

----Mary

NavyMoose

Oct-20-2007, 01:12 PM

Thanks to both of you Navymoose and CAFields. You have given me good information that I understand :D

----Mary

You're welcome. I enjoy helping people with problems like this. I've got a lot of years in the IT field and this stuff is easy to help people with.

NavyMoose

Oct-20-2007, 01:14 PM

Very true, and the native Windows backup utility is great for backups in case of disaster. Unfortunately for me it won't copy the files using the standard file and directory structure as if it were simply cutting and pasting. That's what I need for a long term archive as opposed to a backup, so a utility like SyncBack (or other comparable utility) is the solution that I personally use for archives on HD and Nero for the DVD's.

I gave up on the native Windows backup in the Win2000 days and haven't even looked at the one with XP or Vista, so I might be all wrong with the later versions. I always reserve the right to be wrong :D.

BTW, I like the advice you've given in this thread. :thumb

C.A.Fields

http://cafields.com

I was introduced to the Windows backup utility by my old boss for quick and dirty backups. Helping people who want to learn is fun. I did help desk like most IT people and it certainly teaches you patience and how to explain things :rofl

Dogdots

Oct-20-2007, 01:27 PM

I looked at the sites for Nero and Syncback.

Can Nero copy files from the desktop or from Bridge? Or will I need Lightroom to use it?

And for Syncback, does that work with any HD?

Also why can't Nero work to transfer your files over to an HD or is it just a "copy to disc' software?

I hope I got these questions right :D

-----Mary

nipprdog

Oct-27-2007, 03:49 AM

Also, smugmug account has a lot of them..but smugmug doesn't keep my originals as originals...they do some modification.

Could you please explain that?

Thanks.

ivar

Oct-27-2007, 03:55 AM

Also, smugmug account has a lot of them..but smugmug doesn't keep my originals as originals...they do some modification.We don't touch your originals, unless you upload them in a non-sRGB colorspace. See: http://www.smugmug.com/help/srgb-versus-adobe-rgb-1998

CAFields

Oct-28-2007, 03:52 PM

Sorry about the long delay in replying to your questions, as I've just returned from the Oregon Coast and Silver Falls State Park, two very awesome places :thumb

Can Nero copy files from the desktop or from Bridge? Or will I need Lightroom to use it?
Nero copies files independently of all other programs similar to the way Windows Explorer copies files and folders independently. You don't run it from within a program like Lightroom or Bridge, but it's a program that you start up by itself and then it does it's thing.

And for Syncback, does that work with any HD? I believe it does. I'm using it with an internal HD and also a USB HD.

Also why can't Nero work to transfer your files over to an HD or is it just a "copy to disc' software?Before replying here I did a few tests and I found that in Nero v 6 (the version I'm using), if I choose "no compression" and "select Target" during the backup creation process I was able to specify a folder on my hard drive for Nero to place the resulting backup into. In doing so, Nero then performed a backup re-creating the file and directory structure which could be viewed and copied, etc. using Windows Explorer, just the same as SyncBack does. :clap That now changes my opinion of using Nero for HD to HD file archives, as it will do the job the way I personally prefer.

SyncBack, however has many very advanced syncronization functions, which is a whole topic of it's own.

Dogdots

Oct-28-2007, 08:15 PM

Sorry about the long delay in replying to your questions, as I've just returned from the Oregon Coast and Silver Falls State Park, two very awesome places :thumb

Nero copies files independently of all other programs similar to the way Windows Explorer copies files and folders independently. You don't run it from within a program like Lightroom or Bridge, but it's a program that you start up by itself and then it does it's thing.

I believe it does. I'm using it with an internal HD and also a USB HD.

Before replying here I did a few tests and I found that in Nero v 6 (the version I'm using), if I choose "no compression" and "select Target" during the backup creation process I was able to specify a folder on my hard drive for Nero to place the resulting backup into. In doing so, Nero then performed a backup re-creating the file and directory structure which could be viewed and copied, etc. using Windows Explorer, just the same as SyncBack does. :clap That now changes my opinion of using Nero for HD to HD file archives, as it will do the job the way I personally prefer.

SyncBack, however has many very advanced syncronization functions, which is a whole topic of it's own.

Hi.....

Thanks for all your information. It is very helpful and will certainly help me in setting up my backup fuctions. Nero sounds pretty easy to use. I was checking it out and seeing if I had the ability to learn it :D

Oregon---must be nice :D I have never been there, but hope to get there one day. If I ever head that far west its always to California. Love it there. I'm glad to hear you had a good time and I bet you took a lot of beautiful pictures.

Thanks again :D -----Mary

jasonstone

Oct-29-2007, 12:13 PM

We don't touch your originals, unless you upload them in a non-sRGB colorspace. See: http://www.smugmug.com/help/srgb-versus-adobe-rgb-1998

phew that scared teh crap out of me!!!

my backup method is not perfect but...

internal 160GB drive - backup photos and movies to 2 X 1TB external drives
1 should be off-site but I'm now working at home - so that's not really happening at the moment

i also am sending all my keeper photos in full size resolution to smugmug - sRGB colour space - so that's another backup

i'm paranoid about losing my photos and movies of the kids!!!

have to setup an incremental backup to my airport drive (network drive) too - might just go do that now i think....

you can never have enough backups and the most important thing is to have the backups in different locations! oh and do it regularly!

cheers all
Jase

Giphsub

Oct-30-2007, 07:05 AM

Are there any free programs that I can use for mac to backup in non-compressed format to DVD? Is there a program in tiger that will do this?

Rhuarc

Oct-30-2007, 07:45 AM

Does anyone trust the archival gold DVD's from either Kodak or Memorz for backups? Supposedly they have a 100 year life. Not that that would be my only backup...

claudermilk

Oct-30-2007, 09:13 AM

You knew I was going to pipe up. :wink While I haven't used those specific ones, after my unhappy experience, I don't believe those 100 year claims. I don't trust any burnable optical media now.

Rhuarc

Oct-30-2007, 09:48 AM

You knew I was going to pipe up. :wink While I haven't used those specific ones, after my unhappy experience, I don't believe those 100 year claims. I don't trust any burnable optical media now.

LoL, yeah I know what you mean, but I figure if I am using it as my last resort backup (I think the DVD backup makes backup #5 for me!) then it is ok!

jasonstone

Oct-31-2007, 02:01 AM

Are there any free programs that I can use for mac to backup in non-compressed format to DVD? Is there a program in tiger that will do this?

well i must admit I have Toast Titanium but...

it's supported out of the box in OS X.

Check out this apple page:
http://docs.info.apple.com/article.html?artnum=42663

hope that helps

Cheers
Jase

Rhuarc

Oct-31-2007, 06:37 AM

I'll just go ahead and put in a plug for the backup program I use. It is called Fileback

http://www.maxoutput.com/FileBack/

As far as I can tell from the site it is only available for Windows, so that is a bit of a downer. But if you happen to be on a Windows machine the level of customization it gives to you is insane! It took me 2 hours to go through al the options and verify each and every setting for my automatic backups. I love it!

Giphsub

Nov-01-2007, 02:16 AM

well i must admit I have Toast Titanium but...

it's supported out of the box in OS X.

Check out this apple page:
http://docs.info.apple.com/article.html?artnum=42663

hope that helps

Cheers
Jase

Thanks for that Jase. I think I tried that and for whatever reason it didn't burn. Probably me doing something wrong! Anyway, I went to the opensource page and got Burn. Did the job for me no worries :thumb I'm just not sure if it is compressing my files or not. I think it isn't, but can't be certain.

Scott_T

Nov-05-2007, 11:58 AM

Good thread. It is easy to become complacient with you images, especially if you've never had a failure...

I'm a long time IT guy...So like contractors who do little home remodeling or auto-mechanics who hate to change their own oil, I hate doing IT type stuff at home.

I have about 400GB of images. It is uneildy and my own fault. I tend to keep every image...I recently started to 'star' images in Adobe Bridge, so I can delete the 'unstarred' photos, but don't have the heart to hit the delete key.

My strategy to deal with this volume of data is this.

I have an external NAS device. It is a harddrive plugged into my home network. It is a raid 5 disk array. Not the fastest thing, but what raid does is write the data across, in my case 4 disk drives. So loss of any one drive does not impact my data...But if I loose a second drive I loose it all. That Nas device is on a battery backup to prevent against electrical surges, power outages, etc....

I then periodically dump that entire NAS drive to another external 1TB disk drive. That drive should be stored off site...

Next step is to get a second external drive and rotate the 2 for backups. Then I will have 3 copies of everything. 1. Raid 5 nas. 2. First external disk 3. second external disk...

This could be improved, but really it is about as good as I plan to get from a practical standpoint.

I would like to start deleting all my mediocre shots as mentioned via Adobe Bridge and deleting the images without ratings(stars). Then I would certainly use an online service like Mozy. I may even set that up just to have another automated backup for some subset of my images.

Bottom line, multiple copies stored in different locations is key.

Scott

jasonstone

Nov-05-2007, 11:59 PM

I would like to start deleting all my mediocre shots as mentioned via Adobe Bridge and deleting the images without ratings(stars). Then I would certainly use an online service like Mozy. I may even set that up just to have another automated backup for some subset of my images.

Bottom line, multiple copies stored in different locations is key.
Scott

Isn't smugmug a sufficent online backup?
Unlimited space, sRGB means original is not tampered with by smugmug, and they have 3 offsite storage backup locations.

That's one of the reasons I have my smugmug acccount - am I missing something? :scratch

I hope not! :wink

Cheers
Jase

Foochar

Nov-06-2007, 04:11 AM

Isn't smugmug a sufficent online backup?
Unlimited space, sRGB means original is not tampered with by smugmug, and they have 3 offsite storage backup locations.

That's one of the reasons I have my smugmug acccount - am I missing something? :scratch

I hope not! :wink

Cheers
Jase

Smugmug is great for online backup if you only have jpgs (and gifs and pngs). If you have made the jump to shooting in RAW. then you need to consider how serious the loss of those RAW files would be. The same goes if you like to keep PSD files around for images that you have done substantial work on in photoshop.

Art Scott

Nov-06-2007, 05:51 AM

Does anyone trust the archival gold DVD's from either Kodak or Memorz for backups? Supposedly they have a 100 year life. Not that that would be my only backup...

I would contact both of those vendors and ask who makes the disks for them.....I have over 5yrs of experience with Mitsui (Mam-A out of the Denver Area) Gold CD's and those have never failed me yet, realizing that so far 99.999% of them are Music (recorded while working for Wichita State as the Performance Facilities Mgr), they have never given me an error code....it was due to the claims that we (WSU PF started using them over sony or any other silver / blue no matter the brand disks, I have some that are scratched to high heaven and still play.......personally I would trust them .....due to the fact that at one time they (MAM-A) was the only Mfg'r of the truly Gold Disk....and by tuly gold I mean that was not gold ink or paint or dye....it is a thin layer of 24Kt gold foil..........

Just me .0000002 cent worth. :D

dlacouture

Nov-06-2007, 06:02 AM

After giving a lot of thought into this problem, my brother developped a little application that will catalog several disks, and sync them (until now, nothing new, you'll say!) USING ANOTHER MEDIA (tadaaaa!)...

What this means is that you don't have to physically plug your disks on the same PC (or MAC, this is a Python app!), in order to sync them!

Through this app, I use one main 500Go external HD located at my home, one 250Go external HD backup at work, and also have a copy of the Jpegs only on my computer's HD (for my wife who don't bother with DNGs).
And all this is synced through a 4Go USB key.

WorkFlow:

I download my pics at my work, do basic editing, tagging, and so on (yep, I got a very interesting job!).
I plug the backup HD (kept in a drawer otherwise), add the new files, then use the sync app. It will copy only out-of-sync files from this disk on my 4Go key.
Back at home, I plug the key, and launch the Main sync. It will update my external 500Go HD (that I usually keep stored in a closet).
I carefully put back my HD in its closet...
I then launch the JPeg sync.This ensures that my 2 drives are never used on the same PC (this also keep me from nasty viruses, BTW), thus lessening the chances of having both going down at the same time.

jasonstone

Nov-06-2007, 06:14 AM

Smugmug is great for online backup if you only have jpgs (and gifs and pngs). If you have made the jump to shooting in RAW. then you need to consider how serious the loss of those RAW files would be. The same goes if you like to keep PSD files around for images that you have done substantial work on in photoshop.

Ah ok, I am shooting JPG and RAW (Nikon D80) but am happy if in an emergency I only have the JPGs as I'm anyway 99% just using JPG out of the camera

It's simply a question of time - I don't have any!!! :dunno

Seriously - with 2 small kids, both my wife and myself working full time, travelling for fun and travelling for work - well 24hrs in a day just isn't enough!!! :rolleyes

Stll life is certainly fast paced :thumb

Cheers
Jase

wildviper

Nov-06-2007, 01:10 PM

Giphsub

Nov-06-2007, 04:56 PM

it just means smugmug has renamed it, but not necessarily changed anything in the pic itself. I seem to remember someone voicing a similar concern elsewhere, and Andy replying that nothing gets altered.:thumb

ivar

Nov-07-2007, 12:07 AM

I must be missing something here. I think Smugmug does change your file. For example, when I upload a picture to my gallery (a jpeg), how can I get that same jpeg back to my computer?

By right clicking and "saving"...well then it has changed the name of my file to some wierd number. Doesn't this mean something has changed?

I do not have a pro account..is this a feature of the pro account only?We give each image an ID, for our database. It takes away all the problems with filenames that have identical names for one.

When you use the 'save photo' link we provide, the image should be saved as "<imageID>_<originalname>.<originalextension>"

I believe that albumFetcher (http://www.dgrin.com/showthread.php?t=47160) saves the images with the original filename.

Either way, like i said before, the image itself does not get touched by us, unless you upload them in a non-sRGB colorspace. See: http://www.smugmug.com/help/srgb-versus-adobe-rgb-1998

Cheers,