June 17 – Something You Are Working At
aka. Post 17 of Those 30 Posts in June Blog-Every-Day Posts
Practice makes perfect.
If you read this blog more often than I do, you probably don’t need a reminder that I kinda recently kicked off a daily photo project using a little daily assignment randomizer. You already know. You’ve been seeing the results and either shaking your head at the random pixels that are clogging up your browser or pondering your loyalty to this increasingly drivel-filled site.
For the benefit of years in the future when I’m reading this, that’s what I’m working on right now. Daily photos. A daily picture. An effort, every day, to get out a camera of some kind and snap a photo of some kind, to learn a new skill or practice an old skill or feel the crunch of a deadline of some kind.
Ideally this will make me a better photographer. I’ve been neglecting my expensive camera equipment for so long that some of the triggers that I had felt were narrowing so close to that bliss of being finely tuned, once long ago, ancient in my memory, those triggers are now rusty with disuse.
I used to revel in this. And I miss it.
So, more daily pics: for me as much as you.
Now, here are some bird pictures.
This particular bird is explained in a previous post.
I’ve been archiving photos. I have a lot.
I haven’t always been good at tracking all the pictures I’ve taken. But a while back, around the same time I bought my last desktop computer and actually had hard drive capacity to put them all in one place, I decided I wanted to give Picassa a try for managing my collection. Before that point I had little micro collections, and collections with a lot of overlap between them, on CD-Rs, DVD-Rs, external hard drives, internal drives, memory sticks, memory cards, and scattered across a collection of systems. Picassa didn’t force me to organize them, but I did at that time put in the effort of amalgamating the collections onto one drive on the new computer, a mega collection I’ve since diligently kept updated as my central collection.
That was step one.
A few weeks ago I started thinking about how I could backup, archive, and protect that collection. The thing is that when I do a quick ‘get info’ on the folder, there are currently one hundred and sixty gigabytes of data. One. Six. Zero. Followed by nine zeros. Or, about twenty DVDs worth of photos.
Online or cloud backup is not impossible, but there are limitations: simply transferring that much data to anywhere is time and resource intensive, not to mention that all that space would cost me significantly for remote hosting — or at least it isn’t going to be free. Couple that with the fact that 160GB of photos is roughly a hundred thousand files, and… well… data management issue.
I decided to simplify my problem using a three-fold approach.
Fold one… compress and zip. Most modern zip programs allow you to, through some clever and somewhat hidden options, create large zip files that break into parts. So on, say, my 2006 photos (which I was just working on and know the numbers offhand) a folder with 26GB of photos, I compress and break it into one zip file with 260 x 100MB parts. In the end of this effort I have one archive made up of two-hundred and sixty files — not compressed much because a lot of the files are JPGs and already compressed — rather than the eight-thousand or so files and folders I had before.
Fold two… parity file creation. A little trick I learned back in the days when I would occasionally download stuff from newsgroups was the parity file. A clever little program takes a collection of files — a set of zip-parts, for example — and analyzes them. The result is a collection of parity files — PAR files. The point parity files is that, if anything is damaged in storage or transfer of the original files, the information to restore everything back up to working order — with up to (default settings) 10% degradation of the originals — can be quickly done if you have parity files in their place. Don’t ask me about the math or science… it just works. But I’ve been taking my large collections of zip-parts, sub-dividing them into (max) 100-part groups, then creating 10% parity files based on those originals.
Fold three… multiple and scattered backups. When I’m done running all the little compressions and parity software, a process that will take hours and hours of CPU time before it’s done, I’ll have somewhere between 2000 files representing 180GB of data. The plan — as I’ve slowly started implementing already — is to create at least two copies of each of those files somewhere; maybe DVDs, maybe external drives, maybe scattered on a couple of cloud-services. If disaster every strikes and I lose my original Picassa folder, I find the parts to rebuild that collection. If some of those files are damaged, I look to the second backup. And if both copies of the backup are damaged, I rebuild it with the parity files.
It is an epic effort, but ten years of photography — and an ongoing plan for keeping future photos safe — is probably worth it.
Admittedly, my efforts in keeping my photo gallery up to date over the last month have been weak at best. Considering the lingering promise of new daily photos and a busy holiday season just passed, the sad reality remained: I just never got around to posting pictures. Well, I never got around to it until last night, that is…
Two collections await your curious eyes. We split our festive celebrations down the middle, spending the days leading up to Santa’s arrival with Karin’s family, while spending the days leading away from the occasion with mine. Those days all seemed to have blurred together into one big chocolate-coated smudge of fun and food, but the photo collections are discretely split down the middle for your viewing convenience. The first, a mash of semi-interesting pictures I managed to grab between the numerous distractions of playing host in our home. The second, as a less-busy guest at my folk’s place. Fewer distractions make for more interesting photos, you might notice.
Having just returned yesterday evening — flying both ways to avoid the uncertainty of early January weather — from a whirlwind trip to Northern Alberta where Karin’s cousin was wed, our mini-vacation netted another vast collection of photographs. Unlike past weddings where I tend to fall into that trap of pretending to be the wedding photographer, hauling along a half-dozen lenses and jumping into the action like a crazed shutter-bug — but not actually being paid to do so — this past weekend I concentrated on just snapping my own little collection of interesting things: people, colours, lights, and Claire (of course.) That’s why — while there are some pics of the couple — there are even more of the candy bar.