One other idea someone had mentioned afterward for running a local PyPI was to run a Squid proxy in front of PyPI and set a 1 year cache on everything. The more I think about, it's pretty ingenious and simple, versus running a full Python app.

If you have Journal installed with pip, you can

$ pip install -U journal

What's New

This version has been a long time coming, pulling in some patches from my friend Drew and changing how arguments passing to Journal are handled. Here is the official list:

• added support for multiple journals and journal locations
• added ~/.journalrc for storing default configurations of journals/locations
• changed argument handling to add all arguments to the same entry instead of splitting them up

In Detail

Multiple journals have been in the master branch for awhile, but never officially released. Likewise for multiple Journal locations. With the .journalrc now and the multiple locations, you can keep your journal files in Dropbox now and easily sync them across multiple computers. In the future, I am looking to use the Dropbox API to have this happen automatically maybe, or perhaps allow syncing with some sort of iPhone app.

The change to the argument handling was to done to make things easier for new users. I think this was one UX decision that I made wrong when releasing Journal originally:

v0.2.0
$ journal "one entry" "two entry"

v0.3.0
$ journal one large entry "and still part of first entry"
$ journal two entry

Allowing multiple entries at a time from one run of the program is cool and limits issues with single/double quotes, but a confusing because people aren't used to having to quote things by default. Overall, I think this is more Unix-y and simler to understand.

In The Future

Two things I'm looking at improving on are tests and long messages:

• I want to use a "fake FS" to limit be able to to unit test the features of Journal (something like this)
• Entering long messages from the command line using $EDITOR; journal edit or something, which opens your editor in with a temporary file and when you save/close that file, that entire file gets saved. Perhaps integrating with the clipboard as well, for autosaving snippets of things. Journal all the things!

Some of the Python talks began already, with Graham Dumpleton's "Web Server Bottlenecks And Performance Tuning" talk last night at the local Django/Python meetup and it was quite good. I'm expecting big things this PyCon!

My Schedule

Below is my tentative schedule after flipping through the schedule. Not to be a buzz kill, but this isn't SXSW, I'm ready to schedule and get as much learning as possible!

For Friday, having Paul Graham keynote should be quite interesting. After that, I'm planning on mostly staying on Track 4 for heavy low-level Python and then mixing it up.

• 10:50AM - Introduction to Metaclasses
• 11:30AM - The Art of Subclassing
• 12:10PM - Stop Writing Classes
• 1:45PM - The Magic of Metaprogramming
• 2:40PM - Interfaces and Python
• 3:20PM - Make Sure Your Programs Cras
• 5:20PM - Practicing Continuous Deployment

For Saturday, it's a better mix of topics, which seem more web related. I'm totally happy with that!

• 10:25AM - What you need to know about datetimes
• 11:05AM - Django Form Processing Deep Dive
• 11:45AM - Pragmatic Unicode, or, How do I stop the pain?
• 1:20PM - Coroutines, event loops, and the history of Python generators
• 2:15PM - RESTful APIs With Tastypie
• 2:55PM - Using fabric to standardize the development process

By Sunday, I think I will be happy to still be standing.

What I'm Looking To Takeaway

I'm really looking forward to chatting with main Python people to get thoughts on Python3 and packaging.

I have yet to fully port any of my libraries to Python3, but I have a few branches started.. I'm always curious for more people opinions on what's good and bad with Python3.

For packaging, I would love to see what I can do to improve things or see what people are working on with packaging. It seems like everything with packaging has caveats and is not as nice as RubyGems or CPAN and I want to fix that.

If you read my blog or follow me on twitter, send me a message, I'd love to meetup!

• Thanks to Pathogen, plugins can remain separate from your main configuration, which great decreases the friction of trying new plugins and keeping your existing plugins organized.
• Thanks to git, plugins have revision history and stable versions (tags).
• Thanks to github, plugins have easy and stable endpoints to install from, to get updates from, and to complain about for bugs. Additionally, forking makes it easy to fix bugs yourself or make any tweaks you want, while still keeping everything in git.
• Thanks to git submodules, you can store your list of installed vim plugins, update them when necessary, and share them between multiple machines.
• With vundle or vim-addon-manager, you can search and install new plugins, all from within vim.

The Theory

My dotfiles and vimrc have been in source control for years. I've always kept a selection of vim plugins in my dotfiles repo, specific versions of plugins that I know work together. Pathogen was an easy switch and made it much easier to try new plugins and figure out if a new plugin played well with my current configuration.

With git submodules and keeping everything in git, I've come to realize, you get all of that and more. Want to try a new plugin? Download it to your vim bundle directory and give it a try. Git status will show you that it's an untracked directory and you haven't added it your dotfiles yet. When you decide you like it, you can add it as a submodule and checkout version X, which you know works correctly with your system.

Want to try out the latest dev version? Is there even a newer version to try? Pull latest in that plugin's git repo and see if there are updates. If you like those updates, commit the latest version in the git submodules, otherwise reset everything to the last known working state.

Want to fix something in the plugin? Like some new features, but want to keep some of the old features? Fork the plugin, delete the official submodule from your dotfiles, and checkout your fork as a submodule. Everything can remain in git still.

The Practice

One of the best examples I've seen recently was a Stack Overflow question a few months back. Someone asked how to add highlighting to paired html tags. The answer was a simple plugin that added that exact functionality. Not source code or a link to a vim wiki, but a full plugin, that with the setup I just described, is a one-step process to try out.

I feel plugins have traditionally been complex things in vim, but by having this easy and module process available and understood, more cool plugins will be made. Looks like it's time to Learn Vimscript the Hard Way and start writing my own plugins now!

It's not all gloom and doom: having a local backup of your data is great for searching and viewing in ways that the original provider didn't think about. I think it's cool to be able see how emails I get year over year. A benefit of being in this day and age is that storage is cheap: storing everything you've ever created and done online is entirely possible.

What To Backup

I started out with emails and figuring out to organize things. I then moved onto email contacts, chat logs, Delicious bookmarks, and social site data. As of late, I've been working on receipts and finances, trying to move to toward existing entirely paper free! Here are some ideas, feel free to add suggestions in the comments.

• Email
• Contacts (from GMail, Facebook, or LinkedIn)
• Chatlogs (Adium)
• Bookmarks (Delicious, Pinboard)
• Social site data (Twitter, FB, LinkedIn, Google+, Reddit)
• Pictures (Flickr, Picasa)

How To Backup

Having a simple way to backup your data and having easy access to your data from a website is also another important social topic that has come up the last couple years. Having open APIs and an easy way to export your data is something you should look for and if a website doesn't have one, you should ask why not. Facebook didn't even have an export ability until the middle of 2010. Here some sites and tools that I've been using to help me:

• Google Mail: http://www.gmail-backup.com/ is my recommended tool for backing up GMail. Unfortunately it's closed source but the site has been around for years and the software has seemed reputable enough. It has a simple GUI or CLI interface that allows you to select date ranges to backup; all email from 2010, and it works for me.

  Once you download the 0.107 version, you can backup all 2011 email with a command like this: (you might need an app password if you have 2-step auth enabled)

  $ ./gmail-backup.sh backup email-2011 <EMAIL> <PASSWORD> 20110101 20111231

• Gmail Contacts: While logged into GMail, you can go to the Contacts window and export your contacts in multiple formats.

• All your Google data: Google is quite good about being open, but has a wide range of services, which don't all have the same ease of exportability. While logged in, go to https://plus.google.com/u/0/settings/exportdata and you should be able to backup your G+, Picasa, and most other data Google has on you.

• Adium is an open source OSX chat client which keeps XML logs of all your conversations, which includes your FB and GChat accounts if you have them enabled. All logs should be kept at ~/Library/Application Support/Adium 2.0/Users/Default/Logs. Since it's hard to pull out specific date ranged logs, I just back the whole log folder each year.

• Pinboard: I switched from Delicious this year and have been quite happy with Pinboard for my online bookmarking needs. To export, go to http://pinboard.in/export/

For most social sites, there is a lot of money in owning your data and every site has a different obtuse backup policy. My friend Jeremy has created a one stop shop for easily and safely backing up your data from FB, Twitter, LinkedIn, Gowalla, and Google+ which I would recommend: http://export.synack.me/

Another interesting idea for controlling your online data is what Greplin provides: simple instant search of all your online data. You can easily look across all of your data, although I don't think exporting that data is something they offer.

Final Thoughts

Once you have all this data, don't skimp on your own physical backups. Storing all of your financial and personal data unencrypted in one place is a hacker's dream. This is something I am still exploring: I use OSX's built-in DMG encryption, but that is not too portable.

Also look into Dropbox for having access to your data across all your machines or Backblaze for having a simple external backup of everything on your laptop.

What’s the coolest Python application, framework or library you have discovered in 2011?

Fabric. For a good six months of this year, I was managing everything server-wise at my last job through Fabric and learned a good deal about it, hacking in some features and giving a presentation on it at the local Pittsburgh users group. It's great to be able to automate things and to have that ability in Python.

What new programming technique did you learn in 2011?

I can't think of a specific area I focused on, but overall: I've broaden my knowledge of Python unit testing, deployment, and project packaging. I've also ben diving deep into background processing with Celery lately, which really interests me.

What’s the name of the open source project you contributed the most in 2011? What did you do?

Unfortunately, I don't think I have contributed back too much. Journal, a Python script for keeping a CLI journal, was probably my most complete project for the year, but I haven't been hacking on it recently. Reaching out more via Github and interacting more with other developers is my goal for next year.

What was the Python blog or website you read the most in 2011?

HackerNews. After moving to San Francisco, getting a job via the monthly job threads, and meeting up with people from the site, I've really come to enjoy the dialogue available on programming and Python.

What are the three top things you want to learn in 2012?

• Logging, metrics, and monitoring. Or applying the latest techniques and practices in production: using JSON for logged messages, realtime monitoring and alerting, longterm storage, indexing, and searching.
• A new language. I know a great deal about Python, but it's time to start fresh. Haskell has always been high on my list, but I've never set specific goals and forced myself to start anything. Time to change that.
• More Python? I've been diving into packaging once again, but maybe I should try and figure out how to help fix what I don't like about Python. I'm looking forward to attending PyCon US 2012 this year, hoping to get some great ideas.

What are the top software, app or lib you wish someone would write in 2012?

Unify/fix Python packaging? More Python3 releases? I still need to convert all my scripts to Python3. I have a bunch of Github improvements I'd love see happen, but maybe with the v3 API I can hack them in myself.

Want to do your own list? Here’s how:

• copy-paste the questions and answer to them in your blog
• tweet it with the #2012pythonmeme hashtag

Design For Hackers
David Kadavy
ISBN: 1119998956

What’s The Point?

Design, layout, fonts, and color theory for websites and web applications. Kadavy covers all the main points of design, how design affects how we use things, and through understanding your design decisions, how you can make better decisions.

How Was It?

A useful and interesting read! The hacker in me likes well organized and straightforward things. Each of the main elements of design were given a chapter and covered thoroughly: what they are, how they work and why they exist in a historical context. There were plenty of visual examples that were current and useful.

Typography and fonts were given special preference, given the importance and history, and a practical guide for using them in most situations was given in an appendix.

Who Should Read It?

Programmers and hackers new to the topic. As an overall guide to design, it's a great starting point and covers the bases, but is not a detailed guide on any topic.

Notes:

I met the author through a GrubWithUs group meal. He was using group meals as a kind of book tour and it was an interesting experience to eat and discuss the book together! I also got my copy signed!

What's new in 1.0?

• Android Notifications of your usage via Notify My Android
• The ability to easily run the script on Heroku instead of your own server
• Now using standard config.ini configuration for your Comcast username/password

What's already there; what is this script?

• A simple way to scrape your current bandwidth usage from Comcast's website with the ability to specific warn you if are coming close to the 250GB soft limit

Download 1.0 now (zip).

Upgrading

If you have already been running script, it might be easiest to download the 1.0 and re-enter your Comcast login into the config.ini. The previous method of editing the script itself was pretty bad and left a lot of room for errors with source control.

Android Notifications

With commits from Adalan, you can now add your API key from Notify My Android and will be able to get your usage notifications via a push notification to your phone.

Attach the -a flag when running the script to enable these notifications.

Running On Heroku

This is a unique feature of the script, but was an idea I wanted to try: not everyone has a server running 24x7 or a place where they can easily run Python scripts like this daily.

With Heroku's new Cedar stack, while oriented for running web applications, you can run any Python script on a daily schedule for free. It took a bit of hacking detailed here, but wasn't impossible.

See the HEROKU_USAGE.markdown document and try running the script on Heroku!

Until bandwidth limits disappear, enjoy the script!

This repo is my attempt that.

Overall, I definitely accomplished what I set out to do! I've been very impressed with Heroku's Cedar stack and how flexible it is. It's awesome being able to script the creation of an enviroment and instantly see if my script is working or not.

With that repo, you can basically use Heroku as a free cron running system you control. The whole stack is free and if you just have to run something once a day, that's still free. If you don't have a VPS or a server running 24x7, you can now push stuff onto Heroku and not have to worry about keeping it online, it will just work.

I found an article through HackerNews recently that, while quite old, still seemed quite relevent and impressed me greatly: "You and Your Research," a transcription of a talk given by Richard Hamming in 1986, the year I was born.

Of the many great quotes and ideas in his talk, this stood out to me:

"You should do your job in such a fashion that others can build on top of it"

That is the best way to describe my goal for this blog, along with the code in my github repos. It's time to accomplish great things.