List Grid

Blogs Media Lab

Hacking The iPod

In my last post about using iPods for gallery tours with Art on Call, I talked about ordering serveral iPod Nano’s that we were going to load up and lend out to the public. I also mentioned how this had its own set of unique problems to overcome. That actually turned out to be a [...]

In my last post about using iPods for gallery tours with Art on Call, I talked about ordering serveral iPod Nano’s that we were going to load up and lend out to the public. I also mentioned how this had its own set of unique problems to overcome. That actually turned out to be a bit of an understatement.

Lending iPods out to patrons is much more involved than just the simple question of how you clean them, or avoiding theft (those items of business are handled by our Visitors Services department). In the New Media world, we care more about answering the question, “how do we make them easy to use?”

Ease of use really comes in two forms. One for the user of the device, and the other for those of us having to update the content on the device itself. When there are budgetary constraints, you’re always looking for the best bang for the buck, while not overly hindering the experience because of it. So what do we do?

The default iPod OS is not good enough.

When you’re using an iPod in a normal sense with MP3s as music, the tags for each song make sense, like artist, album, and genre. When you’re dealing with physical objects, the relationship doesn’t always make sense. Sure, Artist makes senes, but Album? What does that mean to someone looking for audio on “Spoonbridge and Cherry” who doesn’t know who the artist is? Where do they look with the default iPod interface? It’s obvious the iPod interface needs some changes to have it make a bit more sense for museum goers.

iPod Notes (aka “Museum Mode”)

Apple put a feature on the iPod called Notes, which is also referred to as “Museum Mode”. These are files you can put on the iPods data section that point to other files or audio. They’re very simplified HTML and allow you to basically customize the interface. You’re also able to default to “notes mode” so that you don’t see the normal iPod OS choices or are you able to fiddle with the iPod’s settings. Sounds like a great solution right? Well, almost.

One of the biggest problems with Notes is that it breaks the second rule of ease of use. Since they’re just flat HTML text files, creating the directory structure you want takes a lot of hand coding. Notes does not really take advantage of the ID3 tags in the MP3 files. While you can link to a list of songs in genre “X”, you can’t link to a list of all genres and go from there (and if you can, it’s not covered in Apple’s API docs). This means having to rewrite a lot of the basic functionality of the normal iPod through notes mode. It’s time consuming, and every update of audio means an update to the Notes files.

Even if this did work nicely there are other issues. One is that special characters don’t seem to render properly, if at all, in Notes mode, even with the correct text encodings set. The other for me was a real deal breaker. Half the reason to restrict users to Notes mode was to keep people out of the normal iPod OS. However, if you hold the Menu button down for 2 seconds (like you would to go from song info to the main menu in one click), it doesn’t go back to the Notes menu, it goes to the iPod menu! Imagine the confusion of someone holding the menu button down just a tad too long and now staring at a screen that looks nothing like they had seen before! Now we’re back to the same old problems we had in the beginning. So what do we do?

Hack the iPod

Before I tried Notes mode, I had thought about just hacking the iPod firmware to change the menu options in the OS. However, I figured “Museum Mode” would be much easier and then went that route. After my dissatisfaction with that, it was back to researching iPod hacks. This would prove to work well, with only a few drawbacks, and also allowed us to add something that we certainly could not do in Notes mode (at least not easily).

First things first, how do you hack an iPod? It’s actually a bit easier than it sounds, though not without a lot of risks. If you’re not confident with machine code, and don’t follow the directions to the letter you can easily turn your iPod into a 6oz paper weight.

That said, there is a great little program called iPod Wizard, that really helps in the process. The basic idea is you download the latest iPod firmware and load it into iPod Wizard. The Wizard helps you find and change various parts of the firmware, like text, fonts, even graphics. Once your changes are made you save the new firmware and then update your iPod with it. If all goes well you’ve just hacked your iPod and it works great!

The results

In our case we mostly just wanted to change the text. Remember how I said earlier how “Album” doesn’t make much sense in a museum audio tour? What if I changed it to “Artwork”? Then we’d have something people could relate to. We’d just have to make sure each artwork title was mapped into the Album ID3 tag in the MP3 and it would be seamless to the user. Do this for other tags, and you get the following, which is our new iPod interface:

Lets start at the top. “Art on Call” is now the name of the iPod. Next are Artist and Artwork, followed by Location which lists each gallery in the museum, and then Code, which is the Art on Call number code on an artwork. As you can see there are a number of ways to drill down to get to the same content, and it all uses the build in ID3 tagging of the MP3s. Just tag them correctly, upload them and they fall into place. Much easier to make sense of and update!

You may have also noticed “Walker Calendar” in the options. This was what I was talking about earlier in regards to extra features that would be hard or impossible to do in Notes mode. iPod allows you to sync with iCal, and we have already made an iCal feed of our online calendar. So why not put it in the iPod? Here’s what it looks like:

Calendar grid is on the left. The red flags represent days when events take place. Click on a day and get the list of events for that day followed by a detail of the event which is shown in the right image. The great thing about this is because it works with iCal, it’s an auto update. When you plug your iPod in it auto syncs with our calendar feed and updates as we recharge. There’s literally no work to do to add this feature on our part.

Lastly you see an “Information” item on the main menu. This is actually Notes mode. We’ll still use notes for things like info about Art on Call, or perhaps various other info we want to push there.

Downfalls

While this does sound nice there is one main downfall. While you can change the text of the items that appear on the OS, you can’t outright remove some of the options. For example, “Settings” always appears on the main menu, meaning anyone could go in and change them if they wanted. However this was also a possibility in Notes mode as well, given the problems I wrote above.

To try to solve this we used a bit of social engineering that will hopefully help at least keep a few people from mucking around in the options. One was to label Settings to “iPod Settings” to alert people that this is perhaps something they want to avoid. If they do happen to click on it though they’re greated with this message:

Most honest people will recognize the mistake at this point and back out. Those who really feel like fiddling of course can, though resetting the defaults is pretty easy and will be done after each iPod is brought back to the counter after use.

Overall this isn’t the greatest solution in the world, but I feel it works a lot better than the default OS menu or the Museum Mode. Time will tell how patrons feel about it, which is the only real thing that matters in the end. Hopefully we’ve covered our bases.

  • Peter Samis says:

    Brent, it sounds like you’ve really come up with a good solution here–the best of present worlds, if not all possible! :-) Are you principally thinking of users coming in and borrowing Nanos, or are you also putting the tagged files up for download from your website? In that case, you could advise people to search “Album” for “Artwork” and so on…or better yet, just tell them which of the MP3 Info fields on their own iPod maps to “Code” (the stop # posted by the artwork in the gallery) and they’re home free.

    It’s still a kluge. We could ask Apple to produce a “real” Museum Mode–the one you’ve created–for people that want to use their iPods for gallery tours. But that would necessitate their providing an alternate OS terminology, and the ability for users to switch between the two when going from music to art.

    Hardly likely! We might have a slightly better chance if we asked them to make your interface improvement available exclusively for museums dispensing hardware…

    Or maybe we should just pass your improvement around! ;-)

  • I have produced a FileMaker database that builds a simple database into a set of iPod notes, all nicely indexed and linked up. It also links automatically to an album in the music section, so record can have an associated sound and image (album cover). Used this way you can build a database of up to about 300 records – great for field guides and quick reference.

    The Notes linking system works really well, especially when your utility does the coding for you, but it would be soo cool to be able to link to the photo and video section. Is there anyone out there who has managed to hack the video or photo playlists yet?

    How is it that you can access the XML audio database, you can put audio files into video playlists, but you can’t get at the video playlists? Where are they?

  • Peter, the tagged files in this example is strictly for the Nano’s we pass out to patrons. For our podcast, we tag them differently. This is because we expect people to have other music on their own iPods, so we need a way to silo the MP3s into groups when there’s other music present. If we don’t, then all of the artists, or artwork get mixed in with all their other music, making it difficult to really find what you’re looking for.

    It’s not an ideal tagging solution but it’s something we have to be aware of. Since we don’t have that problem with the Nano’s, we can tag it a little better.

    As far as I “real” museum mode, there isn’t much change that I’d want. In fact, it would be very simple. Here’s a list of what my wish list would be:

    - Let me link to a tag list in Notes. For example, I can make a link to “ipod:music?genre=rock” which gives me a list of everything in the rock genre. But instead I want to do “ipod:music?genre” which gives me a list of every genre, using the ID3 tags like in the real iPod OS. Same for every other ID3 tag option.

    - Like the above, let me link to non music things as well, like Anatole posted. This way I can retain my Calendar stuff. I could link to “ipod:calendar?cal=walker” and it would go to the Walker calendar in the iPod OS. You could do the same for video or photos as well. This would help out a ton.

    - Make it harder to get to the default iPod OS interface. Holding the Menu button makes it too easy for someone to accidentally get out of it. Make it a code or something (Up, Down, Left, Right, Select for example). Something people won’t accidently stumble upon.

    - Let me list mp3s by other tags. For example, there’s no way to list by Year or Grouping, the same way you list by Artist or Album. Give me more options there, so I can use the ID3 tags in better ways.

    Basically, I would like to use Notes to build just the Main Menu, and then have it link to the iPod OS in the next screen and use the ID3 tagging structure from there. It’s little tweaks to what they already have and it would basically allow you to do exactly what I did but without hacking the iPod at all. In fact, it would be better because you could get rid of the iPod Settings menu option.

    If you’re able to pass these along to your friends at Apple that would be great. Adding all of this would basically be the ultimate Museum interface for me.

  • riemann says:

    so did anybody link to videos yet???

  • Erroll says:

    I recently purchased an iPOD nano. The hardware is nice but

    I am dissatisfied with the software. I like to listen to audio books rather than music. The itunes/ipod software slices and dices the titles requiring manual corrections. I am looking for a third party iPOD operating system that plays audio files

    from their windows compatible directories. I am testing anapod. Anapod does not seem to solve all problems at this point. If anyone can help please let me know.

  • sunrunner20 says:

    erroll: You need to import and convert the audio books to AAC. Its a relatively simple process and I have found it very useful by the fact that the ipod bookmarks the file so you start off where you left off.

    A detailed guide is available at Ipod Lounge

    http://forums.ilounge.com/showthread.php?s=&threadid=116700

  • The iPod lists the video podcasts along with the audio podcasts. I have tried everything to link to any of these files (audio or video) from the Notes as you can with the music files. However, still no success – has anyone else out there had any more luck with this?

    cheers – Tol

  • Carlos Lama says:

    Does anyone know of a Mac OS iPod hacking program that will work with 2nd generation Nano? I’m looking to replicate the method here, but iPod Wizard is Windows only, and doesn’t work with 2nd gen Nano to boot!