Broadersheet - News that matters. To you.

The Pains of iPhone Ad Hoc Beta Testing

View Comments 5 months, 12 days ago.

We have around 100 beta testers anticipating a new build of Broadersheet. I find the entire process terrible, both as an end user (no auto updates, clunky install) and as a developer (lack of crash logs, pain for users to encourage updates)

Initially when you first install the application, you've got to ensure you install the mobile provision, then the application.

When the mobile provision installs, don't expect a "it worked!" dialog, though.

Then you have to install the iPhone application - make sure you drag this to iTunes. If you're on windows it simply appears as a directory which you can navigate in and break. Make sure you copy the .app directory into iTunes.

Also, if you're using Windows Vista - make sure you don't use the built in extraction method if your files were compressed. It'll install okay, but not actually work (it'll say "this application could not be verified.") You've got to use  separate extractor eg: winzip.

Then, simply make sure you have set iTunes to actually sync your newly installed application, and off you go.

But if in the future you want to update your beta application to the latest build you've just been sent - make sure you delete the application from iTunes and the iPhone, and then do the above process (minus the .mobileprovision, usually) for the application. We've had it removing local settings too - which makes it hard to anticipate Apple Store upgrades. No auto update for you!

Don't forget that in order to get the beta you've got to dig up your UDID. Over 10% of our testers gave us the wrong number as their UDID.

So you've sent your beta invites out, now eagerly await those crash logs. Except that only works via iTunes Connect - eg: you have to be in the app store to get the crash logs, so you're left asking your users to dig in their file system for them.

But wait, you forgot to add your sister to the beta list - you'd better add her if you want a Christmas card this year. Good luck explaining the above process to her. You're probably thinking "she isn't a beta tester!" - you're right, but your beta testers probably aren't your target market, so how do you know if your product resonates with the user if they're all early adopters? Catch 22.