Taking the pain out of ad-hoc testing

This post is more of a public service announcement. Prior to Tilt to Live’s Game Center/Retina update we wanted to extensively test the game with a wider tester base. So we ran a small ‘open beta’ (as open as Apple’s ad-hoc program would allow us). Prior to iOS 4.0 users had to do a cumbersome dance to get an ad-hoc game on their devices. And by cumbersome, I mean anything dealing with the desktop iTunes client. There was a lot of room for error, and for those (like me) that loathe syncing with iTunes, it creates a barrier because the act of adding an ad-hoc pretty much wipes my personal device since I buy all my apps 100% on the device and never sync.

Enter iOS 4.0. I discovered this tidbit on Twitter one day. Sadly, I can’t recall who tweeted or retweeted it, but thanks!

With the new iPhone iOS 4, you can distribute apps wirelessly without iTunes intervention. You still need to collect the appropriate devices id’s and create the appropriate provisioning profiles but if you already have those sending out files is easy.

The benefit? Oh where to start? Your testers no longer need to be tethered to a desktop to actually test your app! Our beta e-mails contains direct links to the provisioning and ipa file. The user simply has to tap on both and the game installs over the air! It’s almost easier than buying an app on the app store. The barrier to beta testing has been dramatically lowered because of just this one feature. You can almost coin it as ‘one-click beta installs’. It’s good stuff.

The other upshot? You get more feedback. Some beta testers may simply be out and about and won’t remember to connect to their iTunes client when they return home for the day. We had a lot more responses this go around and even some quick back and forth e-mail discussions as people installed, played, and replied all in one sitting.

Another good thing is we were able to get some ‘field data’ on our Game Center implementation. I would imagine most people have wifi on their homes nowadays. We were getting some feedback from some testers that were on EDGE or 3G that Game Center was causing a long ‘pause’ between games. This was something that didn’t turn up in our internal testing because we’re always on Wifi. Turning over to 3G to test still didn’t give me any hang ups. So just the knowledge that a good portion of people were getting a significantly slower response from GC prompted me to investigate better ways to mitigate this and ‘hide’ the response time delay so users weren’t met with an unresponsive UI.

Downsides? It’s a bit cumbersome to create a build for wireless distro as you’re required to do a ‘build and archive’ from XCode. I have an automated build process for the old-school ad-hoc way. I wish there was a way to automate this as well. I feel that there might be a way, but not sure if ‘build and archive’ is doing any magic behind the scenes. If anyone’s got any info on this or whether xcodebuild has some way of doing this all through the command line please let me know!

A quick guide to build a wireless distro game or app

1. Choose Build->Build and Archive

2. If it already isn’t open, open the Organizer window (window->Organizer) and choose ‘Archived Applications.

3. Highlight the build you just archived and click on “Share Application”

4. Select “Distribute for Enterprise”. The correct provisioning profile should be automatically selected. If not, correct it.

5. At this point you’re presented with a form (pictured below) that you need to fill out.

  • URL: You need to decide beforehand what the name of the ipa and the location on a webserver the file will reside at. For this example we’ll use ‘http://www.onemanleft.com/tilttotlive/Tilt_to_Live.ipa’
  • Title/Subtitle: self explanatory.
  • Large/Small image URL: not needed. But since I had this on hand I just put them in the same folder on the web server as the ipa file.

Now when you click ‘OK’ it will ask you to save the file. Be sure to save it as the same file name you gave it in the URL (in our previous example it was ‘Tilt_to_Live.ipa’).

Now upload both the ipa and plist file to the URL you put in the form. Drop the index.php file created by Jeffrey Sambells in this post to the directory you uploaded the IPA file and you’re good to go. This index file will generate the links for both the provisioning and ipa files.

Now any user that is in the provisioning profile can visit that link in safari on their device and download the app directly. Or more conveniently, you can just copy and those links into an e-mail :).

41 Responses

  1. Warren Merrifield Says:

    It won’t do everything you want here, but I’ve written a shell script that should perform a valid Build & Archive from the command line.

    I’ve got it hooked into CruiseControl.rb, and whilst it’s pretty hardcoded to my personal requirements, I’ve released it as a gist under the MIT Licence, so feel free to fork it and make improvements.

    https://gist.github.com/668002

    Let me know if it’s useful!

  2. Alex Says:

    @Warren Thanks for the script! I’ll definitely look into using it and seeing if I can automate the distribution packaging.

  3. Dad Says:

    I recently did this with a client and they were completely blown away at how much easier it was to install a developer build than previously. Recommended.

  4. Kniveswood Studios Says:

    Thanks for sharing this! Gonna be very useful for distributing to project clients as well.

  5. Leon Says:

    I’ve been doing recently a Ad-Hoc beta for the first time and many users said they didn’t test the app because it required them to sync their iPhone to the desktop iTunes.

    I wish I’d have known about the wireless ad hoc distribution 2 weeks ago :)

    Thank you for the post!

  6. HalfLucifer Says:

    Hello,

    I follow the intructions step by step but when I click on my ‘Install Application’ link, I did not get my app installed. It seems that the web browser doesn’t recognize ‘itms-services’ protocol in PC and iPhone.

    How did you fix the problem?
    Thanks.

  7. vdaubry Says:

    Hi,

    Interesting post !

    I found a way to automate ad-hoc distribution by packaging the app from the command line using the “xcrun” command, ‘i’ve written an article about this:

    http://blog.octo.com/en/automating-over-the-air-deployment-for-iphone/

    Please let me know if you found this usefull :)

    Bye,
    Vincent

  8. Alex Says:

    @vdaubry Thanks a lot for the heads up and the article. I’ll definitely be looking over this in a few days as I’ll be updating my build scripts, it looks like exactly what I was looking for :D.

  9. Micah Says:

    Awesome! A way to get the software to testers that is easier for them is great!

  10. Wireless Ad Hoc Distribution for iPhone Apps | Just2us Says:

    [...] Under Organizer window, select the archive app and select Share > Distribute for Enterprise. You will see this (screenshot from paradeofrain): [...]

  11. ShMarker.com Says:

    Parade of Rain » Blog Archive » Taking the pain out of ad-hoc testing…

    Thank you for submitting this cool story – Trackback from ShMarker.com…

  12. links for 2010-12-16 « Where Is All This Leading To? Says:

    [...] Parade of Rain » Blog Archive » Taking the pain out of ad-hoc testing (tags: iphone adhoc iphonedev development ios) [...]

  13. Fabrizio Giordano | Apple’s Best Kept Secret: Ad Hoc Installs for Testing Purposes Says:

    [...] a few developers have discovered the secret, documented in detail here. Now you may say that this isn’t a secret at all, but a well-known feature most developers [...]

  14. iOS Wireless Ad-hoc distribution | Adriel Blog Says:

    [...] http://www.paradeofrain.com/2010/11/taking-the-pain-out-of-ad-hoc-testing/ [...]

  15. zenchemical Says:

    Do you have to still build it with the Entitlements.plist setup, or does the archive supplant that process?

  16. Alex Says:

    @zemchemical Yes you still have to setup valid entitlements.

  17. Lindsey Says:

    I have tried this several times and for some reason the provisioning file I keep getting the error “cannot install profile, safari could not install a profile due to an unknown error.” – so clearly something is up with the provisioning file.. any more detail on how to do this correctly

  18. Mariano Says:

    Any luck doing this on the XCode 4 GM?

  19. Alex Says:

    @Mariano Haven’t given XCode 4 GM a try yet.

  20. shaxpear Says:

    hi am able to open the page but when i click on provisioning profile link, it says safari cannot download the file. I generated the provisioning profile in my developer account of apple and uploaded in the webserver.

    Any clue why this is happening?

  21. arlomedia Says:

    I think you should get into the habit of syncing your devices! This should not wipe the apps you purchased on your device … when I sync, iTunes asks me if I want to copy items purchased on the device back to my computer and I say yes. You might want to reset your alerts to make sure you see this option.

    One benefit of syncing is that iTunes backs up your device, including all your app data, contacts, etc. So if you lose or break your device, or just buy an upgrade, setting up a new device to match your old one is painless.

  22. How do you beta test an iphone app? - Programmers Goodies Says:

    [...] Answer: iOS 4.0 and later: Instructions on wirelessly distributing your application to beta testers. [...]

  23. foobar Says:

    Lindsey:
    shaxpear:

    I had the same problem. Once I put the correct provisioning profile on my server (the profile for distribution, with my device listed in it), it worked fine.

  24. petros Says:

    Could someone pls mail me the index.php created by Jeffrey Sambells because the site doesn’t exists anymore.

  25. iOS by mcgski - Pearltrees Says:

    [...] Parade of Rain » Blog Archive » Taking the pain out of ad-hoc testing So we ran a small ‘open beta’ (as open as Apple’s ad-hoc program would allow us). Prior to iOS 4.0 users had to do a cumbersome dance to get an ad-hoc game on their devices. And by cumbersome, I mean anything dealing with the desktop iTunes client. There was a lot of room for error, and for those (like me) that loathe syncing with iTunes, it creates a barrier because the act of adding an ad-hoc pretty much wipes my personal device since I buy all my apps 100% on the device and never sync. [...]

  26. igneus – genius » Blog Archive » iPhone OTA adhoc testing Says:

    [...] 之前让测试的人做iphone app的adhoc测试一直都是build一个app,让他们从itunes里面去同步安装到iphone里面的,直到看了这篇和这篇文章之后才发现原来用itunes同步这个方法好笨哦。。因为 With the new iPhone iOS 4, you can distribute apps wirelessly without iTunes intervention. You still need to collect the appropriate devices id’s and create the appropriate provisioning profiles but if you already have those sending out files is easy. [...]

  27. Atif Says:

    I am getting the error “Cannot connect to mydomain.com” when i am clicking on the link in iPhone browser. However i can browse my domain in iPhone browser. any help?

  28. reinvdo Says:

    I get ‘Cannot connect to domain-of-server’ when i click on the ‘Install Application’ link.

    anyone knows what i am doing wrong?

  29. Eamonn Says:

    I am being told it can’t connect to the website for both, so not sure if iOS 5 has broken this?

  30. Eamonn Says:

    My mac can’t get there, either – perhaps the web server is doing something freaky with the extensions?

  31. Eamonn Says:

    Webserver was causing problems, but when I ran it on a local server it finds the files OK – still won’t install, though. AGGGG

  32. Alex Says:

    For this ad-hoc testing, while I would spend the time troubleshooting it months ago, I think at this point you are *much* better off just using TestFlightApp.com. Let them deal with server-side issues and developers can focus on testing, getting feedback, and rolling out new builds quickly and painlessly. They even have an API if you want to have automated builds.

  33. Anonymous Says:

    [...] [...]

  34. How do you beta test an iphone app?(Resolved) - Tech Forum Network Says:

    [...] Answer: iOS 4.0 and later: Instructions on wirelessly distributing your application to beta testers. [...]

  35. David preston Says:

    Can this be automated using XCodeBuild rather than manually through Xcode?

  36. FlightApp: Developer’s Answer To iOS Ad Hoc Testing | D-Enabled Says:

    [...] started to change since 2011 (well, 2010 to be exact, but I only realize it then), with this and that article. Apparently since iOS 4.0,  developer can distribute app wirelessly [...]

  37. How do you beta test an iphone app? | Everyday I'm coding Says:

    [...] Answer: iOS 4.0 and later: Instructions on wirelessly distributing your application to beta testers. [...]

  38. How do you beta test an iphone app? - Tech Forum Network Says:

    [...] Answer: iOS 4.0 and later: Instructions on wirelessly distributing your application to beta testers. [...]

  39. XCode 4: Wireless iPhone/iPad app distribution (OTA) | TEchnical SOlutions Says:

    [...] http://www.paradeofrain.com/2010/11/taking-the-pain-out-of-ad-hoc-testing/ [...]

  40. How do you beta test an iphone app? - oneuptime | oneuptime Says:

    […] Answer: iOS 4.0 and later: Instructions on wirelessly distributing your application to beta testers. […]

  41. How do you beta test an iphone app? | Ask & Answers Says:

    […] Answer: iOS 4.0 and later: Instructions on wirelessly distributing your application to beta testers. […]

Leave a Comment