US Analysts Predict a Rapid Migration to Mobile

10 05 2013

graphOver the last 5 years since 2007, we have seen an explosion in mobile apps to make our lives convenient and more efficient. And it appears there is no letting up. Recently, Forrester Research noted that there are now 7.3 billion mobile devices in a world where there are only 7 billion people.

“Mobile applications in the Enterprise may be a future vision for many companies, but mobile is a vision that is being realized much quicker than many had expected.  What does the rise of mobile mean for the enterprise?

The global Enterprise Mobility (EM) market is expected to grow annually by 15 percent every year, eventually reaching $140 billion by 2020. By 2020 roughly 10-12 percent of the enterprise IT budgets will be spent on mobility, compared to less than 5 percent today. These numbers are based on a report by Nasscom in association with Deloitte.

Similarly,IDC is predicting that the biggest driver for new IT spending this year will be smart mobile devices, which include smartphones, tablets and eReaders. IDC expects that this segment will grow 20 percent and generate 57 percent of the IT industry’s total growth.

Industries where there are many customer interactions, like in banking, insurance and retail are seeing higher rates of Enterprise Mobile adoption. Mobile adoption is expected to also increase in government, healthcare and media.

The move to mobile is being fueled by mobile developers turning out applications for their businesses. Frost and Sullivan report that 82 percent of large North American businesses have already developed mobile apps for their employees. AndGartner is predicting that among in-house development projects, those that target smartphones and tablets will soon outnumber native PC projects by a ratio of 4-to-1.” says Dick Weisinger of formtek.com.

Testing is critical in this process





Results from the DeviceAnywhere Test Center Customer Survey

12 04 2013

A few months ago Keynote sent out a survey to our DeviceAnywhere customers and we wanted to share some of the results.

The survey first asked a few demographic questions “What is your role in your company?”.

Tcdsurveyblog1It’s somewhat surprising that only about half of users are in QA.   More developers and product/project managers were using our product than expected. Also interesting were the “Other” responses—mostly because they indicate that this was a poorly worded question! Many of these responses were “Manager/Director/VP of Engineering/QA.” The word “role” was interpreted as job title, when it was intended to mean functional area. That’s one of the good and bad things about surveys – when you get the question wrong you don’t get the best results, but it’s also very easy to identify sub-optimal questions so you can improve them for the next time.

The survey also asked users “What type of mobile products do you test using DeviceAnywhere?” and allowed multiple answers.

Tcdsurveyblog3
It’s interesting to see such a high % of customers testing Websites, where in the past Native and Hybrid Apps has been the most popular responses for our product.  It does highlight the priority that companies are placing on providing quality mobile optimized versions of their websites. Here’s a good reason why in this quote from a Forbes article: “Two-thirds of smartphone users say a mobile-friendly site makes them more likely to buy a company’s product or service.” You can see the full article here.

Now perhaps the most important question in the survey – we asked about 5 device dimensions, including Reliability (do the devices work as expected), Cleanliness (do the devices have evidence of past use), Speed (interaction with the devices), Availability (are the devices available when you want to use them, and not offline or busy) and Model Availability (do we offer the device models you need). Users were asked to rank the importance of improving each of those dimensions. The chart below shows how many respondents said a given dimension was the most important to improve.

Tcdsurveyblog4
The only surprise here is that so few respondents said Cleanliness was the most important item to improve. However, in thinking about this, it makes sense. Getting on a cluttered device is a big annoyance; however, it will not completely block testing, unlike just not having the model you need. So, this is not an endorsement of “dirty devices”—we are still working on improving the cleanup process! However, it does mean that Keynote needs to place a very high focus on the other items on the list, most important of which are device interaction speed and new model availability. We are in various stages of working on all of the above items, and future blog posts will have more details once we are closer to making improvements available.

Thanks to everyone who gave us their feedback; this information is invaluable to the product, engineering, and operations teams in helping us prioritize efforts that will provide the biggest benefit to our customers. We always want to hear from our customers, so please either respond to this post or send us an email anytime at products@keynote.com.





Cross-platform App Development Frameworks: An Aspirin for Developer Headaches

12 04 2013

mobile-appsOne of the biggest challenges facing enterprise mobile app developers today is designing and developing apps across multiple platforms. In 2011-12, having a mobile strategy was imperative as the “consumerization of IT” and “BYOD” trends pervaded. As a result, enterprises now must shift their mobile strategies to support multiple mobile devices and platforms or else, lose the power to manage all the various devices within their environment.

Some companies can focus on developing apps for just one device type or mobile OS if the devices were company-issued, but this is becoming less and less the case. Businesses and brands must support more than one device or risk backlash from select employees for not supporting their non-supported devices. Keep in mind – as prevalent as the iPhone seems to be, Android has been caught up in popularity.

Cross-platform app development frameworks are becoming critical tools for developers because they’re designed to lessen the time and resources that developers or development teams has to allocate to creating apps for iOS, Android, BlackBerry, Windows Phone and beyond. By not spending excess time and effort creating apps to apply for different devices and mobile OSs, they can focus on what matters most – end user experience.

However, since each cross-platform development tool is unique and exhibits diverse features, capabilities and behaviors, developers will face increased challenges and opportunities designing successful device- and OS-agnostic mobile apps.

I recently spoke on a panel at Mobile+Web DevCon and my fellow panelists and I got into a discussion about the pros and cons of using cross-platform app development frameworks.

The Pros:

  • Reuseable Codes: Rather than having to write the specific action or sequence for each platform, a developer can just write the code once and then reuse those bits in later projects or on other platforms.
  • Plugins: Most cross-development frameworks offer easy access to plugins and modules that can easily integrate with other services and tools.
  • Easy for Web Developers: Most cross-platform frameworks are dynamic and simple for web developers to jump in and use, because many of these frameworks support HTML5 and CSS3.
  • Reduced Development Costs: This is perhaps the biggest advantage because it allows companies and brands to get an app onto other platforms without having to invest in a separate developer or team.
  • Support for Enterprise and Cloud Services: In addition to plugins and modules for specific functions, most frameworks also have the option to directly integrate with cloud services, including Salesforce.com, AWS, Box.net and others.
  • Easy Deployment: Deploying apps is much faster in a cross-platform scenario because it’s easier to incorporate one development code onto multiple devices. This is especially true with many of the new cloud-based tools that various frameworks are starting to push out.

The Cons:

  • The Framework Might Not Support Every Feature of an OS or Device: If, for example, Google, Apple or Microsoft adds a new feature, the framework being used will need to be updated to support those new functionalities.
  • You Can’t Always Use Your Own Tools: Most frameworks want users to use their own development tools and suites, and that can mean that a developer has to forgo his or her own preferences and use something else, even something unfamiliar.
  • Code Might Not Run as Fast: The cross-compilation process can sometimes be slower because it may take longer to load than native tools.
  • High-End Graphics and 3D Support is Often Limited: Fortunately, game-centric development platforms, like Unity, are here to help fill in those gaps.

When considering the pros and cons of app development, Josh Clark, Interaction Design guru, states that app design is one of the major factors cross-platform developers need to be aware of — whether they use a framework or not. Designing an app for the iPhone is different than designing one for a tablet; the UI and UX conventions are different, and touch points and menus work in different ways.

In addition to app design, it’s also important to factor in who the app is being developed for. This pertains to anything from the mobile web apps to e-publications to native apps.

Certainly a couple of years back, developers could quite safely shoot for iOS first, think about Android later and ignore everything else. Now, there are many more options, and although its pros and cons are almost equivalent in nature, taking a cross-platform approach to mobile app design and development appears to be the wave of the future for app developers.

Regardless of which platform, if not all, you’re developing for, app testing will still be one of the most critical steps of the app development lifecycle. Just because an app works fine on iOS doesn’t mean it’ll work just as well on Android devices. Likewise, just because an app works fine on an emulator doesn’t mean it’ll work fine on a real device. So, test early, test often, and on real devices to ensure the quality of the app. A trend I’m realizing is that end-users are becoming very unforgiving about buggy apps which are, quite frankly, synonymous with “revenue- and reputation-killer.” App development is a hot industry and the market is saturated with app developers, so being blasé about app quality is not an option.





The Keys to a Successful Mobile App Strategy

4 04 2013

processThere are many phases in the testing of any mobile app or website, specifically when it comes to QA and development. Within development (or pre-launch) there is Functional Testing, Usability Testing, and Performance Testing, amongst others. And in production (post-launch) there is Benchmark Testing, Availability Monitoring, and Performance Monitoring. All of these types of testing are critical to the success of any mobile platform. While there are many factors that can affect an apps success,  the importance of having a mobile strategy that incorporates testing is crucial.

For development teams the use of emulators and real devices for testing is vital to ensure the app or site is of the highest quality to avoid pitfalls such as misplaced images, non-functioning apps, apps crashing, broken links, etc.

For Web sites or Web apps it is viewable by users around the world. Even if you’re initially targeting only users in a single country or on a single network, it helps to understand the global dynamic.

When you test mobile Web apps or sites you encounter several challenges presented by the nature of the global, mobile Web. As we understand the nature of each challenge, we can explore different technology options to manage issues and mitigate risk. Coming up with the right solutions for your requires an assessment of the advantages and disadvantages inherent in each of the testing options available to you and determining the technology that best suits your testing requirements. These mobile testing challenges include

devices, network, and scripting.
For native apps, while application testing has always been an important step in the application development process, its importance is becoming even more critical for the following reasons, as adapted from an ABI whitepaper:

  • Mobile applications drive productivity – they must work.
  • Device platforms vary – applications developed for one platform must work on other platforms. For example, device fragmentation on different Android devices.
  • Applications will evolve – as worker’s needs and responsibilities change, applications will be both upgraded as well as downgraded in functionality.
  • Cloud systems affect where data is stored. In addition, authorizations and connectivity APIs are not consistent across cloud service providers.
  • Multiple wireless networks – businesses connect to different radio networks based on network capabilities, worker needs, and contractual relationships. But all of these conditions can change which will require modifying the application.
  • Operator choice – devices commissioned for use on a network in France may be recommissioned for use on a network in Germany. Or a business may change mobile operators. Applications will need to be tested on different operator networks to ensure consistent connectivity when upgrading in-the-field devices.
  • Worker demographics will change device type and application.




HTML5 and the Fight Over Who will Win the OS War

2 04 2013

201209-Cross-Platform-AppsMobile developers continue to struggle to determine how and on which OS’ to develop their mobile projects on.  As Michelle Fredette recently explained in her article that “Developing applications for multiple platforms is expensive, primarily because it takes developers a lot of time to create two or three versions of a single app. Not only does the coding itself take time, but the developers also have to learn multiple authoring systems: Xcode for Apple apps, Visual Studio for Windows apps, and the Android SDK development tools and platform for Android apps. And when updates are needed, which is inevitable, changes must be replicated across the various operating systems. Costs escalate even further when you account for the extra time needed to develop for different-sized devices. Ryan Matzner, writing in Mashable Tech, estimates that adding iPad compatibility to an iPhone app can increase development costs by 50 percent.”

 

She continues “Another drawback associated with native apps is that companies such as Apple act as gatekeepers: Users have to visit their app stores to download the app or update it, and these same companies must approve the app before it goes public–a process that can take weeks. It’s a lopsided arrangement with which not everyone is comfortable. “There are real concerns with [these] companies deciding who can and who can’t publish what on their stores,” explains John Kennedy, developer of Pocket Universe, a successful iOS app.

 

These costs and hosting concerns don’t apply to HTML5 solutions, which generally incorporate CSS (cascading style sheets) and JavaScript, the code language often used to augment HTML apps. All three are considered among the easiest codes to write, and can be written in Notepad or any number of free editors. Plus, you don’t need a development environment to compile them, just a browser for rendering.

 

An additional advantage of HTML5 involves updating. In truth, people are terrible about updating their apps when new versions come out. Browser-based apps draw their features and content in the form of data hosted on the web. If there’s an update, it’s incorporated in that data. The user doesn’t have to download it from an app store. The user might not even know about it.

 

Another benefit is flexibility, allowing a user to access the same piece of content from multiple devices, something that’s especially critical in higher education. Harvey Singh, CEO and founder of Instancy, a company specializing in web and mobile learning solutions, says it’s increasingly important for users to be able to “open a course on a desktop, then go on the road and access it using a mobile device and continue where they left off.”

 

So why aren’t we hearing the death knell for native apps? Well, HTML5 also has real limitations. With native apps, for example, course content can be downloaded to users’ devices, so they don’t need constant access to the internet to work on a course. With a native app, furthermore, when network access is restored, files are automatically synchronized on the network.”

 

Keynote’s DeviceAnywhere platform prides itself on being agnostic when it comes to devices and even OS’. Since our technology can work with any device on any OS, that becomes a non-issue and allows our customers the opportunity to switch platforms as they see fit. That being said, we do see value in HTML5, especially as it pertains to automated testing of mobile apps and websites. While traditionally this has been done on a 1:1 ratio leveraging scripting, HTML5 gives us a framework to perform automated testing across any device (provided it is an HTML5-enabled device, which is  becoming the standard in the industry).

To read the rest of Michelles article click here.

To learn more about HTML5 Web Tesing with DeviceAnywhere’s Automation platform click here.





For Testers, Shipping Devices Is a Major Headache – Mobile Cloud Testing to the Rescue!

28 03 2013

deviceanywhere_mobile_cloud_testingTraditionally, to conduct real device mobile testing vendors shipped devices to testers all over the world. A major roadblock is the upkeep of these devices and maintaining them with the latest OS version or device model. Shipping back and forth becomes a huge pain point as time and cost rises exponentially. With cloud-based services there is no need to ship, purchase devices, or subscribe to service plans.

Cloud-based architecture enables easy access to application performance information anywhere in the world and eliminates the need to have a physical device on hand to test.

Some cloud-based tools allow mobile teams to receive real-time alerts against any measurement criteria, allowing them to address issues before they impact end-users. Real device testing, such as Keynote’s DeviceAnywhere platform through the cloud gives teams the ability to access real devices from anywhere in the world. This is perfect for organizations that either offshore their testing because of cost or have internationally-based teams. These teams can have access to the latest devices from locations with an Internet connection.

For a free THREE HOUR trial with access to the LARGEST library of real devices in the world – click here!





With Adoption of iOS 6 Apple gets Fragmented!

21 03 2013

iOS-6-fragmentation-detailed-which-device-gets-whatWe recently wrote about how the launch of the iPhone 5 and the iPad Mini, each having a different form factor than their predecessors provides unique challenges for a QA tester and developers who are trying to keep up with the onslaught of new devices into the market. Android who has been the king of fragmentation due to it’s open OS and overwhelming OEM development has had to deal with this for some time. This is new for Apple while rarely changing it’s form factor since it’s launch of the iPhone in 2007.

But as the devices have changed, so have the operating systems supporting them. With the launch of the iPhone 5 and iPad Mini came a new OS – OS 6. This new OS provided new challenges as it could now be leveraged by carriers and partners to be customized to provide competitiveness and flexibility for their users.

In a recent article entitled “iOS 6 “fragmentation” detailed: which device gets what” the author writes  “‘Fragmentation’ is a word heavily loaded against Android and a term a bit too broad for our liking. It’s true that software updates on Android devices often arrive too late, but this depends on the carrier, it’s also true that some features are available on certain devices and not on others, and on and on, but using the general term fragmentation blurs those issues and writes all Android devices under a common negative denominator.

So far, Apple has been particularly proud of its “non-fragmented” operating system and lineup, but it seems that this concept broke with iOS 6. Hidden in the fine print of iOS 6 new features and updates are some staggering inconsistencies across devices – certain features are reserved for the newer devices and will never allow on older models. If that’s not a perfect example of something begging to be labelled with the same vague word “fragmentation” than we don’t know what is.
The folks from India’s iGyaan.in have penned this brilliant table showcasing just how fragmented Apple’s ecosystem really is after iOS 6, and it’s a joy to behold for the Android fans who finally get a big weapon in their anti-Apple arsenal. We bet you know this, but let’s keep this civil and think about what this means for the ecosystem that Apple is building. “
ios-fragmentation-tn




Netflix Talks HTML5-based Mobile Testing on Android

19 03 2013

DSC01749In a recent article posted by Amol Ker of Netflix, he shared his struggles with performing device testing of their mobile apps and websites. Since they operated on a hybrid approach using HTML5 based coding. In the article Amol shared the following “when Netflix decided to enter the Android ecosystem, we faced a daunting set of challenges: a) We wanted to release rapidly every 6-8 weeks, b) There were hundreds of Android devices of different shapes, versions, capacities and specifications which need to playback audio and video and c) We wanted to keep the team small and happy. Of course, the seasoned tester in you has to admit that these are the sort of problems you like to wake up to every day and solve. Doing it with a group of other software engineers who are passionate about quality is what made overcoming those challenges even more fun.”

He continues… “To put device diversity in context, we see almost around 1000 different devices streaming Netflix on Android every day. We had to figure out how to categorize these devices in buckets so that we can be reasonably sure that we are releasing something that will work properly on these devices.”

And later mentions “We keep our team lean by focusing our full time employees on building solutions that scale and automation is a key part of this effort. ”

Netflix’ issues are not new and are not specific to Netflix. Anyone looking to test their apps or websites MUST perform real-world, real device testing before release AND after it’s launched to support forthcoming updates. Netflix has chosen a way that works for them that has potential flaws, in that it can easily miss most of the device OS ecosystem if they don’t test on a certain device or platform. And as budgets and efficient-driven teams demand, utlizing mobile test automation software is key to their strategy.

Keynote, with it’s acquisition of DeviceAnywhere has developed several tools to address these issues helping thousands of companies become more efficient and enabling them to centralize their testing efforts while maintaining dispersed, cost-efficient development teams around the world. With DeviceAnywhere Test Planner, QA managers and developers can get free assistance on determining which devices they should test on that will provide them the widest coverage while testing on the lowest number of devices, providing the ultimate in efficiency and planning of any new rollout.

deviceanywhere_device_planner Keynote also offers automated mobile testing with it’s TCE – Automation platform – leveraging the latest HTML5 web-based coding for ease-of-use giving you the flexibility of running the same test across any HTML5-enabled device or tablet. No more need to ship devices around or leverage agent-based systems whereby one does not get a true experience from the consumer’s perspective, resulting in potential pitfalls for the developer and in result potentially affecting revenues.





The Android OS – the Ultimate in Device Fragmentation?

14 03 2013

animoca-androidIn an article posted in 2012 in TechTarget, Kim-Mai Cutler had the chance to interview “Animoca, a Hong Kong mobile app developer that has seen more than 70 million downloads, says it does quality assurance testing with about 400 Android devices. Again, that’s testing with four hundred different phones and tablets for every app they ship!”

She continues .. “The photo above is just a sampling of Animoca’s fleet of Android test units. Yat Siu, who is CEO of Animoca’s parent company Outblaze, snapped and posted it from Outblaze’s headquarters today. In total, Siu says their studio has detected about 600 unique Android devices on their network.

“We haven’t managed to track down all of those devices because, in large part, they are no longer available for sale,” he says. Sad cakes!

On top of that, Siu said that the number of handsets from the lower-end Asian manufacturers is also growing rapidly. These are the phone makers that Nokia chief executive Stephen Elop was probably talking about in his famous “burning platform” memo when he said that are Chinese OEMs were “cranking out a device much faster than, as one Nokia employee said only partially in jest, ‘the time that it takes us to polish a PowerPoint presentation.’” If you take those out, the actual number of devices you need to test for is much lower.

But if you want to break into Asian markets, these phones matter and make it especially challenging for Android developers to ensure their apps work on every single Android device. Android fragmentation is a huge issue because developers have to check their work on dozens of devices. Animoca happens to be backed by Intel Capital and IDG-Accel, so it has the resources to buy all of these devices for testing and pay employees to use them.

But imagine the long-tail of developers! Imagine the people who make the roughly 500,000 apps in the Google Play store. Total nightmare.

It puts a real dent in Eric Schmidt’s prediction from six months ago that developers might start going Android first within six months. His deadline is up now and there aren’t signs of this happening. Appcelerator did a survey of 2,100 of its developer clients in March and found that, if anything, interest in Android development is stagnating.

Siu isn’t fazed though. He’s told me in the past that thorough QA testing makes Animoca’s apps retain users better because so many other Android developers do a bad job at it. Unlike iOS users who throw up their hands in frustration, write bad reviews and just leave, Android users tend to be delighted when they find apps that work even if they have a glitch or two.

He adds, “We like fragmentation as users prefer choice. We are not big believers that one size fits all.”

At Keynote, we see this all the time. Our customers tell us of the pain of having to manage libraries of real devices and the vast variety of OS versions even just within Android, let alone iOS, BlackBerry, or Win 8.  Developers who started with one or two devices a few years ago are now up to 20-30 today as seen in this image from another developer – Pocket Gems. They had two of the 10 top-grossing games on iOS last year, according to Apple’s iTunes Rewind.

android-table

And there is no end in sight now with the release of new form factors from Apple such as the iPhone 5 and the iPad Mini. One of our customers – Microsoft’s Windows Live team was able to replace their entire cabinet of devices with the DeviceAnywhere platform. No longer having to check out devices to team members or update devices with different OS’, or manage/maintain separate plans for each device locking them into a 2-year agreement with the carrier. Mark Boyce of Microsoft’s Windows Live deployment team said at the time of the release “Keynote’s DeviceAnywhere solution has saved our department a lot of time and headaches by eliminating most of the tedious, manual tasks associated with our in-house mobile testing process. We no longer have to chase down lost devices and SIMs, dig through boxes of chargers, or even track multiple phone bills and expense reports.”

To learn how you too can benefit from access to real devices from anywhere in the world, eliminating the need to maintain your own library or even having to ship devices around the globe, check out Keynote’s DeviceAnywhere platform and we’ll even get you started with THREE free hours, TODAY!

To read more of Ms. Cutler’s article click here.





Is Apple Dominating the Mobile Enterprise Market?

12 03 2013

Screen Shot 2012-08-10 at 15.19.01In a recent article by Jonny Evans of CITE World, it would appear that Apple is starting to dominate the enterprise marketplace. For years, this was a market long-held by the king of enterprise devices – BlackBerry. However since the iPhone and it’s worldwide acceptance amongst consumers and since organizations have seen an explosion in employees bringing their own devices to work and deploying work-based apps on them it is no shock that it’s dominance would make it’s way into the enterprise. The permeation of the Android device has also made its way into the enterprise, resulting in a battle over the mobile enterprise marketplace.

In the article Mr Evans states “If you believe the latest Appcelerator/IDC survey results, poor security, explosive growth in malware threats, and device fragmentation is costing Google’s Android a place in the mobile enterprise, with Apple scooping up believers in this space.”

As an example, CITE recently discussed how PepsiCo took a chance and gave iPhones to 4,500 hourly employees — and it’s paying off.  Even at Keynote, we have seen an increase in request for iOS devices for testing of internal enterprise apps by our DeviceAnywhere customers.

Mr Evans article continues:

“Times are changing

Appcelerator and IDC surveyed 3,632 Appcelerator Titanium developers in May, asking them about their development priorities. They found that Apple now holds a 16 percent lead over Android when it comes to OS deployment among enterprise users: a huge hike since Q3 2011 when both mobile operating systems were tied. Fifty-three percent of developers say iOS will win in the enterprise, while just 37.5 percent side with Android.

The reasons? According to the survey, these include:

  • The popularity of the iPad
  • Frequent reports of Android malware
  • Enterprise challenges in dealing with Android fragmentation
  • Reports of enterprises re-evaluating widespread Android deployment outside of particular business vertical implementations like Machine-to-Machine (M2M).

When it comes to mobile at least, this is translating into an Apple-dominated ecosystem. “Apple iOS device activations still account for more than twice the number of Android activations in the enterprise when it comes to overall platform activations,” says the latest report from Good Technology. iOS accounted for 70.8 percent, Android was 28.3 percent and Windows Phone 7 was 0.9 percent, the research claims.”

Time will tell if Microsoft’s Windows 8 platform takes off as they attempt to extend their enterprise dominance with Windows to mobile.

To read more of the article from CITE go here