Keep track of all the latest news and events on developer tools and technologies you care about
by Vinu Chandran, Software Test Engineer, Testhouse.
Vinu is a computer science graduate, and has been working with Testhouse India as a software test engineer for more than a year. He’s currently focusing on Coded UI and other testing capabilities of the Microsoft ALM solution. Previously he worked with Infosys technologies as an Assistant Test Engineer.
With Testhouse, I've recently completed a functional automation project in Emirates National Bank of Dubai, which is using Finacle core banking solution and a PoC in National Bank of Kuwait, to demonstrate Functional, Performance and Mobile testing using Visual Studio.
Applications need to be tested for performance. It’s vital in ensuring they have the capacity to perform when accessed by a number of users.
Companies, whether established or startup, can ill afford crashes or similar problems. It would hit their reputation, they may lose business, and they could lose the faith of customers very quickly.
Leading Kuwait bank NBK wanted to test its mobile banking app, which allows their customers to manage transactions 24 hours a day through BlackBerry, iOS and Android devices. With the app, a customer can perform various useful actions, such as make payments and transfers, get statements, and find branches.
The Bank chose the company I work for, software consultancy Testhouse, a global company that specialises in software performance testing.
Testing the NBK mobile app
We found that the NBK application could only be accessed in a testing environment by connecting a mobile device to a Wi-Fi hotspot provided by the bank. A cloud based/simulated device wouldn’t work, so it needed an automation tool to interact with a real device.
We chose the SeeTest mobile automation tool, developed by Experitest and used by firms such as American Express, Barclays, Cisco, CitiBank and McAfee.
With SeeTest we could create a link between the Visual Studio 2013 coded UI test and an iPhone, Android, Blackberry, Symbian or Windows Mobile device.
When the device is connected to a PC which has SeeTest installed, it simulates the real device screen in the PC. This allows the user working with Visual Studio to interact with the application.
The user could then record computing scenarios, which are instantly converted into C# MSTest code. This generated code can be copy pasted to Visual Studio 2013 Coded UI test and run from there by adding additional references.
While executing from Visual Studio 2013, the scenario will be played back in both the simulated screen and real device. The simulated screen by SeeTest acts as a link between Visual Studio and the real device.
SeeTest works with three different kinds of object recognition methods – image recognition, text recognition and Web DOM.
Here’s how it works step by step:
1. The SeeTest Automation tool simulates the real device connected to the test computer. It records the scenario using an image recognition method.
C# code that can be imported to Visual Studio 2013 is automatically generated in the code tab.
2. The recorded scenario in SeeTest will be played back, to make sure the test passes. This playback will generate an HTML report of each action with pass/fail status and screenshot of the same.
3. After finishing the test successfully, generated C# code will be copied to Visual Studio 2013, using Coded UI test to execute. Playback will happen on both the simulator as well as the real device to make sure the execution passes.