TL;DR

Last Tuesday, we gathered at the lovely Q Agency office for Testival #55. This is my learning experience from that meetup.

Testival #55 Meetup was hosted by Q Agency, which also sponsored pizzas and beers. Many thanks to them for their Testival support!

Kresimir Linke was MC for this Testival. He gave the usual introduction to Testival. After the introduction, we continued with traditional About Me, where every attendee said something about themselves. We had 30+ participants from ten different companies. I like to share what I tested today, but this time was time for the bug report. Visual Studio Code extension Vim emulation stopped working at version 1.12.2. In Visual Studio Code, extension updates are set to auto by default. And in this case, that caused an issue for me. There is a joke that one developer is still using Vim because he does not know to exit Vim. I have the opposite problem. I am so used to Vim keyboard command mapping that I forgot how to exit the default Visual Studio Code editor.

Doroteja Držaić (Q Agency) – Mobile Application Testing – Emulators vs. Real-Device Testing

Dora presented her experience in using Mobile Devices vs. Emulators for testing mobile applications. In her introduction, he stated that testing should start with testing strategy. The strategy covers the following areas:

• scope
• approach
• tools
• metrics
• deliverables
• reports
• standards

Based on that strategy, they define testing techniques that will be used. User acceptance testing is a technique that is done last.

Mobile application testing brings the following challenges:

• number of device hardware
• number of operating system versions
• number of mobile technologies

To sample those values to the important ones, they use information from Google Analytics. The problem is that the first version should be shipped to get analytics data to start flowing in.

So when to use Emulators and when to use Real Devices? In their context, Emulators are for developers, and testers use both Emulators and Real Devices. Emulators advantages are:

• free
• the log is immediately available

Devices advantages are:

• camera
• sensors
• battery consumption
• color visibility in the sun and shadows.

In the QA section, I asked about cloud services such as Browserstack. Dora used it for geolocation services. Those cloud services even support real devices that you can use remotely. This is very useful for not so usual mobile hardware. The problem is the security of Android apk files. Browserstack approached this problem by doing a phone factory reset when the session is done.

Karlo Šmid (Tentamen) – Self Verifying Data

Software testers are responsible for creating test data. They can do it manually or using testing tools, but it is their responsibility. Here we explain the concept of self-verifying data oracle. The talk is aligned with the Black Box Software Testing Foundations course (BBST) designed by Rebecca Fiedler, Cem Kaner, and James Bach.

That was my presentation. You can found it here. The last slide has links to bbst resources. Niko Madzar found out that the first link is case sensitive!

Lighting Talk

Radan Skoric presented his work with Alex Rodionov on a project related to the business process. Imagine a business process with states and transitions (state machine). They created a robot (program) that exercised page object transitions (process mutations) to automatically check all possible changes.