- A professional stumbler
- Leading Indicators in Unit Testing Implementation, Part II
- Nordic testing days – closing it all up
- Getting Hacked, Lessons Learned
- Programmers, Testers, & Dogs
- Does certification have value or not?
- Comma Separated Vulnerabilities
- How Torch broke ls and made me vulnerable (or the dangers of LD_LIBRARY_PATH)
- Nordic testing days – day 1
- But is it Automation?
- Using SPIN for persuasive communication
- “Fractal Test Planning” Slides from #NTD2017
- Implementing Unit Testing – Leading Indicators (part 1)
- Code Health: Reduce Nesting, Reduce Complexity
- Is Waterfall the Opposite of Agile?
This post is about my other passion, comic books. I found one UX issue while enjoying Inkal comic book.
Observe following photo:
On the right side, my user experience was broken. Can you identify the issue?
Everybody who reads from left to right, reads comic books in the same fashion. Actually, expects that comic book panels (frames or boxes) follows that flow. On the right side, that flow was broken. Note the arrows put by the editor. Those arrows are there to define panel flow that is different from the other parts of the comic book.
Why? My test idea is that editor needed to satisfy requirement that there must not be empty space on a page.
In first past, I automatically followed left-right panel direction, so I lost the flow. I needed to stop in order to comprehend story flow.
Which is better, empty panel or uninterrupted reader flow?by
This post is about the last day of TestBash Brighton2017, Open Sessions moderated by Richard Bradshaw. Here are my takeaways.
Open session conference lets participants to propose topics they would like to discuss. This instance was a little bit different than my previous open sessions because each participant could propose only one topic and there was no voting, all topics were arranged into slots.
As you can see from the above photo, last slot was left empty for possible topics created during the open sessions and based on input and ideas received during the open sessions.
Dan Billing’s Proxy Security Surgery
This session was about security testing of vulnerable web application. It is an example of Dan’s workshop. I volunteered to be Dan’s driver while he was presenting security topics. I used Burb Enterprise on Mac, Chrome proxy switcher, and application was ticketmagpie that is available as docker image. We explored from security perspective payment, login and register features.
- every tester gets scared when he thinks about security testing
- security testing etics
- always asked for permission to do it
- we used burp in passive mode
- Burp is Java application
- Charles proxy is Mac alternative
Storytelling in software development
This session was my proposal and it was based on series of blog posts Software as narrative by Noah Sussman. The point is that software development is more like creating narrative. Every stakeholder has its role in novel called software development of application ABC. it was lively 45 minute discussion and I thank to all participants!
Legends of Charlie by David Christiansen
David read first two chapters from his book that is work in progress. I was there because I am currently reading book Writing the novel from plot to print by Lawrence block in order to improve my blog writing skill. And this session produced greatest takeaways!
- scrivener is mac tool that helps writers to write a book
- blog frequency: deep academic once a month, funny stuff once a day, experience based (my frequency for last two years), once a week
- write draft => put it aside =>print it in double spaces => space after chapter => read it and comment
Simon Tomes testbuddy.co
We provided to Simon feedback which features we would like to have in Exploratory session tool that he plans to implement. For now I know about following tools:
- Exploratory Testing Chrome Extension (that I use it on daily basis)
- Rapid Reporter
Heuristics with Paul Holland
And here we were, three of us, last session about heuristics. And two of us get free 30 minutes Paul Holland (Rapid Software Testing teacher) teaching about heuristics.
- heuristics is fallible method that helps us to resolve a problem
- heuristics is like metadata for test ideas
- for example Test Obsessed Test Heuristics cheat sheet: Goldilocks – Too Big, Too Small, Just Right. Goldilocks is test heuristic which helps you to create test idea for integer input box: enter number 9223372036854775807
I noticed a great number of conference speakers at Open session which is great opportunity for every software tester. I joined and listened conversation between Paul and Anne-Marie Charrett. Topic was removing testers from software development because they represent safety net for developers. Ann-Marie said that what next happens is that software developers will create another safety net.
Paul suggested that next Open Session needs to have exposed names of registered participants as a means of attracting more testers to this valuable event.
On Friday morning while I was having breakfast, I googled for open mic stand up comedy Brighton. There it was, Junkyard Dogs was the place at 7pm. I shoot organizer and email and excitement started to grow in my belly.
I have been doing stand up comedy in Croatian for six years, but only last two should be counted for. I have never done it in English. During conference breaks, I prepared my three bits and isolated punchlines that I need CORRECTLY to translate in English.Person on the right was Irish so I asked person on my left for help because he was an English. He was happy to verify my translation. I was set to go.
I arrived at 6.30 PM. Another thing that I was interested in was to meet Brighton stand up comedians (amateurs like me). What are they thoughts and drives about stand up comedy. 21 people applied (in Zagreb we usually have up to 8 people and Brighton is three times smaller than Zagreb), and they were most of the audience (some brought relatives or friends). Also, I was interested how was open mic conceived.
EVERYBODY was extremely friendly to me. This was very important for my confidence.
Act had 5 minutes time limit. My first English act went very well. Most of my punchlines got laugh, one that were not related to English “known things” did not. That was expected, by I also wanted to execute negative test case.
I had trouble to understand all the jokes because of local accent, English facts and talking speed.
In order to do stand up comedy internationally you either have to do universal material or to do local facts material. And for local facts material, the best way is to experience those local facts.by
This is learning report on Testival #28 meetup that was held today. Our host was again Repsly in HUB385.
There were 15+ participant with three long talks/hands on presentations and four 5 minute lightning talks.
Marko Elezović from Oradian presented how to write concurrent integration tests for api towards the database. Language was Scala, specs was framework for writing tests. Developed testing framework runs tests concurrently. In order to do that, Marko showed us how he resolved issue where every test suites has dedicated postgres database.
Marko Varat, Repsly Inc: presented UX Testing – Product Development Sanity Check.
I learned about tools UXpin, MixPanel and FullStory, tools that help in testing UX aspects of new features.
There were four lighting talks: Kreso from Repsly explained how Repsly successfully hired senior tester in tough market, Zeljko presented Selenium bindings in Scratch, Zoran from ButterflyMX explained which frameworks they use in order to do TDD in their Ruby on Rails project. I presented Ministry of Testing TestSphere cards and possibilities how to use them.
This post is about my takeaways from TestBash Brighton 2017 conference day.
The testers survival guide to joining a continuous delivery project by Amy Phillips.
Amy suggested us to read two books:
- Project Phoenix
- Continuous Delivery.
Tester must now continuous semantics: dead canary, walking skeleton and dark lunch are some of them. In first week tester should know his project role, project deadlines and establish code review procedure.
Another book was mentioned: What is trunk based development.
Be aware of all communication channels: recurring meetings, trello, slack, github, jira,…
Catalog information that you do not know (need answers), ask same question to different people, be alert on information changes. Think about support staff as one persona that is using your application. Read bug reports!
Assess your environment and note HOW THEY DIFFER!
When you think about bug that is not resolved, think about a cost if this bug would be shipped in deploy.
Read code if you can. Even better, ask developer to explain to you part of his code. Doing that, maybe some issues would pop up!
AI language and the net by prof. Harry Collins
Oh, this was a goodie!
We have two elements for computers: the clockwork and computers as social prostheses. Every computer IS DOING LESS THAT REAL STUFF. The goal is that this become equal!
Some programs have passed the Turing test just because it was not hard enough.
We have tacit and explicit knowledge. Every knowledge has author (producer) and critic (consumer). Objective experts should be somewhere in the middle.
There is no deep learning, there is VAST amount of data to which computes have access and they represent social machines. Complete knowledge has not yet been achieved.
Testers have important role in creating AI.
Rediscovering Test Strategy by Mike Talks
On Thursday meetup, I played with Mike and his friends Monty Python’s Flux card game (at that time I did know that this was Mike). This was my first play of Flux, before that I just read the instructions. I learned that there can be several RULE cards at the table, the only rule is that RULE cards must no be exclude (logically) each other.
Testers usually create their test plan based on previous work (experience). Mike noted that strategy is different than plan.
Testers have a lot of test ideas. We should capture them (e.g. post it), cluster them and discard ones not relevant for the project scope. With all test ideas in front of you, it is easier to find gaps in your test strategy.
Mike created Oblique Testing cards that can help you with your test ideas. He also mentioned Ministry of Testing TestSphere cards.
Testers usually have test ideas related with keyboard and mouse because those inputs are most available!
How to turn 403 into 202 at the API party by Gwen Diagram and Ash Winter
I learned about BINMEN acronym that is useful for API testing:
Always put less logic in User Interface!
Building customer happiness with a tiny team by Paul Campbell
Following technology stack enables them to do that with tiny team:
- Stripe for payments
- aurora database
- pivotal tracker
This post is about my takeaways from workshop Brighton 2017 day. I attended Alessandra Moreira’s Agile Exploration and Michael Bolton’s Critical Thinking. Post is not an easy read.
First we had opening keynote by Kevin Harris Kick-Ass-Kick offs! It was about project kick off meeting. Here are some points that sticked with me:
- freeze requirements
- be prepared, do your reading
- small is beautiful (stories context)
- ASK QUESTIONS!
- reveal your testing strategy (I am going to test like that) in order to get feedback
- test on developer machine early
- other stuff (performance, security)
- definition of done
- create your mnemonics
In Q&A session, I applied advice: ASK QUESTIONS! I asked audience: Have you ever been in situation were requirements were frozen in Kick off meeting?
Kevin answer was that requirement change requires new kick off meeting, but what about scenario when customer frequently changes requirements? Does that increases frequency of kick off meetings, or do we wait for “customer cool” off time?
Workshop: Agile exploration by Alessandra Moreira
I have read (and practice) a lot about exploration testing, so my goal with this workshop was reality check about the topic. Here are my takeaways.
- We use exploratory testing to find additional problems. For me this is just extension to it, one way of using it.
- Software testing is to provide many types of information about product to interesting parties.
- Software testers bring to project their specific MINDSET.
- How to do exploratory testing: heuristics, critical thinking, questioning
- Critical thinking is thinking about what we think.
- Weinberg rule of 3, think of three different ways to do something
- Six honest man, 5 W questions + how.
- James Bach session test management
- tool for session test management?
- Michael Bolton created spread sheet for session test management automatic report creation
We created groups of three to implement session test management on Instapaper. My group decided to test search feature and one group member, experienced with Jira Capture, made notes for our session. In cooperation we made great notes, and found some interesting behavior in advanced search feature.
Workshop: Critical thinking for testers with Michael Bolton
Here are my takeaways:
- Calculator test assignment. Fell in trap again, despite the fact that I have done it on Rapid software testing course
- Testers help to remove risks that jeopardize quality
- assumptions => state them => their become your proxy for questions => do not go too deep
- NEVER MAKE ASSUMPTIONS!
- We often state that our ASSUMPTION is TRUE but with NO EVIDENCE
- From assumption (premise), using reasoning to real cause
- assumptions: reckless (high risk), risky (risk is acceptable), safe (no risk), required
- assumption is more dangerous when it is hard to support it, there are too many factors to support it and has high impact
- Reading: Validity and reliability in quantitative studies
- Assumption can be: foundational, unlikely, blind, controversial, impolitic, volatile, unsustainable, premature, narcotic, latent
- assignment: bat costs 1$ more than ball. Together they cost 1.10$. How much ball cost?
- Reading: Thinking fast and slow
- Keep your eyes on the ball and the game
- When you are too focus, you will miss something else
- Alternate from wide to narrow view
- Experience is the best teacher
- Learn from every bug
- Reading: Nassim Taleb: Black swan
- Some bugs are obvious
- Justify why you think this is a bug (unconscious factors, memory habit)
- system 1 (reflex, fast, loser) and system 2 (reflection, slow, surer)
- SOFTWARE TESTER MUST NOT GET FOOLED
- Three stories: project, testing, product
- Cognitive bias, help us to survive, but not help us with bugs (illusion, miss, quick decision, memory errors)
- PEOPLE SHOULD (NOT) ARGUE ABOUT SEMANTICS
- What is an integer?
- Heuristic is way to solve a problem that could fail in that mission
- As tester, you must give SYSTEM 2 time to WAKE UP!
- I do not understand, I understand but it is not true, what is whole story, does it matter?
- Conversation flow: intake => meaning => significance => response
Builder has focused mindset and tester has defocused mindset
- Reading: Asking the right question. A guide to critical thinking.
- A vs THE
- And, unless, also, so far, not yet (be careful when you here those!)
- Reading: How to not be wrong
Next series of post is about my takeaways from Brighton TestBash2017 conference. First was pre TestBash meetup.
That meetup was day before workshop day. I came late, and everybody was already in the game mood. I noticed that a lot of games were played.
I joined to table with following setup. One card was on the table, three testers were asking questions, and one was answering them. Game was Dark Stories. Each card represents a puzzle in story form that is written on one side, answer is on other side. One person reads puzzle at loud and keeps answer for himself. Others try to guess the answer.
My takeaway. This is excellent game for practicing critical thinking. Answer is not obvious, so you need to do focus/defocus thinking about the puzzle. You need to have some common general knowledge in order to solve some puzzles. I played with excellent testers, and by listening their questions, I learned about their approach to puzzle problem. Pairing of testers, in this case testers tetrads, is great way to learn, test and solve a puzzle!
Second game that I observed was Otrio. Think of it as tic-tac-toe with more dimensions. Triplet can be made with same size or different size in ascending or descending order. Each element has three sizes.
Third game was Cockroach Salad. Pace of this game is very fast. it trains your brain to think fast, as rule of games could change. You have four card type: Pepper, tomato, salad and cauliflower. For each card type, there is taboo card. You play a card and say vegetables that is on the card. But:
- If your vegetable matches the previously played vegetable, the player must lie.
- If your vegetable matches the claim made by the previous player (perhaps because that player lied), then the player must lie.
- If you play a taboo card, he shouts “Cockroach!” and the next player starts a new pile next to the first one so that the taboo card remains visible.
- If your vegetable matches a visible taboo card, he must lie.
If you can not lie and you are supposed to (nightmare of every politician!), you must pick all cards from the table. First player without cards wins.
I was in situations when I was testing application that had feature rules similar to this game. How about you?
That was it. No beer party because I need a good night sleep for workshop day. I walked back to my bed and breakfast place despite the fact that weather had changed three times since I arrived to Brighton.
This is my personal cheat sheet for TestBash Brighton 2017 testing gathering.
Based on my previous conference experiences, I realized that I need a one stop shop reminder for conference activities. I will print out this blog post. Here it goes.
- Wednesday Pre-TestBash Meetup, 29-30 Surrey street, Brighton, BN1 3PA
Starts at 7.00PM but it does not designates ending time. I can be there at 9.30PM so I will need to check meetup page when I arrive.
My Google maps route:
Pool Valley Coach Station, Brighton BN1 1NJ, UK => 52 Regency Square, Brighton BN1 2FF, UK => 29 Surrey St, Brighton BN1 3PB, UK
2. Thursday workshop day
Agile Exploration Workshop::Alessandra Moreira
Teams practicing any flavor of agile development have different views on the role of a tester. As a test practitioner and hiring manager, I found one of the challenges we face as in the Software Test industry is that although Exploratory Testing makes its way to many resumes and conversations, not many people know what it really is, are unsure how to perform it in an agile context, and are unaware of how to execute it skillfully.
In this hands-on workshop, we will discuss what exploratory testing is by definition and will put it in practice by testing real software. We will examine how it is a perfect fit in an agile environment, and how to master the skills necessary to become an expert exploratory tester – in any team.
Hope for takeaway
My current testing project has zero documentation and by documentation I do not mean word document. I mean documentation that can be get by using various tools. For example, my current issue is that I need to test an api. In Ruby on rails project, I would use
but there is no comparable command in client framework. I will try with security scanners, in order to find all routes with brute force. I hope that I will get some practice and ideas how to solve similar issues. In this workshop description I am confused with Agile Exploration title that switches to Exploratory Testing. I will definitely need clarification on that matter.
SOLD OUT – Critical Thinking for Testers, Programmers, and Managers::Michael Bolton
Critical thinking is the kind of thinking that specifically looks for problems and mistakes. Regular people don’t do a lot of it. However, if you want to be a great tester, you need to be a great critical thinker. The good news is that critical thinking is not just innate intelligence or a talent <— > it’s a learnable and improvable skill. Michael Bolton shares the specific techniques and heuristics of critical thinking and presents realistic testing puzzles that help you practice and increase your thinking skills.
Rapid critical thinking begins with four questions—Huh? Really? And? So?—that kickstart your brain and help you to analyze plans, specifications, risks, causes, effects, bugs, and anything else that puzzles you. Join Michael for this interactive, hands-on session and practice your critical thinking skills.
Hope for takeaway
To improve my critical thinking skills. To be able to develop my own testing puzzles.
3. TestBash Meetup – sponsored by QASymphony – 6PM conference location
3. Friday Pre-TestBash Run, 7AM, Palace pier
There is no Palace Pier in Google maps so I will need to check the actual location during Thursday. It is not clear what is run ending point, I hope that it is Conference location. My plan is to walk at pace of 4km/hour.
4. Friday conference day
Nine 30 minutes sessions will probably drain my intellectual energy by I plan to stay focus for those 270 minutes. No alcohol on Wednesday night and a minimum of seven hour of deep sleep. My accommodation heuristic was to pick the cheapest Booking offer. In Birmingham that was bad decision because I got glass braking noise wakeup at 4 AM. Hope Brighton does not do so heavy bottle recycling.
99 second talks
This how you need to do it:
Think of something to talk about
Ensure you are in a quiet location
Grab your mobile phone in landscape mode
Talk or do something for 99 seconds
Email the file or a place to download it to Rosie – email@example.com
I am not sure how this will work. Shall we watch already recorded talks, or talks will be filmed on stage?
5. Hindsight TestBash Meetup 6PM, Conference location
Game meetup. Eric Davis wrote a great post about games for software testers: Using Games to Make You a Better Tester. I am bringing Batman Fluxx and Game of Set. I can also present Mastermind that requires only pen, paper and somebody to play with.
6. Saturday Open Space event by Richard Bradshaw 9.00AM
I always learn a lot at open space events. In Croatia we have annual Testival open space conference, I was at TestRetreat 2016, organized by Matt Heusser. Why this works? Because you are in the same place with smart testers and you can discuss whatever you like. By that, you learn a lot!
That it is, full steam pack of learning opportunities. My tool is notebook with four pencils (red, green, blue and black).by
In this blog post I will provide practice how to get latest nginx version aligned with docker documentation.
You have web application, and you need proxy server. You decided to go with nginx using docker. Also, you need to modify original image, so you have your own Dockerfile that is based on official docker nginx image (first line in Dockerfile is FROM nginx:latest).
Everything is set up, and after some time, you realized that your
command does not gets latest nginx version despite the fact that you have in Dockerfile
This was my heuristic that failed. Then I tried solution that is not aligned with docker. In Dockerfile I put:
sudo add-apt-repository ppa:nginx/stable sudo apt-get update sudo apt-get install nginx
because nginx docker image is based on debian linux distribution.
Doing that, local docker image got bigger than it should be.
Investigating docker documentation for build, I found following for docker build option:
--pull false Always attempt to pull a newer version of the image
By default, option is set to false. So, in order that on every build you get latest nginx docker image, you should run following cmd:
docker build –pull
Your local docker image will have optimized size, based on original Dockerfile and your application would be more secure.