Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

3
votes
1answer
368 views

How to keep unit tests independent?

I've read it at many places that unit tests should be independent. In my case I have a class that does data transformation. These steps must be done sequentially, otherwise they don't make sense. For ...
29
votes
5answers
3k views

Testing multi-threaded race conditions

Reading the comments to this answer, specifically: Just because you can't write a test doesn't mean it's not broken. Undefined behaviour which usually happens to work as expected (C and C++ are ...
2
votes
2answers
166 views

How can a beginning programmer begin to learn and apply testing best practices when developing software?

While learning to develop in PHP it has been easy enough that my short, one page, 20 line little scripts I could add "testing code" directly to my functions to figure out where I am or get close to ...
3
votes
1answer
183 views

Is equivalence partitioning part of negative testing?

I assume that negative testing is an approach to design the test cases and so is equivalence partitioning. But I am not sure if NT is a part of ET. An example: A field can accept a numeric value from ...
0
votes
2answers
247 views

How to use lists in equivalence partitioning?

I have read that equivalence partitioning can be used typically for intervals or lists, e.g. I assume it can be used for every set of inputs. Anyway if the requirement says that allowed colors are ...
3
votes
1answer
124 views

Stubbing and mocking boundaries

Suppose I'm building a JSON API and would like to include an endpoint that returns a list of recently created posts. Somewhere in my system is an existing Post model with the following test: create ...
1
vote
8answers
399 views

Improve Bad testing [closed]

We have a large team of developers and testers. The ratio is one tester for every one developer. We have full bug tracking and reporting systems in place. We have test plans in place. Every change ...
1
vote
2answers
163 views

What is the real point of an “oracle” in the SW testing?

I know the definition of an testing oracle but to me, it seems to be overrated. I have a specification, why should I bother with thinking about oracles? I just compare what the spec wants and what the ...
0
votes
1answer
209 views

Coping with test code becoming too complex [duplicate]

Our test automation team writes tons of automation tests for our WEB application, but it seems to me that their code is becoming way too complex and warrants that someone will test it as well. Is ...
2
votes
1answer
314 views

What is the difference, if any, between Model and QA environments?

I have worked for various organizations many of whom call their environment that comes after the test/developer environment and before the staging and/or production environment either model or QA. ...
3
votes
6answers
156 views

Keeping test and release version numbers in sync

I'm currently beta-testing an iPhone app. Right now I have sent out the first beta-test for my users and I have labeled that release as 1.0 for my testers. Now since the testers have tested the app ...
3
votes
1answer
135 views

Unit Testing and “Fit”

I am reading Cristopher Alexander's "Notes on the Synthesis of Form", and he is describing a solution to a problem as having good fit, when there is an absence of bad fit; we can't describe all of the ...
1
vote
2answers
748 views

Why is SIT called SIT when it serves for system testing?

I should define a testing strategy and environments and I have encountered rather terminology issue (but might well be my fault) so I hope someone will correct me here. We are using INT environment ...
1
vote
3answers
343 views

If functional testing is referred as black box..how can it be done on unit test level?

Preparing myself for ISTQB, I found a bit odd many things in their textbooks. E.g. they call black box testing as functional testing when you are not concerned with structured but only observe the ...
2
votes
1answer
3k views

Integration testing in en example - confused

I know that integration testing means integrating unit tested moduls and testing for interface errors etc. But in real world examples, I am kinda lost. Here is an example of our system: Back end ...
3
votes
2answers
582 views

How many regression bugs from refactoring is too many.

Recent QA testing has found some regression bugs in our code. My team lead blames recent refactoring efforts for the regressions. My team lead's stance is "refactor, but don't break too many things", ...
3
votes
5answers
4k views

Understanding unit tests/TDD for ASP.NET webforms [closed]

I'm the lead programmer at a small software firm (currently 4 developers including myself), we develop bespoke ASP.NET WebForms applications for businesses. I joined there in 2010 just after ...
5
votes
1answer
7k views

How can I unit-test my REST web service?

I am new to unit testing, I've one REST web method that just calls DB and populates a DTO. Pseudo code is public object GetCustomer(int id) { CustomerDTO objCust = //get from DB return objCust; } ...
6
votes
2answers
6k views

What is a Developer in Test?

I was recently talking with a recruiter who wants to put me at a company for a position of Developer in Test. He essentially made it sound like a position where you get to fiddle with new programming ...
0
votes
1answer
315 views

Beta-testing app good practice [duplicate]

I have just released an iOS app for beta-testing with TestFlight. I'm wondering what is good practice during beta-testing? Should I halt development of the app during beta-testing? Should I ...
4
votes
7answers
739 views

Can a developer perform testing efficiently? [duplicate]

I don't know yet how it feels to be a part of dev/testing teams. If in an organization (mostly single-product company), can a developer handle testing efficiently? From what I have read: ...
1
vote
2answers
712 views

Test case design - do for all positive tests exist also negative ones?

There is ambiguity in all papers I have read so I would like to ask about the following requirement: Requirement: Being a Game master, I can access the GM menu by typing "menuInvoke". Trying to do ...
6
votes
9answers
4k views

Negative test cases confusion

In the Software testing book from Koirala, Sheihk, they say: A positive test is when you put in a valid input and expect some action to be completed in accordance with the specification. A ...
13
votes
4answers
2k views

Why does Cem Kaner consider a test not revealing a bug a waste of time?

What about confirming the functionality in positive tests, proving it is working - should I say it is a waste of time? What kind of concept is behind this quote? Unsuccessful tests, i.e. tests ...
6
votes
3answers
788 views

In TDD, if I write a test case that passes without modifying production code, what does that mean?

These are Robert C. Martin's rules for TDD: You are not allowed to write any production code unless it is to make a failing unit test pass. You are not allowed to write any more of a unit test than ...
4
votes
3answers
5k views

Test planning for an Agile sprint

Can anyone offer any tips or experience on developing a test plan for an Agile sprint? Most of the time our team simply creates a "Test Feature X" task and goes about writing ad-hoc test cases. There ...
5
votes
1answer
405 views

Shared QA responsibilities on an Agile team

For many years our IT development group subscribed to the waterfall software development methodology with segregated pods of programmers specializing in database development, logic layer and ...
4
votes
2answers
319 views

Can I start with a passing unit test?

Uncle Bob's rules for TDD are specified here. You are not allowed to write any production code unless it is to make a failing unit test pass. You are not allowed to write any more of a unit test ...
14
votes
3answers
1k views

Brittle unit tests due to need for excessive mocking

I've been struggling with an increasingly annoying problem regarding our unit tests that we are implementing in my team. We are attempting to add unit tests into legacy code that wasn't well designed ...
2
votes
5answers
179 views

How many different configurations are used for software tests? [closed]

This article shows that for Android apps, software developers use between 30 and 50 different devices for compatibility tests. I tried to find information about tests of applications on "classic" ...
19
votes
7answers
2k views

Should I test inherited methods?

Suppose I have a class Manager derived from a base class Employee, and that Employee has a method getEmail() that is inherited by Manager. Should I test that the behaviour of a manager's getEmail() ...
17
votes
4answers
2k views

Why is test driven development missing from Joel's Test?

I was reading this blog by Joel Spolsky about 12 steps to better code. The absence of Test Driven Development really surprised me. So I want to throw the question to the Gurus. Is TDD not really worth ...
8
votes
1answer
505 views

Unit testing in Django

I'm really struggling to write effective unit tests for a large Django project. I have reasonably good test coverage, but I've come to realize that the tests I've been writing are definitely ...
7
votes
7answers
369 views

Why different testing methods are so contradicting topic? [closed]

There are a lot of very smart and experienced people, who claim that if you don't write unit tests then your code will be buggy and God will kill all kittens. On other hand, another bunch of smart ...
3
votes
2answers
1k views

Testing Java as Groovy

We're looking into improving our testing process for some of our applications, and the idea that's been put forward it to write unit tests in Groovy and automatically run them with Maven. The first ...
1
vote
1answer
123 views

Testing interaction with large CRM database

In our company we have two large systems, basically they are scoring and CRM. Both have large SQL Server databases running on Windows servers on the intranet. These two databases are managed by other ...
67
votes
11answers
6k views

Is there a reason that tests aren't written inline with the code that they test?

I've been reading a bit about Literate Programming recently, and it got me thinking... Well-written tests, especially BDD-style specs can do a better job at explaining what code does than prose does, ...
1
vote
4answers
165 views

Encountering the same issue in an application

I've often come across the situation when the same mistake is made in many places in an application. For example, in a web application when the user creates an item and clicks the Add button to save ...
2
votes
2answers
282 views

How do you track third party services SSL certificates?

Recently Windows Azure Storage SSL certificate unexpectedly expired and since a lot of dependent services defaulted to "refuse to connect to a site with expired SSL certificate" that became a serious ...
1
vote
1answer
3k views

Condition coverage for If(A && B) - measuring the input or code exercised?

I have been studying condition coverage for last few days. In a book "The Art of Software Testing" they highlight that it does not assure decision coverage, because for example IF(A && B) ...
0
votes
4answers
212 views

How to count condition coverage

I am wondering, What would be the correct condition coverage test cases for the following condition: if(A && E && (B || C || D)) Considering short circuiting, what cases would I ...
4
votes
3answers
316 views

Using testing branches in Git

We have someone (let's call him Ted) that is responsible for testing new features and bug fixes. We're using Git and GitHub. master should be/is always deployable and development is where we ...
3
votes
2answers
706 views

Functional testing and Acceptance testing leading to redundant code

What I know is: A Functional test aims to test a single component (like a WebApp's Controller) from the point of view of the developer. => Did I achieve all the requirements to make it work well? ...
0
votes
1answer
145 views

What the white box testers create test cases against?

I'm wondering, what are the white box testers using to create test cases? The actual code? Some kind of diagrams? I mean, if I am given a task to create test cases for complete branch coverage, is it ...
3
votes
4answers
212 views

How to handle committed and merged code that has no tests?

When developing an application in a team not everyone on this team will be equally good developers. Some will be skilled in some things and some in others and some not at all. As a team working in an ...
2
votes
2answers
360 views

Workflow for building a RESTful API

I am building a RESTful API, and so far, to make sure that my resources work as I need them to, I am using a REST client called Postman. This makes it easy for me to store routes and quickly make ...
5
votes
2answers
1k views

Event Driven Programming: A sequence of unfortunate events

I have a very basic game loop whose primary purpose is to check for updates & changes to a list. I have contemplated using event driven programming to replace the game loop/list idea with an ...
8
votes
3answers
661 views

Relative value of manual vs automated testing

The organisation I work for has recently employed a testing officer to run manual tests, but when I asked about being given time as a developer to write unit tests the response was that the manual ...
2
votes
1answer
2k views

Difference between functional test and integration test

I am deeply confused the difference. I've read so many definitions and they always explain functional test as testing the requirement is satisfied. Well, that's just rephrasing the name functional ...
4
votes
5answers
2k views

What is a good measure of testing/tester efficiency?

I am about to participate in a discussion with management regarding measuring our testing efficiency as a QA organization. The main reason behind this is that half of our team is contracted out and ...