Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

-1
votes
1answer
78 views

Writing data driven reflection based tests to ensure design completeness [closed]

When writing software I'm often forced to at some point to make a decision that involves a design pattern of "by convention" naming and behavioral patterns. This normally makes me feel kind of slimy ...
-1
votes
5answers
452 views

The emperor's new code, or: how to communicate code efficiencies [closed]

So you've made some code changes that should hopefully speed up some part of an application. But there is just one problem - you don't know how it will perform in live. Different networks, different ...
13
votes
4answers
2k views

Is there a point to unit tests that stub and mock everything public?

When doing unit tests the "proper" way, i.e. stubbing every public call and return preset values or mocks, I feel like I'm not actually testing anything. I'm literally looking at my code and creating ...
2
votes
1answer
208 views

Approaches to isolating tests that require a database? [duplicate]

Suppose I have component A,B,C that all put some data into a database. Each component depends on data in the database inserted by the previous component. How do I test these modules in isolation? I ...
0
votes
0answers
146 views

What is a UNiversal IT Test (UNITT) and how do I prepare for one?

I will be taking an advanced PHP UNiversal IT Test (UNITT) for a position I am applying for. However, I am unfamiliar with the term 'unitt test'. What is a unitt test and how would a company ...
0
votes
1answer
90 views

Is context-driven testing suitable for all projects?

One thing I cannot find anywhere is: is this approach limited to non-critical software? Because in critical (or just when customer wants us to follow his rules) we have no freedom in testing and just ...
3
votes
1answer
167 views

Shared context: good or bad?

RSpec allows users to share context across tests / examples, which would reduce the number of code lines in my app by a significant amount. On the other hand, somehow related to the question of ...
2
votes
4answers
397 views

What is the benefit of the MoSCoW technique?

I do not see how the MoSCoW Method's "Must, Should, Could, Would" prioritisation is better that simply 1,2,3,4? If I receive the requirements from the customer, they already are prioritised, usually ...
-6
votes
1answer
228 views

Hallway usability testing and quiet working environment together

How can one achieve both the 8th and 12th point, i.e. Do programmers have quiet working conditions? and Do you do hallway usability testing? mentioned in The Joel Test: 12 Steps to Better ...
3
votes
6answers
445 views

Why don't I see many unit test projects that bring up and tear down a DB? (ASP.NET MVC)

I see all the examples that demonstrate unit testing code and mocking the calls to the DB since you are not suppose to touch the DB. But it seems to me having a set up tasks that uses the actually ...
0
votes
3answers
170 views

How to organize the quality testing of a large website?

I developed a pretty big website. I tested it myself to the best of my ability, but I cannot test all scenarios that my users may run in to. I found a testing team in India, but they don't seem to ...
2
votes
4answers
587 views

Using only UI testing. Is that Ok?

I am a sole developer working with an offshore employer. I do realize the importance of unit testing (although haven't practiced before) but currently, the code hasn't ever been tested. The problem ...
3
votes
2answers
165 views

Is there a name for the school of thought behind writing tests? [closed]

Essentially it is a branch of software engineering but SE itself is too large an umbrella. I was curious if there was a title for the knowledge base that encompasses TDD, BDD, mocks/stubs/spys, unit ...
1
vote
2answers
134 views

How to handle product rebranding in code in a short time frame

We've all been there - a product feature is called "gold", and then a week before launch they decide it is to be called "platinum". Luckily, you had some nous about you so the UI code is easy to ...
6
votes
2answers
435 views

Feature branches, beta branches, and scrapped features

I've been thinking a lot about best practices regarding branching in distributed version control systems such as git an mercurial (the two dvcs's I have experience with and use on a daily basis). The ...
1
vote
1answer
192 views

Pairwise testing, not possible to say which combinations is faulty?

Let's say I have 4 (A,B,C,D) parameters with 3 possible values, also 81 unique combinations. With e.g. orthogonal array, I will end up with 9 test cases, each combining 3 pairs. But that means that if ...
1
vote
2answers
473 views

How to ensure a project 100% tested?

I want to know how exactly, we can ensure that a project is 100% tested ? In banking or financial applications not 1% also tolerable. So being a developer, how can you say your code is 100% tested? ...
3
votes
1answer
318 views

How to keep unit tests independent?

I've read it at many places that unit tests should be independent. In my case I have a class that does data transformation. These steps must be done sequentially, otherwise they don't make sense. For ...
25
votes
5answers
2k views

Testing multi-threaded race conditions

Reading the comments to this answer, specifically: Just because you can't write a test doesn't mean it's not broken. Undefined behaviour which usually happens to work as expected (C and C++ are ...
2
votes
2answers
157 views

How can a beginning programmer begin to learn and apply testing best practices when developing software?

While learning to develop in PHP it has been easy enough that my short, one page, 20 line little scripts I could add "testing code" directly to my functions to figure out where I am or get close to ...
3
votes
1answer
159 views

Is equivalence partitioning part of negative testing?

I assume that negative testing is an approach to design the test cases and so is equivalence partitioning. But I am not sure if NT is a part of ET. An example: A field can accept a numeric value from ...
0
votes
2answers
202 views

How to use lists in equivalence partitioning?

I have read that equivalence partitioning can be used typically for intervals or lists, e.g. I assume it can be used for every set of inputs. Anyway if the requirement says that allowed colors are ...
3
votes
1answer
108 views

Stubbing and mocking boundaries

Suppose I'm building a JSON API and would like to include an endpoint that returns a list of recently created posts. Somewhere in my system is an existing Post model with the following test: create ...
1
vote
8answers
393 views

Improve Bad testing [closed]

We have a large team of developers and testers. The ratio is one tester for every one developer. We have full bug tracking and reporting systems in place. We have test plans in place. Every change ...
1
vote
2answers
155 views

What is the real point of an “oracle” in the SW testing?

I know the definition of an testing oracle but to me, it seems to be overrated. I have a specification, why should I bother with thinking about oracles? I just compare what the spec wants and what the ...
0
votes
1answer
187 views

Coping with test code becoming too complex [duplicate]

Our test automation team writes tons of automation tests for our WEB application, but it seems to me that their code is becoming way too complex and warrants that someone will test it as well. Is ...
2
votes
1answer
217 views

What is the difference, if any, between Model and QA environments?

I have worked for various organizations many of whom call their environment that comes after the test/developer environment and before the staging and/or production environment either model or QA. ...
2
votes
5answers
133 views

Keeping test and release version numbers in sync

I'm currently beta-testing an iPhone app. Right now I have sent out the first beta-test for my users and I have labeled that release as 1.0 for my testers. Now since the testers have tested the app ...
3
votes
1answer
134 views

Unit Testing and “Fit”

I am reading Cristopher Alexander's "Notes on the Synthesis of Form", and he is describing a solution to a problem as having good fit, when there is an absence of bad fit; we can't describe all of the ...
1
vote
2answers
372 views

Why is SIT called SIT when it serves for system testing?

I should define a testing strategy and environments and I have encountered rather terminology issue (but might well be my fault) so I hope someone will correct me here. We are using INT environment ...
1
vote
2answers
197 views

If functional testing is referred as black box..how can it be done on unit test level?

Preparing myself for ISTQB, I found a bit odd many things in their textbooks. E.g. they call black box testing as functional testing when you are not concerned with structured but only observe the ...
2
votes
1answer
2k views

Integration testing in en example - confused

I know that integration testing means integrating unit tested moduls and testing for interface errors etc. But in real world examples, I am kinda lost. Here is an example of our system: Back end ...
3
votes
2answers
524 views

How many regression bugs from refactoring is too many.

Recent QA testing has found some regression bugs in our code. My team lead blames recent refactoring efforts for the regressions. My team lead's stance is "refactor, but don't break too many things", ...
3
votes
5answers
2k views

Understanding unit tests/TDD for ASP.NET webforms [closed]

I'm the lead programmer at a small software firm (currently 4 developers including myself), we develop bespoke ASP.NET WebForms applications for businesses. I joined there in 2010 just after ...
4
votes
1answer
5k views

How can I unit-test my REST web service?

I am new to unit testing, I've one REST web method that just calls DB and populates a DTO. Pseudo code is public object GetCustomer(int id) { CustomerDTO objCust = //get from DB return objCust; } ...
3
votes
2answers
3k views

What is a Developer in Test?

I was recently talking with a recruiter who wants to put me at a company for a position of Developer in Test. He essentially made it sound like a position where you get to fiddle with new programming ...
0
votes
2answers
295 views

Beta-testing app good practice [duplicate]

I have just released an iOS app for beta-testing with TestFlight. I'm wondering what is good practice during beta-testing? Should I halt development of the app during beta-testing? Should I ...
4
votes
7answers
596 views

Can a developer perform testing efficiently? [duplicate]

I don't know yet how it feels to be a part of dev/testing teams. If in an organization (mostly single-product company), can a developer handle testing efficiently? From what I have read: ...
1
vote
2answers
606 views

Test case design - do for all positive tests exist also negative ones?

There is ambiguity in all papers I have read so I would like to ask about the following requirement: Requirement: Being a Game master, I can access the GM menu by typing "menuInvoke". Trying to do ...
6
votes
9answers
3k views

Negative test cases confusion

In the Software testing book from Koirala, Sheihk, they say: A positive test is when you put in a valid input and expect some action to be completed in accordance with the specification. A ...
13
votes
4answers
2k views

Why does Cem Kaner consider a test not revealing a bug a waste of time?

What about confirming the functionality in positive tests, proving it is working - should I say it is a waste of time? What kind of concept is behind this quote? Unsuccessful tests, i.e. tests ...
5
votes
3answers
608 views

In TDD, if I write a test case that passes without modifying production code, what does that mean?

These are Robert C. Martin's rules for TDD: You are not allowed to write any production code unless it is to make a failing unit test pass. You are not allowed to write any more of a unit test than ...
4
votes
3answers
3k views

Test planning for an Agile sprint

Can anyone offer any tips or experience on developing a test plan for an Agile sprint? Most of the time our team simply creates a "Test Feature X" task and goes about writing ad-hoc test cases. There ...
5
votes
1answer
345 views

Shared QA responsibilities on an Agile team

For many years our IT development group subscribed to the waterfall software development methodology with segregated pods of programmers specializing in database development, logic layer and ...
4
votes
2answers
302 views

Can I start with a passing unit test?

Uncle Bob's rules for TDD are specified here. You are not allowed to write any production code unless it is to make a failing unit test pass. You are not allowed to write any more of a unit test ...
13
votes
3answers
800 views

Brittle unit tests due to need for excessive mocking

I've been struggling with an increasingly annoying problem regarding our unit tests that we are implementing in my team. We are attempting to add unit tests into legacy code that wasn't well designed ...
3
votes
5answers
163 views

How many different configurations are used for software tests?

This article shows that for Android apps, software developers use between 30 and 50 different devices for compatibility tests. I tried to find information about tests of applications on "classic" ...
19
votes
7answers
1k views

Should I test inherited methods?

Suppose I have a class Manager derived from a base class Employee, and that Employee has a method getEmail() that is inherited by Manager. Should I test that the behaviour of a manager's getEmail() ...
17
votes
4answers
2k views

Why is test driven development missing from Joel's Test?

I was reading this blog by Joel Spolsky about 12 steps to better code. The absence of Test Driven Development really surprised me. So I want to throw the question to the Gurus. Is TDD not really worth ...
7
votes
1answer
414 views

Unit testing in Django

I'm really struggling to write effective unit tests for a large Django project. I have reasonably good test coverage, but I've come to realize that the tests I've been writing are definitely ...