Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

43
votes
7answers
8k views

How to deal with static utility classes when designing for testability

We are trying to design our system to be testable and in most parts developed using TDD. Currently we are trying to solve the following problem: In various places it is necessary for us to use static ...
-3
votes
0answers
27 views

What should I call the toolset for testing? [on hold]

According to wikipedia: .. test suite, less commonly known as a validation suite, is a collection of test cases .. At work however I see people use the term test-suite when they mean the ...
6
votes
1answer
441 views

Can Test-Driven development work in legacy projects?

So here is a question for you, having read some great answers to questions such as Test-Driven Development - Convince Me. So my question is: "Can Test-Driven Development be used effectively on ...
3
votes
1answer
89 views

How do you get complete testing/QA in a git/hg flow development process?

I have a question about working with independent testers (not about unit and regression testing.) In a flow process I do my work on a feature branch until I'm confident that it works and I haven't ...
31
votes
6answers
4k views

Testing multi-threaded race conditions

Reading the comments to this answer, specifically: Just because you can't write a test doesn't mean it's not broken. Undefined behaviour which usually happens to work as expected (C and C++ are ...
0
votes
0answers
15 views

web app+databse+object store E2E testing

I wrote a thin layer that allows me to log every interaction between other programs and object store. It has simple logic to accept and serve only unbroken files(if checksums provided by user and ...
2
votes
2answers
80 views

How do you pass/fail performance tests?

Example: A certain test is run five times on the current build, to compare it to release 1.0, where the same test was also run five times. Build 1.4 22 ms, 26 ms, 23 ms, 25 ms, 20 ms Release ...
2
votes
2answers
161 views

Is there a software industry for converting old, outdated code to new standards? [duplicate]

There still are developers building and extending applications using languages like COBOL, since banks and other such organizations rely on ancient systems to power their day to day businesses. Some ...
1
vote
2answers
113 views

Testing front-end app that hits a REST service

A lot of questions about testing here... And I have another one. Forgive me, but I want to make sure I do this right. Let's say I have a front-end application, be it a mobile app, or a single-page ...
0
votes
1answer
52 views

Development and testing PHP script that gets variables from external server

I have a web app that sends users to an offsite payment server to complete a transaction, and I'm working on the PHP page that users are returned to upon completion of the transaction. The script uses ...
1
vote
2answers
575 views

Should EICAR be updated to test the revision of Antivirus system?

I'm posting this here since programmers write viruses, and AV software. They also have the best knowledge of heuristics and how AV systems work (cloaking etc). The EICAR test file was used to ...
5
votes
4answers
119 views

How do you scale your integration testing?

I am investigating techniques and strategies for scaling our growing number of integration tests on our current product, so that they can (humanly) remain part of our development, and CI process. At ...
1
vote
2answers
146 views

How to unit test static void methods? [duplicate]

How does one go about unit testing static void methods? I have a few more questions: Is it necessary to unit test database queries like insert, select and update queries ? If so, how does one test ...
3
votes
1answer
131 views

How well am I writing my tests?

I've been coding as a career for about 2 years now but am just now writing my first "real" tests for a non-trivial application. I've been trying to follow best practices I've picked up from the ...
6
votes
5answers
2k views

What is a good measure of testing/tester efficiency?

I am about to participate in a discussion with management regarding measuring our testing efficiency as a QA organization. The main reason behind this is that half of our team is contracted out and ...
0
votes
1answer
112 views

Where should I store and verify files manipulated by an app

I'm working on a little Ruby script to move screenshots while renaming them based on a specific convention. I'll be writing tests to confirm the behavior. Ruby has lots of conventions for where to ...
5
votes
4answers
3k views

Behavior Driven Development and Unit Testing in Python [closed]

We might be interested in starting to incorporate a unit test suite to our project, which is coded in Python (and it uses Redis, PostgreSQL and some third-party libraries, if that bears into the ...
-1
votes
0answers
18 views

Java program exit function not working [migrated]

i'm a newbie to java so i decided to create a simple program that prints out even numbers. I tried to make it exit a while loop if you answered no to the question but it just keeps on going. Here's ...
0
votes
5answers
145 views

what gets testers invested in the releases they test? [closed]

For a lot of roles in a development team it is pretty obvious how these roles are invested in the quality of releases of their software. Developers who accidentally write bugs know that when the call ...
0
votes
3answers
136 views

What is the difference of smoke testing and black-box testing?

Main theme of my question is about the differences of Smoke Testing and other types of software testing specially Black-box testing but also I'm very curoius to know what is the purpose of this ...
3
votes
2answers
284 views

What UML diagram should be used for modelling permissions/users/files in Linux?

If I am planning a structure for support testing in Linux, a structure that will contain packages, such files as shell and build scripts, app configurations, DBs, sources, tests and jars for to be ...
1
vote
1answer
62 views

What to test for in a simple form where the value of one input field dictates other fields?

Note:- I have added android and iOS tags to this question but it is not necessarily restricted to those platforms. Consider a simple registration form where the the value of one field dictates what ...
0
votes
1answer
37 views

What is calendar time and execution time in terms of reliability testing?

What is calendar time and execution time in terms of reliability testing? My book is talking about the Musa Okumoto model and says that it uses calendar time and execution time. However googling and ...
1
vote
2answers
191 views

What is the real point of an “oracle” in the SW testing?

I know the definition of an testing oracle but to me, it seems to be overrated. I have a specification, why should I bother with thinking about oracles? I just compare what the spec wants and what the ...
4
votes
3answers
763 views

Does TDD formally use black box testing to supplement unit tests?

Unit tests are never perfect at capturing functionality, particularly in certain parts of an application (such as the GUI), so everyone needs some measure black box testing. Does TDD have anything to ...
1
vote
4answers
13k views

How to apply verification and validation on the following example

I have been following verification and validation questions here with my colleagues, yet we are unable to see the slight differences, probably caused by language barrier in technical English. An ...
0
votes
1answer
102 views

How do I actually use Selenium to automate UI testing? [closed]

We have a large inventory system where we work and making changes has the possibility to break things in other areas. This happens a lot, and it is hard to manually test for everything every time ...
0
votes
0answers
51 views

how to do test driven development for cgi / lua script

I'm new to cgi and just finished writing my test website using cgi / lua for an embedded device. Now I'd like to try writing some scripts to automate the testing of the various functions I have in my ...
18
votes
12answers
2k views

What problem does automated user interface testing solve?

We are currently investigating automated user interface testing (we currently do automated unit and integration testing). We've looked at Selenium and Telerik and have settled on the latter as the ...
5
votes
4answers
315 views

Are there any formalized/mathematical theories of software testing?

Googling "software testing theory" only seems to give theories in the soft sense of the word; I have not been able to find anything that would classify as a theory in the mathematical, information ...
7
votes
0answers
817 views

Math underpinnings of software testing? [duplicate]

In my software engineering course, we recently (briefly) covered testing. Over the course of the discussion some topics came up that made me wonder about the math underlying software testing (such as ...
3
votes
1answer
160 views

Is it reasonable for a client to expect automated test scripts as project deliverables?

Our company is currently halfway through a software project with a consulting firm. As someone who will be taking ownership of the project after the consultants finish, is it reasonable for our ...
0
votes
3answers
54 views

How to test Windows .NET TCP program handling of connection failure [closed]

I've written my own C# TCP communications module (using SocketAsyncEventArgs, although that's presumably irrelevant). My module runs at both ends of the connection, client and server. As part of the ...
59
votes
16answers
4k views

Is it reasonable to insist on reproducing every defect before diagnosing and fixing it?

I work for a software product company. We have large enterprise customers who implement our product and we provide support to them. For example, if there is a defect, we provide patches, etc. In other ...
197
votes
21answers
28k views

Leaving intentional bugs in code for testers to find

We don't do this at our firm, but one of my friends says that his project manager asked every dev to add intentional bugs just before the product goes to QA. This is how it works: Just before the ...
1
vote
2answers
39 views

Testing code in Java that is only loosely defined

My question is about testing in general. At school, professors say that testing has to be written before we begin to write some code. I guess we need to use EasyMock to represent the classes not ...
0
votes
1answer
46 views

How can I automatically test my app on multiple OSes? [closed]

I have a Python based desktop app that can run on Windows, Linux, and Mac. Each time I make an update, I would like to test that it works on each OS, because I have already had several OS-specific ...
0
votes
0answers
55 views

DBUnit alternatives to test DAO layer

We have a lot of DAO tests written with DBUnit and (it's ugly) datasoure. It's not that hard to edit it and add some new entries but it's annoying. Worse is that we have only one datasource for all ...
0
votes
1answer
207 views

Should developers be responsible for testing other developer and contractor/vendor code? [duplicate]

I have been working (~ 5 years & first IT job) as an application developer at a large financial institution with a strict corporate hierarchy, multiple LOBs, and heavily process-laden IT ...
6
votes
5answers
1k views

Test Driven Development: A good/accepted way to test file system operations?

I am working on a project at the moment that generates a table (among other things) based on the contents of a file-system, and and in turn does some meta-data modifications on the things it finds. ...
4
votes
2answers
113 views

How deep should we dive into testing different layers, i.e. Drupal's db_query?

We use Drupal 7 as our base CMS tool. For one specific product, something like an ERP, we've created sort of a non-drupal layer, to keep our specific business code in. It would be something like ...
2
votes
3answers
78 views

Property based testing without reimplementing the code under test

Given a very simple method such as: def squaredDistance(p1: Point, p2: Point) = math.pow(p1.lon - p2.lon, 2.0) + math.pow(p1.lat - p2.lat, 2.0) What are some valuable property-based tests ...
4
votes
3answers
110 views

What is Black Box Testing? Are Functional and Usability Testing its types?

I am writing about testing and I am confused about the following: What exactly is Black-Box testing? Are functional testing and Usability testing two different types of testing and are they types of ...
57
votes
11answers
6k views

Does path coverage guarantee finding all bugs?

If every path through a program is tested, does that guarantee finding all bugs? If not, why not? How could you go through every possible combination of program flow and not find the problem if one ...
1
vote
1answer
78 views

PHPUnit > Best approach to mock container objects? (e.g. $item->id)

I'm using PHPUnit test doubles to mock models, libraries etc. But when I want to return an array perhaps of container objects, how best to do so. Here is what I'm currently doing: /** * This is just ...
0
votes
2answers
122 views

Why not using questions in TDD tests descriptions [closed]

I've been a (small) while (ten months more or less) doing TDD for my own applications, trying to improve my skills following this workflow. Thus I am comfortable writing tests, stubbing, mocking, etc. ...
0
votes
1answer
59 views

Test logic with external data [duplicate]

I have a site programmed in PHP where I make more call to external server that return me big xml of data. For each record of the xml I have to make other external call to get other data. So my ...
3
votes
0answers
62 views

Is there an industry standard term for a build which uses the production API, but is specifically for internal testing? [closed]

I'm working on clearing up our build processes of a PhoneGap app we're developing for iOS and Android, and I want to develop a concise naming scheme for our different build types. Here's what I'm ...
2
votes
2answers
86 views

Managing scaffolding for debug vs production builds

The more I program the more I realize that most of my time is spent writing scaffolding for programs so that I can debug them and then strip away the scaffolding for production. The problem is that ...
3
votes
3answers
119 views

How to write tests for function that depends on a config file?

I have a function that uses information from a config file. How do I test the function? Ideally, I'd want to inject my own version of the config file and test from there, but I'm not using dependency ...