Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

2
votes
2answers
19 views

Test arrangement using the system under test

I have some integration tests around stored procs. Typically I do the test setup using Dapper. This is fine for simple cases, but in some cases to setup up the system correctly it would be far simpler ...
1
vote
3answers
40 views

Automation testing strategy with changing test cases

Say, for example, you have a program that sends a message to a server and that server validates it. Note: The server validation process can have additional test cases due to it being implemented in ...
11
votes
2answers
1k views

How to go about testing un-injectable code?

So I have the following piece of code in use all over my system. We're currently writing unit tests retrospectively (better late than never was my argument), but I don't see how this would be ...
-1
votes
1answer
93 views

How to get developers to fix broken tests

In our company we have multiple test stages: unit and integration tests (CI build) application tests (all calls to other systems are mocked) system tests (interacting with other systems) all ...
3
votes
4answers
160 views

Property based testing without reimplementing the code under test

Given a very simple method such as: def squaredDistance(p1: Point, p2: Point) = math.pow(p1.lon - p2.lon, 2.0) + math.pow(p1.lat - p2.lat, 2.0) What are some valuable property-based tests ...
23
votes
8answers
4k views

Wouldn't it be beneficial to write tests during code review?

A colleague of mine came up with an idea that I found interesting. Wouldn't it be beneficial to write tests during code review, by the person doing the review assuming that we don't do TDD? For ...
0
votes
1answer
60 views

What are unit tests called when they change data instead of relying on mocks or stubs?

What would you call a test that is similar to a unit test, except it actually modifies a file, directory, or database data? It is similar to a unit test in that it does test a single method of a ...
8
votes
4answers
361 views

Testing minor browser version compatibility

I develop a web application and we test it on several browsers, including Firefox and Internet Explorer. During our development we tested the application on Firefox 3.5.2 and our testing team tested ...
32
votes
6answers
3k views

Should there be unit tests for complex regular expressions?

Should I write unit tests for complex regular expressions in my application? On the one hand: they are easy to test because input and output format is often simple and well-defined, and they can ...
20
votes
12answers
4k views

How To Know When To Stop Testing?

I know this is a very very basic question. For some software applications there are a large almost infinitely high number of test cases for an application. It is not practical to test all those test ...
43
votes
7answers
3k views

Does software testing methodology rely on flawed data?

It’s a well-known fact in software engineering that the cost of fixing a bug increases exponentially the later in development that bug is discovered. This is supported by data published in Code ...
78
votes
12answers
7k views

Is there a reason that tests aren't written inline with the code that they test?

I've been reading a bit about Literate Programming recently, and it got me thinking... Well-written tests, especially BDD-style specs can do a better job at explaining what code does than prose does, ...
-1
votes
5answers
505 views

How to ascertain from the users if performance tuning has had the desired effect [closed]

So you've made some code changes that should hopefully speed up some part of an application. But there is just one problem - you don't know how it will perform in live. Different networks, different ...
8
votes
5answers
3k views

Test Driven Development: A good/accepted way to test file system operations?

I am working on a project at the moment that generates a table (among other things) based on the contents of a file-system, and in turn does some meta-data modifications on the things it finds. The ...
0
votes
1answer
46 views

UI Testing and Code Coverage [closed]

My company wants me to write UI tests that test the business logic (all of the use cases MUST be independently testable) I decided to do it in selenium. I have managed to create a decent product (as ...
1
vote
1answer
32 views

Abstracting end-to-end test cases across multiple pages

I am using Protractor and Jasmine to create end-to-end tests for a webpage. To test this initial page, I have abstracted made some common utility functions to create about 20 test cases for this ...
2
votes
1answer
35 views

Use Coded UI Tests for Integration

I have a couple of users who have a User Interface for an application that they must use to do their job. The UI can be cumbersome to navigate to perform some time critical tasks. This UI does not ...
69
votes
10answers
7k views

Are (database) integration tests bad?

Some people maintain that integration tests are all kinds of bad and wrong - everything must be unit-tested, which means you have to mock dependencies; an option which, for various reasons, I'm not ...
1
vote
0answers
46 views

Determining if webgl code will work on a variety of hardware

I have some javascript/webgl code. I want to have some idea of whether it will work for someone with a different browser/machine/gpu. This is difficult, because there's so much diversity in support ...
8
votes
2answers
550 views

Unit Testing a stateful framework such as Phaser?

TL;DR I need help in identifying techniques to simplify automated unit testing when working within a stateful framework. Background: I'm currently writing a game in TypeScript and the Phaser ...
2
votes
1answer
52 views

Writing Automated test cases for a folder Archiving Class.

Using C# and Visual Studio, I've developed a class that zips and archives a folder into desired location, creating directories and manipulating files on a machine. The intended use is as an part of ...
32
votes
9answers
5k views

How can QA staff test caching logic that they can't see?

I just implemented a caching layer in my web application, and now I'm wondering how QA is supposed to test it, since caching is transparent to the user. One idea I have is to put logging in the ...
-2
votes
1answer
86 views

Test Cases in an Interview Setting

In the first cracking the coding interview video Ms. McDowell talks about candidates that begin by writing test cases in whiteboard interviews. How would one go about this? For example, the ...
0
votes
0answers
27 views

Does CI servers allow maven to generate content outside target directory?

I'm maintaining a Multi Module Maven project, I have a module that contains some tests, the tests run smoothly locally, but on the integration server they don't, and the logs shows only FileNotFound ...
5
votes
3answers
173 views

Should unit tests always overlap

This is a test design question. I have a class 'handler' that accepts a 'validator' that checks some business logic on what's passed to the handler. I made the unit tests for the validator and now ...
64
votes
17answers
5k views

Is it reasonable to insist on reproducing every defect before diagnosing and fixing it?

I work for a software product company. We have large enterprise customers who implement our product and we provide support to them. For example, if there is a defect, we provide patches, etc. In other ...
1
vote
1answer
69 views

Testing a bootloader written from scratch?

I'm planning to write a simple bootloader. Nothing too complicated. Just really basic output and maybe keyboard input. But it seems a bit crazy to restart my computer every time I want to run the ...
1
vote
2answers
68 views

How short/stable should tests/build be for working CI/CD pipeline?

(Please note that this question is linked to this: How can Continuous Delivery work in practice? - but it asks a more specific question regarding time and stability). CI/CD, no manual QA, super quick ...
1
vote
1answer
167 views

Should I have code that only exists for testing?

I have a service class which is responsible for instantiating repositories and using them. It makes an external Http request which ideally I would like to mock for testing. However, I am not quite ...
5
votes
2answers
202 views

Is this the wrong environment for CI?

Background Team/Project Size Currently at our company, we have a team of 3 developers. We each have our own projects that we work on. So, we never have more than one person working on a software ...
13
votes
6answers
485 views

How do you scale your integration testing?

I am investigating techniques and strategies for scaling our growing number of integration tests on our current product, so that they can (humanly) remain part of our development, and CI process. At ...
0
votes
0answers
36 views

Tracking a program-wide state of tasks being done and making it testable

I have a program which does some processing which can be asynchronously requested (WCF). There should be only one computation per identifier (always supplied upon request). So if at some point work is ...
0
votes
2answers
107 views

Spring-MVC : Testing code by automatically running it in UI

I am working on a Spring-MVC application(config XML based, no Main class) in which I would like to do testing. I have known that there is a way to test code which is backend+frontend code. For that, I ...
0
votes
0answers
13 views

Approach for efficiently working on view controllers in iOS app

When working on a specific view controller within an app, my approach has always been to make some changes to the code, launch the app, navigate to the view controller and see if everything is ...
1
vote
4answers
124 views

How and where to test if the JSON request objects generated by the front-end is valid

We have built a complex Angular application that sends multiple HTTP request to a REST service that is also built in house. Since both the frontend and the backend is being developed in parallel, ...
1
vote
5answers
3k views

Should each method have a seperate JUnit test class?

I am writing JUnit unit tests for my classes. Is it better to have a separate class for each method, or have just one test class for every actual class?
2
votes
3answers
208 views

Browser Web Application UI/End User Testing

I am building a web application in php. I am following TDD (write tests before production code) for my unit tests and using BDD to drive discovery of my applications features and to provide ...
3
votes
1answer
64 views

GUI Testing With Network

I am doing GUI tests for my network application and I'm wondering if I should stub out mock responses, or if it's OK to keep using the network for the GUI tests. It seems to me the main benefits of ...
1
vote
2answers
111 views

From a software development lifecycle perspective, is duck-typing a benefit or a problem?

Statically-typed languages such as Java afford the benefit of compile-time checking of types - you are guaranteed that an object is of a given type, so: there is no need to spend time and resources ...
4
votes
5answers
91 views

What are the best practices for managing Test results

We are using GitHub for managing source code and waffle board for managing workflow/issues. Right now when we test the system using custom written test cases, it generates a CSV file. We want to be ...
7
votes
3answers
220 views

What should be the scope of a health check for a system which deploys a webapp?

Today I had a task to "write a health check" for a long running service that is an orchestration system to deploy a web-app. I am trying to determine what the scope for such a health check would be, ...
5
votes
2answers
167 views

The concept of “quality gates” in software testing

We are using SonarQube for code quality testing. It tests the quality of code, and not the function of code. It has the concept of quality gates, so you can set for instance a 90% quality gate, ...
1
vote
2answers
62 views

How much optimisation should one put in for slow integration test setups

I have some very slow integration tests that use Selenium and require a lot of database setup. The setup and tear down times are in the order of tens of seconds while the test bodies only take a few ...
3
votes
4answers
111 views

Test cases do all the work through helper method — bad practice?

Consider a test suite like this: public class MyTestSuite { @Test public void test_something() { testHelperMethod("value11", "value12", "value13"); } @Test public void ...
2
votes
1answer
142 views

What is the proper infrastructure and release cycle for developing and testing an application? [closed]

I am developing a web application for my coworkers, and from a little management app it is becoming a more and intense large project that is involving more people as I go. I am pretty sure my boss ...
4
votes
3answers
165 views

What kinds of bugs can integration testing actually find?

I feel like, in web dev at least, that integration tests can't really find any useful bugs. I can't think of any, at least. If I can use unit tests to verify that one section of my code calls a ...
0
votes
0answers
23 views

Writing test cases for another web service

I'm working in a team as a developer. We have developed a product where we generate letters by populating some XML file. This XML file ONLY contains some texts that need to show up in a pdf document. ...
5
votes
4answers
203 views

Can we encourage our test team to collaborate with developers on automating tests?

I am a C# developer, and my team and I are trying to start automated functional tests. (Note that we don't want to do Unit Tests; we expect to develop tests which test one function point per test) ...
3
votes
1answer
59 views

How do you properly test a complete software replacement

We have System A (an application and a database) that is built for a specific business department and therefore has business aligned data model and table structure. System A is a mission critical ...
7
votes
1answer
156 views

How to test calculations that are only passed down into the stack rather than returned upward

This is a problem I have been trying to wrap my head around a couple months now. It has shown up again in a learning project I was working on last night, so I will use that as an example. I am ...