Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

8
votes
5answers
3k views

Test Driven Development: A good/accepted way to test file system operations?

I am working on a project at the moment that generates a table (among other things) based on the contents of a file-system, and in turn does some meta-data modifications on the things it finds. The ...
-1
votes
0answers
28 views

When writing test cases for node modules, where does testing begin?

Let's say I wrote a node module that is a blogging engine. There are hundreds or thousands of functions that goes into a large application. Where does writing the test case start? Possibly, a lower ...
0
votes
1answer
36 views

UI Testing and Code Coverage [on hold]

My company wants me to write UI tests that test the business logic (all of the use cases MUST be independently testable) I decided to do it in selenium. I have managed to create a decent product (as ...
1
vote
1answer
28 views

Abstracting end-to-end test cases across multiple pages

I am using Protractor and Jasmine to create end-to-end tests for a webpage. To test this initial page, I have abstracted made some common utility functions to create about 20 test cases for this ...
2
votes
1answer
34 views

Use Coded UI Tests for Integration

I have a couple of users who have a User Interface for an application that they must use to do their job. The UI can be cumbersome to navigate to perform some time critical tasks. This UI does not ...
69
votes
10answers
7k views

Are (database) integration tests bad?

Some people maintain that integration tests are all kinds of bad and wrong - everything must be unit-tested, which means you have to mock dependencies; an option which, for various reasons, I'm not ...
1
vote
0answers
35 views

Determining if webgl code will work on a variety of hardware

I have some javascript/webgl code. I want to have some idea of whether it will work for someone with a different browser/machine/gpu. This is difficult, because there's so much diversity in support ...
8
votes
2answers
538 views

Unit Testing a stateful framework such as Phaser?

TL;DR I need help in identifying techniques to simplify automated unit testing when working within a stateful framework. Background: I'm currently writing a game in TypeScript and the Phaser ...
2
votes
1answer
48 views

Writing Automated test cases for a folder Archiving Class.

Using C# and Visual Studio, I've developed a class that zips and archives a folder into desired location, creating directories and manipulating files on a machine. The intended use is as an part of ...
32
votes
9answers
5k views

How can QA staff test caching logic that they can't see?

I just implemented a caching layer in my web application, and now I'm wondering how QA is supposed to test it, since caching is transparent to the user. One idea I have is to put logging in the ...
-2
votes
1answer
78 views

Test Cases in an Interview Setting

In the first cracking the coding interview video Ms. McDowell talks about candidates that begin by writing test cases in whiteboard interviews. How would one go about this? For example, the ...
0
votes
0answers
20 views

Does CI servers allow maven to generate content outside target directory?

I'm maintaining a Multi Module Maven project, I have a module that contains some tests, the tests run smoothly locally, but on the integration server they don't, and the logs shows only FileNotFound ...
5
votes
3answers
160 views

Should unit tests always overlap

This is a test design question. I have a class 'handler' that accepts a 'validator' that checks some business logic on what's passed to the handler. I made the unit tests for the validator and now ...
64
votes
17answers
5k views

Is it reasonable to insist on reproducing every defect before diagnosing and fixing it?

I work for a software product company. We have large enterprise customers who implement our product and we provide support to them. For example, if there is a defect, we provide patches, etc. In other ...
1
vote
1answer
67 views

Testing a bootloader written from scratch?

I'm planning to write a simple bootloader. Nothing too complicated. Just really basic output and maybe keyboard input. But it seems a bit crazy to restart my computer every time I want to run the ...
1
vote
2answers
56 views

How short/stable should tests/build be for working CI/CD pipeline?

(Please note that this question is linked to this: How can Continuous Delivery work in practice? - but it asks a more specific question regarding time and stability). CI/CD, no manual QA, super quick ...
0
votes
1answer
160 views

Should I have code that only exists for testing?

I have a service class which is responsible for instantiating repositories and using them. It makes an external Http request which ideally I would like to mock for testing. However, I am not quite ...
5
votes
3answers
188 views

Is this the wrong environment for CI?

Background Team/Project Size Currently at our company, we have a team of 3 developers. We each have our own projects that we work on. So, we never have more than one person working on a software ...
0
votes
0answers
3 views

Problems with buffer telnetlib [migrated]

I'm developing a software which make telnet connections to send the scripts to the routers. I need to save the logs of each router in txt files but at the end the shows commands saves are incomplete, ...
-1
votes
0answers
40 views

Writing an Overall test plan for a system?

I need to write an overall test plan for a system outlining our strategy for Verification and validation testing. In this document i need to include a strategy for unit testing, integration testing ...
13
votes
6answers
465 views

How do you scale your integration testing?

I am investigating techniques and strategies for scaling our growing number of integration tests on our current product, so that they can (humanly) remain part of our development, and CI process. At ...
0
votes
0answers
35 views

Tracking a program-wide state of tasks being done and making it testable

I have a program which does some processing which can be asynchronously requested (WCF). There should be only one computation per identifier (always supplied upon request). So if at some point work is ...
0
votes
2answers
102 views

Spring-MVC : Testing code by automatically running it in UI

I am working on a Spring-MVC application(config XML based, no Main class) in which I would like to do testing. I have known that there is a way to test code which is backend+frontend code. For that, I ...
0
votes
0answers
12 views

Approach for efficiently working on view controllers in iOS app

When working on a specific view controller within an app, my approach has always been to make some changes to the code, launch the app, navigate to the view controller and see if everything is ...
1
vote
4answers
117 views

How and where to test if the JSON request objects generated by the front-end is valid

We have built a complex Angular application that sends multiple HTTP request to a REST service that is also built in house. Since both the frontend and the backend is being developed in parallel, ...
1
vote
5answers
3k views

Should each method have a seperate JUnit test class?

I am writing JUnit unit tests for my classes. Is it better to have a separate class for each method, or have just one test class for every actual class?
2
votes
3answers
200 views

Browser Web Application UI/End User Testing

I am building a web application in php. I am following TDD (write tests before production code) for my unit tests and using BDD to drive discovery of my applications features and to provide ...
3
votes
1answer
62 views

GUI Testing With Network

I am doing GUI tests for my network application and I'm wondering if I should stub out mock responses, or if it's OK to keep using the network for the GUI tests. It seems to me the main benefits of ...
1
vote
2answers
107 views

From a software development lifecycle perspective, is duck-typing a benefit or a problem?

Statically-typed languages such as Java afford the benefit of compile-time checking of types - you are guaranteed that an object is of a given type, so: there is no need to spend time and resources ...
4
votes
5answers
88 views

What are the best practices for managing Test results

We are using GitHub for managing source code and waffle board for managing workflow/issues. Right now when we test the system using custom written test cases, it generates a CSV file. We want to be ...
7
votes
3answers
209 views

What should be the scope of a health check for a system which deploys a webapp?

Today I had a task to "write a health check" for a long running service that is an orchestration system to deploy a web-app. I am trying to determine what the scope for such a health check would be, ...
5
votes
2answers
134 views

The concept of “quality gates” in software testing

We are using SonarQube for code quality testing. It tests the quality of code, and not the function of code. It has the concept of quality gates, so you can set for instance a 90% quality gate, ...
1
vote
2answers
59 views

How much optimisation should one put in for slow integration test setups

I have some very slow integration tests that use Selenium and require a lot of database setup. The setup and tear down times are in the order of tens of seconds while the test bodies only take a few ...
3
votes
4answers
104 views

Test cases do all the work through helper method — bad practice?

Consider a test suite like this: public class MyTestSuite { @Test public void test_something() { testHelperMethod("value11", "value12", "value13"); } @Test public void ...
2
votes
1answer
136 views

What is the proper infrastructure and release cycle for developing and testing an application? [closed]

I am developing a web application for my coworkers, and from a little management app it is becoming a more and intense large project that is involving more people as I go. I am pretty sure my boss ...
4
votes
3answers
159 views

What kinds of bugs can integration testing actually find?

I feel like, in web dev at least, that integration tests can't really find any useful bugs. I can't think of any, at least. If I can use unit tests to verify that one section of my code calls a ...
0
votes
0answers
15 views

Writing test cases for another web service

I'm working in a team as a developer. We have developed a product where we generate letters by populating some XML file. This XML file ONLY contains some texts that need to show up in a pdf document. ...
5
votes
4answers
203 views

Can we encourage our test team to collaborate with developers on automating tests?

I am a C# developer, and my team and I are trying to start automated functional tests. (Note that we don't want to do Unit Tests; we expect to develop tests which test one function point per test) ...
3
votes
1answer
58 views

How do you properly test a complete software replacement

We have System A (an application and a database) that is built for a specific business department and therefore has business aligned data model and table structure. System A is a mission critical ...
7
votes
1answer
154 views

How to test calculations that are only passed down into the stack rather than returned upward

This is a problem I have been trying to wrap my head around a couple months now. It has shown up again in a learning project I was working on last night, so I will use that as an example. I am ...
1
vote
0answers
36 views

Rules of thumb for test coverage [closed]

In general it makes sense to me to unit test everything besides glue classes which have no logic. They often catch mistakes and code smells even at the time of writing let alone protecting you from ...
0
votes
2answers
80 views

How can I test code that verifies data sanity?

I have a large data structure that gets read in from XML. I've been given a large list of constraints that should hold between data members. For example, one of the constraints might look like ...
4
votes
2answers
72 views

Testing strategies for interpreter language parser

For a recent personal project, I started working on an interpreter for my own programming language. One of the ground rules I set for myself on this project is that I need to properly test as much of ...
0
votes
2answers
57 views

Possible to get path coverage but not condition coverage or other way around?

I was wondering if it was possible to get path coverage(executing all paths) but not condition coverage? Also, how about the other way, condition coverage, but not path coverage? A concrete example ...
3
votes
1answer
93 views

Is it unreasonable to implement a small domain specific scripting language?

At my new job, they are currently spending scores of labor hours that we don't have to do manual QA testing after every build. Nothing is automated at all. (We can only afford three developers, and ...
2
votes
2answers
81 views

How to enable my team to run integration tests against RedShift in parallel?

I am working with Docker to run my integration tests, it works pretty nice: I startup my docker containers (one with my server and one with the database) I run the IT using arquillian against these ...
1
vote
0answers
39 views

How are JSON Web Token validators tested?

JSON Web Tokens (JWTs) are an open, industry standard method for representing claims securely between two parties. There are numerous implementations for JWT verification, but it looks like each ...
79
votes
20answers
10k views

Why does TDD work? [closed]

Test-driven development (TDD) is big these days. I often see it recommended as a solution for a wide range of problems here in Programmers SE and other venues. I wonder why it works. From an ...
-1
votes
1answer
69 views

Considering the testing software issues when designing software [closed]

When designing the software, must we consider how much this code could be testable? for example, if we used X technology/Class/Interface instead of Y, based on that X can be tested more easily than Y, ...
68
votes
5answers
18k views

What are the key points of Working Effectively with Legacy Code? [closed]

I've seen the book Working Effectively with Legacy Code recommended a few times. What are the key points of this book? Is there much more to dealing with legacy code than adding unit/integration ...