Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

4
votes
2answers
24 views

Test arrangement using the system under test

I have some integration tests around stored procs. Typically I do the test setup using Dapper. This is fine for simple cases, but in some cases to setup up the system correctly it would be far simpler ...
1
vote
3answers
44 views

Automation testing strategy with changing test cases

Say, for example, you have a program that sends a message to a server and that server validates it. Note: The server validation process can have additional test cases due to it being implemented in ...
13
votes
2answers
1k views

How to go about testing un-injectable code?

So I have the following piece of code in use all over my system. We're currently writing unit tests retrospectively (better late than never was my argument), but I don't see how this would be ...
-1
votes
1answer
93 views

How to get developers to fix broken tests

In our company we have multiple test stages: unit and integration tests (CI build) application tests (all calls to other systems are mocked) system tests (interacting with other systems) all ...
0
votes
1answer
61 views

What are unit tests called when they change data instead of relying on mocks or stubs?

What would you call a test that is similar to a unit test, except it actually modifies a file, directory, or database data? It is similar to a unit test in that it does test a single method of a ...
24
votes
8answers
4k views

Wouldn't it be beneficial to write tests during code review?

A colleague of mine came up with an idea that I found interesting. Wouldn't it be beneficial to write tests during code review, by the person doing the review assuming that we don't do TDD? For ...
33
votes
6answers
3k views

Should there be unit tests for complex regular expressions?

Should I write unit tests for complex regular expressions in my application? On the one hand: they are easy to test because input and output format is often simple and well-defined, and they can ...
0
votes
1answer
47 views

UI Testing and Code Coverage [closed]

My company wants me to write UI tests that test the business logic (all of the use cases MUST be independently testable) I decided to do it in selenium. I have managed to create a decent product (as ...
1
vote
1answer
32 views

Abstracting end-to-end test cases across multiple pages

I am using Protractor and Jasmine to create end-to-end tests for a webpage. To test this initial page, I have abstracted made some common utility functions to create about 20 test cases for this ...
2
votes
1answer
39 views

Use Coded UI Tests for Integration

I have a couple of users who have a User Interface for an application that they must use to do their job. The UI can be cumbersome to navigate to perform some time critical tasks. This UI does not ...
1
vote
0answers
46 views

Determining if webgl code will work on a variety of hardware

I have some javascript/webgl code. I want to have some idea of whether it will work for someone with a different browser/machine/gpu. This is difficult, because there's so much diversity in support ...
2
votes
1answer
53 views

Writing Automated test cases for a folder Archiving Class.

Using C# and Visual Studio, I've developed a class that zips and archives a folder into desired location, creating directories and manipulating files on a machine. The intended use is as an part of ...
0
votes
0answers
28 views

Does CI servers allow maven to generate content outside target directory?

I'm maintaining a Multi Module Maven project, I have a module that contains some tests, the tests run smoothly locally, but on the integration server they don't, and the logs shows only FileNotFound ...
5
votes
3answers
175 views

Should unit tests always overlap

This is a test design question. I have a class 'handler' that accepts a 'validator' that checks some business logic on what's passed to the handler. I made the unit tests for the validator and now ...
1
vote
1answer
69 views

Testing a bootloader written from scratch?

I'm planning to write a simple bootloader. Nothing too complicated. Just really basic output and maybe keyboard input. But it seems a bit crazy to restart my computer every time I want to run the ...
1
vote
1answer
167 views

Should I have code that only exists for testing?

I have a service class which is responsible for instantiating repositories and using them. It makes an external Http request which ideally I would like to mock for testing. However, I am not quite ...
1
vote
2answers
69 views

How short/stable should tests/build be for working CI/CD pipeline?

(Please note that this question is linked to this: How can Continuous Delivery work in practice? - but it asks a more specific question regarding time and stability). CI/CD, no manual QA, super quick ...
5
votes
2answers
202 views

Is this the wrong environment for CI?

Background Team/Project Size Currently at our company, we have a team of 3 developers. We each have our own projects that we work on. So, we never have more than one person working on a software ...
0
votes
0answers
36 views

Tracking a program-wide state of tasks being done and making it testable

I have a program which does some processing which can be asynchronously requested (WCF). There should be only one computation per identifier (always supplied upon request). So if at some point work is ...
-2
votes
1answer
87 views

Test Cases in an Interview Setting

In the first cracking the coding interview video Ms. McDowell talks about candidates that begin by writing test cases in whiteboard interviews. How would one go about this? For example, the ...
0
votes
0answers
13 views

Approach for efficiently working on view controllers in iOS app

When working on a specific view controller within an app, my approach has always been to make some changes to the code, launch the app, navigate to the view controller and see if everything is ...
1
vote
2answers
111 views

From a software development lifecycle perspective, is duck-typing a benefit or a problem?

Statically-typed languages such as Java afford the benefit of compile-time checking of types - you are guaranteed that an object is of a given type, so: there is no need to spend time and resources ...
3
votes
1answer
64 views

GUI Testing With Network

I am doing GUI tests for my network application and I'm wondering if I should stub out mock responses, or if it's OK to keep using the network for the GUI tests. It seems to me the main benefits of ...
2
votes
3answers
208 views

Browser Web Application UI/End User Testing

I am building a web application in php. I am following TDD (write tests before production code) for my unit tests and using BDD to drive discovery of my applications features and to provide ...
4
votes
5answers
92 views

What are the best practices for managing Test results

We are using GitHub for managing source code and waffle board for managing workflow/issues. Right now when we test the system using custom written test cases, it generates a CSV file. We want to be ...
5
votes
2answers
175 views

The concept of “quality gates” in software testing

We are using SonarQube for code quality testing. It tests the quality of code, and not the function of code. It has the concept of quality gates, so you can set for instance a 90% quality gate, ...
7
votes
3answers
224 views

What should be the scope of a health check for a system which deploys a webapp?

Today I had a task to "write a health check" for a long running service that is an orchestration system to deploy a web-app. I am trying to determine what the scope for such a health check would be, ...
1
vote
2answers
63 views

How much optimisation should one put in for slow integration test setups

I have some very slow integration tests that use Selenium and require a lot of database setup. The setup and tear down times are in the order of tens of seconds while the test bodies only take a few ...
0
votes
2answers
107 views

Spring-MVC : Testing code by automatically running it in UI

I am working on a Spring-MVC application(config XML based, no Main class) in which I would like to do testing. I have known that there is a way to test code which is backend+frontend code. For that, I ...
4
votes
3answers
165 views

What kinds of bugs can integration testing actually find?

I feel like, in web dev at least, that integration tests can't really find any useful bugs. I can't think of any, at least. If I can use unit tests to verify that one section of my code calls a ...
0
votes
0answers
25 views

Writing test cases for another web service

I'm working in a team as a developer. We have developed a product where we generate letters by populating some XML file. This XML file ONLY contains some texts that need to show up in a pdf document. ...
3
votes
4answers
112 views

Test cases do all the work through helper method — bad practice?

Consider a test suite like this: public class MyTestSuite { @Test public void test_something() { testHelperMethod("value11", "value12", "value13"); } @Test public void ...
3
votes
1answer
59 views

How do you properly test a complete software replacement

We have System A (an application and a database) that is built for a specific business department and therefore has business aligned data model and table structure. System A is a mission critical ...
5
votes
4answers
204 views

Can we encourage our test team to collaborate with developers on automating tests?

I am a C# developer, and my team and I are trying to start automated functional tests. (Note that we don't want to do Unit Tests; we expect to develop tests which test one function point per test) ...
2
votes
1answer
144 views

What is the proper infrastructure and release cycle for developing and testing an application? [closed]

I am developing a web application for my coworkers, and from a little management app it is becoming a more and intense large project that is involving more people as I go. I am pretty sure my boss ...
7
votes
1answer
156 views

How to test calculations that are only passed down into the stack rather than returned upward

This is a problem I have been trying to wrap my head around a couple months now. It has shown up again in a learning project I was working on last night, so I will use that as an example. I am ...
1
vote
0answers
38 views

Rules of thumb for test coverage [closed]

In general it makes sense to me to unit test everything besides glue classes which have no logic. They often catch mistakes and code smells even at the time of writing let alone protecting you from ...
1
vote
4answers
127 views

How and where to test if the JSON request objects generated by the front-end is valid

We have built a complex Angular application that sends multiple HTTP request to a REST service that is also built in house. Since both the frontend and the backend is being developed in parallel, ...
0
votes
2answers
80 views

How can I test code that verifies data sanity?

I have a large data structure that gets read in from XML. I've been given a large list of constraints that should hold between data members. For example, one of the constraints might look like ...
4
votes
2answers
75 views

Testing strategies for interpreter language parser

For a recent personal project, I started working on an interpreter for my own programming language. One of the ground rules I set for myself on this project is that I need to properly test as much of ...
0
votes
2answers
62 views

Possible to get path coverage but not condition coverage or other way around?

I was wondering if it was possible to get path coverage(executing all paths) but not condition coverage? Also, how about the other way, condition coverage, but not path coverage? A concrete example ...
3
votes
1answer
95 views

Is it unreasonable to implement a small domain specific scripting language?

At my new job, they are currently spending scores of labor hours that we don't have to do manual QA testing after every build. Nothing is automated at all. (We can only afford three developers, and ...
2
votes
2answers
104 views

How to enable my team to run integration tests against RedShift in parallel?

I am working with Docker to run my integration tests, it works pretty nice: I startup my docker containers (one with my server and one with the database) I run the IT using arquillian against these ...
-1
votes
1answer
69 views

Considering the testing software issues when designing software [closed]

When designing the software, must we consider how much this code could be testable? for example, if we used X technology/Class/Interface instead of Y, based on that X can be tested more easily than Y, ...
1
vote
0answers
45 views

How are JSON Web Token validators tested?

JSON Web Tokens (JWTs) are an open, industry standard method for representing claims securely between two parties. There are numerous implementations for JWT verification, but it looks like each ...
1
vote
2answers
377 views

“I'm done with my coding” from Agile perspective

Scenario: I'm working in an Agile environment. The dev environment has not been configured yet, and I'm told to code a piece of an application. I code the module and write appropriate unit tests for ...
-2
votes
1answer
100 views

Dynamic things to test, does it make sense? [closed]

I wrote like seven tests for testing if our network topology was working fine. Each one in a file, so I had test1, test2, test3... However, right now my boss is asking me for something more dynamic, ...
1
vote
3answers
106 views

Are debug-build-only UI controls a bad practice?

Often, to simplify testing, I add UI controls that are only visible and enabled in debug build only. Or prepopulate mandatory input fields in debug build. Is this a bad practice? Assuming the release ...
2
votes
1answer
75 views

How to write tests for browser automation script

I have a couple of scripts (two in Python, one in Java) that use Selenium to drive a browser and download files from a website. I need to do some major refactoring before I do a major expansion, so I ...
3
votes
3answers
218 views

Unit Testing and 3rd party packages. Do I mock or not?

I'm just getting used to unit testing and on my new project I decided to adopt a TDD approach. My code below is to test the UserServices class which is responsible for creating a user, deleting a ...