Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

-1
votes
1answer
39 views

Where should I create utility classes that are used by unit tests, integration tests and functional tests?

Say I have a project that's using the standard Maven/Gradle project directory structure, with the source file directory like this: src ├── functTest ├── integTest ├── main └── test What would be ...
1
vote
3answers
71 views

What does stubbing mean in programming?

I often hear the term stub, stub out somethings, stubs, ...etc. What does stubbing mean in programming, where the word come from? and in what contexts it can be used?(just examples)
0
votes
0answers
15 views

Specflow or BDDfy or other [on hold]

I am looking to start using BDD in my next .NET project and I was wondering if anyone has experience using Specflow, BDDfy or another similar tool and which of them would be recommended for a team ...
-3
votes
0answers
77 views

What do you do while you're waiting for your tests to run? [on hold]

Tests and test suites can take any amount of time to run. When I'm running one that takes between, say, 30 seconds and 5 minutes to run, I'm never sure what I should do during that time. It's too ...
5
votes
4answers
525 views

How to test a method which is not as much as a unit, because it is more of a 'orchestrator' / 'process' / 'controller' / 'coordination' class [duplicate]

I want to test a method which is not as much as a unit, because it is more of a 'orchestrator' / 'process' / 'controller' / 'coordination' class. This is the case: I have four unit tested classes: ...
134
votes
18answers
13k views

Leaving intentional bugs in code for testers to find

We don't do this at our firm, but one of my friends says that his project manager asked every dev to add intentional bugs just before the product goes to QA. This is how it works: Just before the ...
-2
votes
1answer
19 views

SystemUnderTest versus other nomenclatures [on hold]

this is a minor issue but we are a worldwide company trying to unify some criteria and we are using systemUnderTest to name the variables used in our unit tests while others are using other ...
2
votes
1answer
170 views

Any reasons NOT to write self testing Python code?

Whilst writing tests I was giving considerable thought to the question of how to ensure I have tests for every class in my application. It occurred to me that maybe I should just put the test code ...
1
vote
1answer
68 views

Using conditional feature compilation/inclusion for release versioning

I have been playing with the following idea: commonly when different release series (1.0.x, 1.1.x, development code) of a product are maintained in parallel one uses different branches within a ...
1
vote
1answer
40 views

In boundary-value analysis, why test min+1 along with min?

In boundary analysis testing, some authors suggest testing MIN-1, MIN, MIN+1 (and the same for MAX). Also for 1-100 range (if A>=1 && A<=100), test cases would be: 0,1,2 and 99,100,101. I ...
2
votes
3answers
227 views

How does a software developer know if the target hardware is fast enough to run the software? [duplicate]

How do software developers manage to know if their software will run on the target hardware they are developing to? Many developers today work on machines much faster than the intended platform. What ...
4
votes
1answer
70 views

Summarizing time spent on UI tests

I was working with a team on a web-based software. We have written ~70-80 Selenium test for the product. Mainly happy-path tests with some regression ones for bugs reported by users. It was the first ...
1
vote
2answers
145 views

How to add rigor to my testing?

I work on a small/medium sized Java application. Over time, I've tried to ensure that the tests which I write are "good" tests, and that there's plenty of them. Hence I've been looking into various, ...
-1
votes
2answers
99 views

Scheduling a Jenkins job to only run integration test [closed]

My current company has a Jenkins/DotCi setup. Our current process for CI is when dev pushes to github, jenkins runs unit tests on all branches and reports back to us via email if the unit tests ...
1
vote
2answers
89 views

Java applets with Safari on Windows as compared to Safari on OS X [closed]

I have a developed an Applet which works fine on Chrome/IE/FF on Windows. I am not expecting any users for Safari on Windows but there might be the odd user who may be on a Mac. As of now, I don't ...
0
votes
1answer
106 views

Testing - How to test if you are actually testing the code?

I was thinking about unit tests and code coverage, and I came up with this thought: It is possible to have 100% code coverage and not test 100% of your code. For example: function ...
0
votes
1answer
47 views

Testing - Test for Specific Paths?

When (unit) testing, is is bad to expect the code to use certain paths. For example, should I be testing for specifically "/build/static/public/css/", or just that server.cssPath has been set to a ...
1
vote
2answers
97 views

Should you test development features?

Is it a good practice to test features that only run in a development environment, or just a waste of time? Specifics: The item that is prompting this question is a line of code that dynamically ...
1
vote
2answers
104 views

TDD and Writing Tests for File Processing

These questions are very similar: TDD for batch processing: How to do it? and TDD: how to test file outputs? but I'm still left wondering some things The app processes files/pdfs. It takes them from ...
3
votes
1answer
72 views

How use same Behavior Drive Development (BDD) stories across platforms?

I'm writing an app that has a client for iOS, Android, and the web. The server is hosted on Google App Engine (Java). REST is used for the communication between clients and server. In order to ensure ...
-1
votes
1answer
57 views

Starting a big application with unit testing [closed]

I am learning test driven develeopment and read some books about TDD. I learned rules of unit testing. How can I write unit test, how can I select test method names, Act, Assert, Action and like this. ...
0
votes
1answer
58 views

What's good about statement coverage?

When it comes to code coverage, you often hear about the flaws of statement coverage criteria. We're told that statement does not take into account control structures and branches thereof, and is ...
0
votes
1answer
113 views

Term to describe pre-canned objects for use in testing

I have forgotten the term for a class that provides pre-canned objects for use as test data. e.g. If I'm testing a payment module and I need credit card objects of different types, I might have a ...
5
votes
2answers
197 views

How detailed should QA aim to be?

When QA discovers an issue during testing should they... Log the bug with the test case and scenario information and move on testing? Try investigating to determine why the bug is happening? I ...
0
votes
1answer
36 views

Is Exploratory testing Context Driven testing?

I do not think so, yet many sources say it is. As I understand it: Context-driven testing means that when planning testing on our project, I choose the methods, practices, etc. in order to fit the ...
1
vote
1answer
95 views

How do I Create Automated UI test code for application developed using Domain-Driven-Design with very little concrete UI requirements?

We are developing an application using Domain-Driven-Design(DDD). We have to come up with Automated UI Test code. The customer has used 3rd-party GUI Administration template ...
7
votes
4answers
870 views

Is there something as a bug-free application? [duplicate]

We are developing an application that goes through many testers before reaching our client. Finally, when it reaches the client, they find some more bugs and report to us, and this has become a ...
1
vote
2answers
221 views

Why all consider UAT a validation activity? It contradicts the original idea

Virtually any book dealing with software testing mentions that user acceptance testing (UAT) is an ultimate validation activity, often quoting Boehms informal definition: "Validation: Are building the ...
5
votes
3answers
93 views

Where should I store test data?

I have smaller unit tests that use small snippets from real data sets. I would also like to test my program against full data sets for a multitude of reasons. The only problem is that a single real ...
0
votes
2answers
91 views

How to best do cross-browser cross-platform visual CSS regression testing? [closed]

Background: Visual CSS regression testing is where you screenshot (part of) one version of a webpage in a browser and compare it against a screenshot of the previous version of the same webpage in the ...
1
vote
0answers
76 views

Unit Testing a stateful framework such as Phaser?

I'm currently writing a game in TypeScript and the Phaser framework. Phaser describes itself as an HTML5 game framework that tries as little as possible to restrict the structure of your code. This ...
15
votes
3answers
1k views

How to test when arranging the data is too cumbersome?

I am writing a parser and as a part of that, I have an Expander class that "expands" single complex statement into multiple simple statements. For example, it would expand this: x = 2 + 3 * a ...
1
vote
1answer
136 views

Unit test approaches other than test-first and test-last? And what about variants of them? [closed]

I'm wondering if there are other approaches, old or new, to writing unit tests, and how viable they are, other than the traditional and tdd unit testing approaches. I know there is behavior-driven ...
1
vote
2answers
84 views

Should you mock key-value stores/aggregators

I've always been taught that your tests should run in isolation, and other than a db for ActiveRecord etc., your tests should not rely on any external software/services. e.g. I always mock my other ...
0
votes
0answers
55 views

Automatically verifying INSERTs when building a PHP(5.3.3) application

I am building a form in PHP. I would like to automatically verify that INSERT queries are successful, and populate data correctly, as opposed to running queries in Workbench or MySQL with every code ...
2
votes
2answers
89 views

Why in cyclomatic complexity we add 1 for operators within a condition?

I know that basically, CC can be computed as number of decision + 1. In addition, every logical operator in the condition causes CC to increase by 1. But why? Having the code if(A || B || C) else... ...
5
votes
6answers
494 views

When should you start unit testing? (during which development stage?)

I'm currently learning about unit testing, specifically JUnit (with Java). Searching the web I see many threads talking about why you should use it, what type of methods you should use it with but I ...
3
votes
1answer
115 views

Is it reasonable for a client to expect automated test scripts as project deliverables?

Our company is currently halfway through a software project with a consulting firm. As someone who will be taking ownership of the project after the consultants finish, is it reasonable for our ...
0
votes
1answer
98 views

Does it make sense to express reliability as a ratio of number of tests and system failures? [closed]

I have seen a reliability of the system expressed like this: Rel=No of tests executed / Sum of crashes or other critical events Does it make sense and what actually is the output?
3
votes
2answers
59 views

Cross device testing for web development

Currently, I do not have a fixed process for cross device testing other than randomly asking the people around my co-working space to test my site on whatever device they have on-hand. This is quite a ...
1
vote
2answers
363 views

How to set an ungoogleable coding test? [closed]

Question In a coding test (for example), what is an example of a type of question that cannot be easily googled to find the answer? Is there a formula that can be used to create questions that are ...
0
votes
3answers
103 views

Unit testing method that calls multiple private methods

I've been reading a lot about unit testing recently and there seems to be a debate online about whether private methods should be tested or not. If I have an interface that exposes one method, but ...
0
votes
2answers
77 views

Should I put the name of the method I'm testing in the Unit Test method's name/assert message?

Given that a method's name might change in time, is it a good idea to specify the name of the method whose return value I am asserting as a part of the Unit Test method's name? What about the message ...
-1
votes
1answer
92 views

Do you spend your effort to reuse obsolete unit tests or rewrite them entirely? [closed]

I have this javascript project which has a unit test suite(about 200unit tests) that covers about 11.31% of the code that it was testing. The project has evolved greatly but the unit tests where never ...
11
votes
2answers
2k views

As back-end developers, should we learn software testing? [closed]

As a junior developer, I'm working in a company that develops software for the airline industry. We have a test team, so I don't have any motivation to learn testing software. My friend is working for ...
0
votes
1answer
184 views

Create fake HTTP server to simulate an API for testing

I'm looking to mock responses from an external API service that returns JSON during live events. The first response would contain (fake) events that have happened up to time X, the second response ...
0
votes
2answers
105 views

Introduction to testing [closed]

I am very new to the concept of testing and I had not yet have any experience with this. At my company, no one does write tests as of now, neither is any test framework set up or anything. Also, we ...
2
votes
3answers
171 views

How often should internal applications be deployed? [closed]

In Short: Should I deploy each fix/feature as I make it, or schedule releases for an internal application? Some Background: A few months ago I was hired as our IT's first dedicated developer with ...
1
vote
2answers
88 views

What is proper order of pull requests and testing?

We want to setup proper development workflow. We have two main branches: master(release branch) and develop(working branch). We want to use pull requests properly. We see two ways how to do this: The ...
0
votes
3answers
112 views

Website testable design [duplicate]

I have developed two web services. The main service is a RESTful service (using DB), and another UI service that uses the RESTful service. Say I want to test the UI for now (integration tests), every ...