Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

6
votes
1answer
232 views

Testing: deterministic or non-deterministic?

Is it better to have either a Deterministic test suite, that results in the same tests succeeding Non-deterministic test suite, which potentially possibly covers more cases ? Example: You write a ...
5
votes
1answer
175 views

Managing false positives in TDD or BDD

I'm relatively new to TDD and have been thinking a lot about how to manage the perpetually growing pool of tests that comes with it. One of my biggest concerns is about false positives. In my ...
1
vote
2answers
11k views

What is the difference between apache and tomcat in the xampp control panel? [duplicate]

I installed xampp in my machine. I wonder what is the difference between apache and tomcat in the xampp control panel. p/s: I started apache only and test with "localhost/index.html", it works. I ...
2
votes
3answers
247 views

Software without a testable goal

I hope you bear with me here. It's difficult to explain this problem, especially so without direct reference to the specific domain. I work on a component of a larger system which performs ...
12
votes
6answers
791 views

Contract Based Programming vs Unit Test

I am a somewhat defensive programmer and a big fan of Microsofts Code Contracts. Now I cannot always use C# and in most languages the only tool I have is assertions. So I usually end up with code ...
0
votes
1answer
287 views

How would you create useful tests for Oracle BI Publisher reports?

I'm curious about how to test reports that seem rather straightforward. I'm supposed to create test cases for an Oracle report(XML Publisher/BI Publisher). So for example, a report is supposed to just ...
6
votes
3answers
245 views

How many bugs to expect [closed]

At a previous job (circa 2010), my manager mentioned that he's doing some research into quality metrics. The bottom line is to answer the question how many bugs should I expect? The goal is to try and ...
1
vote
2answers
131 views

Which is better approach for writing automated tests? [duplicate]

Writing tests in single file or writing each test in a separate file? I have found few advantages of keeping test cases in separate file. Easy to maintain, better readability, easy to run single ...
1
vote
1answer
221 views

Is it best practice to create a back door for testing a web service?

We have a public RESTful web service which exposes functionality to third parties. We are writing automated tests against it. In order to set up all scenarios on it we need to change the data behind ...
0
votes
1answer
262 views

High Level Configuration of Constructor Injection in C++

My questions are specifically dealing with dependency injection through the constructor. I understand the pros/cons of service locator pattern, constructor/setter injection, and their flavors, however ...
1
vote
3answers
657 views

Unit Testing Wrapper (Facade?) Method

I have to write unit tests for some classes my group is developing. The classes are fairly simple, and I'm not sure how to best test them. public class MyObjectRegistry { private ...
1
vote
1answer
213 views

Should testers be equivalent to programmers? [closed]

I've been reading Joel Spolsky's old article about "Top Five (Wrong) Reasons You Don't Have Testers". it's an old article date back to 2000, but it's insightful as most of its content make sense after ...
6
votes
3answers
6k views

How to test the data access layer?

I have a DAO method that utilizes Spring for JDBC access. It calculates a seller's success rate of selling an item. Here is the code: public BigDecimal getSellingSuccessRate(long seller_id) { ...
2
votes
1answer
293 views

Automating tests in a browser not supported by selenium

I work on a company that have a payment system that runs under a executable kiosk instance of internet explorer 7. when the application is running the process name is not similar with iexplore.exe or ...
2
votes
2answers
144 views

Where should tests' log files go?

My application has a rather non-trivial, yet standard, log configuration. It includes a console appender and a rolling size-based file appender. When I'm running the tests, thru the IDE or with ...
4
votes
1answer
173 views

What does “testing surface” mean in the context of programming?

I encountered the following text in an article on the ModelViewPresenter pattern and my brain blue-screened: Passive View usually provides a larger testing surface than Supervising Controller ...
7
votes
1answer
237 views

Can relational algebra/calculus proofs be used to test/verify SQL?

Is it feasible or even possible to use relational algebra and/or relational calculus in the form of proofs to test/verify the correctness of SQL statements, functions, and stored procedures? It seems ...
20
votes
2answers
617 views

How do I create an environment where fixing tests is seen as a priority?

I am a software engineer at a medium sized company. We have a fairly robust testing platform running on TeamCity. It does unit tests on every checkin, and a daily unit test/BVT run. The problem is ...
3
votes
4answers
191 views

Not assigning Bugs to a specific user

My question: Is there a benefit to NOT assigning a Bug to a particular developer? Leaving it to the team as-a-whole? Our department has decided to be more Agile by not assigning Bugs/Defects to ...
0
votes
2answers
126 views

Running only some of the tests after a code change [closed]

Running the build can take a long time. Why run all the tests when a given change probably only has the potential to break some of them? You should be able to build a dependency graph of all the ...
4
votes
1answer
99 views

Testing my model for hybrid scheduling in Embedded Systems

I am working on a project for school, where I have to analyze the performances of a few fixed-priority servers algorithms (polling server, deferrable server, priority exchange) using a simulator in ...
3
votes
1answer
217 views

Are there any formalized/mathematical theories of software testing? [duplicate]

Googling "software testing theory" only seems to give theories in the soft sense of the word; I have not been able to find anything that would classify as a theory in the mathematical, information ...
2
votes
5answers
141 views

Should mock objects for tests be created at a high or low level

When creating unit tests for those other objects, what is the best way to create mock objects that provide data to other objects. Should they be created at a 'high level' and intercept the calls as ...
0
votes
1answer
324 views

Should programmers itemize testing for projects? [closed]

I recently hired a programming team to do a port of my iPad app to the iPhone and Android platforms. Now, in a separate contract, I am asking them to implement a bunch of tips on how to play the ...
1
vote
4answers
470 views

Testing on different operating systems

I am a developer who has windows 7 installed as the host operating system with vmware. I have linux installed using vmware. Therefore I am able to test java and c++ apps on windows 7 and Linux. I ...
0
votes
2answers
80 views

Area of testing

I'm trying to understand which part of my code I should to test. I have some code. Below is example of this code, just to understand the idea. Depends of some parametrs I put one or another currency ...
5
votes
1answer
596 views

Is there an established or defined best practice for source control branching between development and production builds?

I struggled in how to phrase my question, so let me give an example in hopes of making more clear what I am after: I currently work on a dev team responsible for maintaining and adding features to a ...
0
votes
1answer
79 views

Test Doubles : Do they go in “source packages” or “test packages”?

I've got a couple of data access objects (DefaultPersonServices.class, DefaultAddressServices.class) which is responsible for various CRUD operations in a database. A few different classes use these ...
2
votes
1answer
1k views

How to create unit/integration tests for my web app?

I am currently developing an Ajax chat application that uses PHP on the back-end. Some of the features it has right now are different types of users (admin/mod/banned), public and private rooms, ...
2
votes
3answers
210 views

How do I limit the resources available to a program?

I'm delving into multi-threaded programming with Java, but I'm finding it hard to test my program for bugs. My computer simply has too many resources and cores, making it hard to see how my program ...
53
votes
14answers
3k views

Is it reasonable to insist on reproducing every defect before diagnosing and fixing it?

I work for a software product company. We have large enterprise customers who implement our product and we provide support to them. For example, if there is a defect, we provide patches, etc. In other ...
7
votes
5answers
1k views

Why use in-memory database for integration testing?

I'm really confused when I see a lot of in-memory database implementation used for testing, because I also heard a lot from integration testing best practices that the environment running the test ...
4
votes
2answers
278 views

How can I test an application that depends on specific hardware

I have written an Android application. The application requires a Bluetooth connection to a very specific piece of hardware, currently a prototype. The only way I can test the app at present is to ...
5
votes
4answers
624 views

Test Driven Development: A good/accepted way to test file system operations?

I am working on a project at the moment that generates a table (among other things) based on the contents of a file-system, and and in turn does some meta-data modifications on the things it finds. ...
2
votes
1answer
178 views

Rethinking testing strategy

Working on Plone projects our team tries to achieve full test coverage at least for important products. The kind of tests we write are unit tests, functional tests and integration tests. (Also ...
7
votes
3answers
301 views

Should I store test files in source control?

I have a number of (large) test files that need to be maintained. This means access to their history is a requirement. Benefits Any new developers get the entire test suite with just a git pull. ...
2
votes
2answers
168 views

Equivalence partitioning understanding A<5 and B<5

I do not understand the following example. It says that a function X will be executed if either of A and B variables will be lower than 5. The go on and explains that there are three valid equivalence ...
3
votes
1answer
168 views

How to deal with the notion of time in UI/Integration tests

There are some well-known techniques for dealing with the notion of time in unit tests. These allow you to write unittests that always work with a specific time so the outcome of the test is ...
3
votes
2answers
631 views

What are the different meanings of 'fixture'?

I have some difficulty understanding the concept of "fixture". I know what a test suite is, a test case, a test run, but what exactly is a "fixture"? A parameterized test case? It seems to me that ...
0
votes
2answers
591 views

Assert equality in mstest when types may differ

I've been working on some MSTest automated test infrastructure, that is testing a tool that merges data sets into SQL Server database tables. The basic structure of the test is to: Define the ...
2
votes
2answers
193 views

Who fixes broken tests? [duplicate]

Our small team has made the curious observation that diagnosing and fixing broken automated tests is a useful activity; in particular, if the CI build indicates that developer A's last check-in broke ...
0
votes
1answer
64 views

Using a flag in in-memory-repository to indicate update to entity

I'm about to write a lot of test for my application. While some of the tests check whether everything works if the user enters the right data, most of them deal with wrong/missing data. In these cases ...
1
vote
1answer
480 views

Can AspectJ or AOP in general be used to test exception handling?

I'm reading a book's chapter ("Controlled Exception Test" in "Testing Object-Oriented Testing") about testing exception handling in a running system (not at unit level). The conclusion is that it is ...
1
vote
2answers
138 views

Understanding unit testing for dynamically changing condition

I was trying to understand how to write unit tests for a few days now. I'm confused with following scenarios in the existing code. In first function the max value changes depending on the object ...
1
vote
3answers
335 views

Should you write automated tests to check that data is correct (the contents of config files, databases, etc.)?

Simply put: is there a best practice for whether developers should write automated tests to check that data is correct (the contents of config files, databases, etc.)? If so, what is it? Assume that ...
-2
votes
4answers
183 views

How to use unit testing? [duplicate]

How to use unit testing? There are a lot of frameworks for different languages, which provide functionality of unit testing. There is a lot of information on how to use each of them technically. Just ...
8
votes
3answers
482 views

Doesn't single-assert unit testing break the DRY principle?

Whenever I write unit tests I have always tried to have a single assert per test to make debugging easier when tests fail. However as I follow this rule I feel like I am constantly copying the same ...
0
votes
3answers
5k views

What would be negative test case for this scenario?

Let's say we have some requirements Req1: User name will accept 6-10 character alpha value. Req2: On click of Submit button, application will show error message "Please enter value or character ...
2
votes
1answer
169 views

Strategy for normalising and interpreting location data

I'm a bit stuck with a problem involving the normalisation of location input data from the user (which comes from a third party). Aim To logically breakdown and interpret the user location input ...
2
votes
2answers
532 views

Should I bother to write unit test for UI/UX Components?

So I am building an application with Angular and have started to get into UI testing with DalekJS (http://dalekjs.com). As I have been writing these tests I have been thinking to myself, should I ...