Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

3
votes
4answers
187 views

Must all new features go through betatest?

Obviously, small usability fixes and bugfixes go directly into the stable product. What about small new features? Can you afford to just release them after internal testing, or do they have to be ...
9
votes
2answers
1k views

Data Quality in Relational Database Regression Tests

I have been working on an open source Museum Collections Management web application that is to be used to keep track of a museum's accessioned, donated, loaned or otherwise acquired artefacts. This ...
5
votes
2answers
1k views

Javascript tools for branch coverage [closed]

I'm looking for tools that will help me write test cases to cover all paths through a function in Javascript. Ideally, I'd like something that will spit out a list of combinations of parameter and ...
0
votes
4answers
501 views

What Are Some Tips For Writing A Large Number of Unit Tests? [closed]

I've recently been tasked with testing some COM objects of the desktop app I work on. What this means in practice is writing a large number (>100) unit tests to test different but related methods and ...
0
votes
1answer
95 views

How to test a random-generating feature in application? [duplicate]

Possible Duplicate: How should I test randomness? One of the features to be developed in our application was allowing user to click a button which will choose an element at random out of (...
22
votes
11answers
3k views

Why it is necessary to to test my iPhone app on actual iPhone device

I developed one application for iPhone and now I want it on App Store. So many my iOS geek friends told me to test it on actual device i.e. on iPhone. So I wonder that why it is necessary to to test ...
15
votes
11answers
18k views

Why is using System.out.println() so bad? [closed]

Of course, it is very good use to use a logging framework for the error messages or warnings. But sometimes I use System.out.println() if I want to try something new in a short time. Is it really so ...
1
vote
2answers
786 views

Unit Tests code duplication?

How can I avoid code duplication in unit tests? Using Java and JUnit suppose I have something like this: public interface Arithmetic<T> { public T add(T a, T b); public T sub(T a, T b);...
10
votes
5answers
550 views

Methods for testing a very large application

I have a PHP app which is very large. There are usually 2-3 developers working on it full time and we are getting to the point where we are making changes and creating bugs (cough features!). The ...
5
votes
5answers
192 views

Is there much thought towards internal diagnosis testing within an enterprise application?

Imagine a discussion between four people - one a developer, one a manager, one a tester and one a deployment/operations type. The Manager is very angry as a system has fallen over after a new version ...
9
votes
9answers
1k views

As a professional developer, is it acceptable to not write unit tests? [closed]

Just wondering on the pros and cons on TDD/automated unit testing and looking for the community's view on whether it's acceptable for professional developers to write applications without supporting ...
1
vote
1answer
104 views

Which mobile devices cover the widest spectrum for testing?

My company has decided to purchase a multitude of devices for browser testing our stages e.g. iPhones, Android, Windows and assorted tablets. They've tasked me with finding specific devices that cover ...
4
votes
2answers
1k views

What is the best way to handle last minute changes to product scope?

What is the best way to handle changes to product requirements or scope during or after User Acceptance Testing (UAT)? How dangerous is it to make those changes, and how can the danger be mitigated?
7
votes
4answers
2k views

Is functional spec a “design document”?

So I have been a bit lost in the terms, so first of all I present you what I have learned so far: System requirements specification - what users want, what the system should do Functional requirement -...
4
votes
2answers
138 views

Inserting validation in Data Driven Tests

I am working on a testing tool that provides image comparisons. For test data insertions, I am using excel and csv files that supply the tests with text that is used by the tool to mock actual user ...
5
votes
3answers
300 views

How do I go from “here's the zip” to a good release strategy?

I can write code, resolve dependencies, and get my program to run on my computer; I have no idea where to go from here though. How do I get the software ready for distribution? The school ...
10
votes
4answers
3k views

How should I test my TEST code?

One of the few things that most software developers agree on is that you shouldn't rely on code to work correctly unless you test it. If you don't test it, it may have hidden bugs that are only ...
20
votes
5answers
4k views

What is a normal “functional lines of code” to “test lines of code” ratio?

I'm pretty new to TDD approach and my first experiments say that writing 1 line of functional code means writing about 2-3 lines of testing code. So, in case I'm going to write 1000 LOC, the whole ...
5
votes
2answers
140 views

Automated tests for differencing algorithm

We are designing a differencing algorithm (based on Longest Common Subsequence) that compares a source text and a modified copy to extract the new content (i.e. content that is only in the modified ...
3
votes
1answer
105 views

A testing feedback/report tool?

I'm thinking of developing a pluggable test and assessment module. This tool will be used especially for desktop application projects to report and log errors, bugs, missing features and suggestions ...
4
votes
2answers
1k views

How to test the render speed of my solution in a web browser?

Ok, I need to test the speed of my solution in a web browser, but I have some problems, there are 2 versions of the web solution, the original one that is on server A and the "fixed" version that is ...
32
votes
9answers
3k views

Are programmers bad testers?

I know this sounds a lot like other questions which have already being asked, but it is actually slightly different. It seems to be generally considered that programmers are not good at performing the ...
6
votes
4answers
370 views

Testing To Prevent Cascading Bugs

Yesterday, Twitter was hit with a "Cascading Bug" as described in this blog post: A “cascading bug” is a bug with an effect that isn’t confined to a particular software element, but rather its ...
2
votes
3answers
344 views

Writing selenium tests, should I just get it done or get it right?

I'm attempting to drive my user interface (heavy on javascript) through selenium. I've already tested the rest of my ajax interaction with selenium successfully. However, this one particular method ...
1
vote
2answers
416 views

Recognizing text fields according to their label value

I have an application who has text fields (not select, not checkbox or other types) where an user can enter some value, like this: ISBN and E-Mail are the label of each input. Now I have to ...
18
votes
9answers
2k views

Are too many assertions code smell?

I've really fallen in love with unit testing and TDD - I am test infected. However, unit testing is normally used for public methods. Sometimes though I do have to test some assumptions-assertions ...
10
votes
2answers
1k views

All unit tests in one executable, or split them up?

When writing tests for one piece of software, say a library, do you prefer to compile all unit tests into one, or separate them into several executables? The reason I'm asking is because I am ...
3
votes
4answers
826 views

Should you exercise TDD on prototype applications?

I'm developing an iOS app, which is a prototype for a customer. They're expecting it to not be of production standard and are happy for a few rough edges here and there. Since this is my first ...
7
votes
2answers
67 views

Testing applications with statistical features [duplicate]

Possible Duplicate: How should I test randomness? Are their some techniques described for testing applications that have as a requirement some statistical or probabilistic features? They may ...
1
vote
2answers
519 views

Test a simple multi-player (upto four players) Android game in single developer machine

I'm working on a multi-player Android game (very simple it is that it doesn't have any game-engine used). The game is based on Java Socket. Four devices will connect the game server and a new thread ...
1
vote
1answer
843 views

rails fake data, considering switch from faker to forgery, any advantages or pitfalls?

With Ruby on Rails I've usually used Forgery for generating dummy data for testing. I've noticed recently that several clients and tutorials are using Faker They both seem fairly similar in use ...
2
votes
2answers
143 views

Assignments in mock return values

(I will show examples using php and phpunit but this may be applied to any programming language) The case: let's say we have a method A::foo that delegates some work to class M and returns the value ...
0
votes
1answer
370 views

FxCop / Code Analysis with VS2010 Ultimate

I've getting some information about this, but I still can find a proper answer, I was asked recently in my company for this : "run a fxcop analysis on that code and tell me the results". Ok, I have ...
6
votes
5answers
18k views

How to unit test a jsp file?

I'm developing a Java 6 EE application and I'm testing my jsp code with another one with a testing version of the function calls and code used in the original one but it seems loose and impractical. ...
6
votes
3answers
324 views

When module calling gets ugly

Has this ever happened to you? You've got a suite of well designed, single-responsibility modules, covered by unit tests. In any higher-level function you code, you are (95% of the code) simply ...
2
votes
4answers
7k views

How to test a program in an efficient way? [closed]

I know that a writing test case is one of the way to do some programming level testing, but how to test some careless mistake? or how to reduce? For example, a buttonA, should perform ActionA, but ...
8
votes
3answers
2k views

What was the historical impact of Ariane 5's Flight 501?

The disintegration of the Ariane 5 rocket 37 seconds after launch on her maiden voyage (Flight 501) is commonly referred to as one of the most expensive software bugs in history1: It took the ...
4
votes
4answers
2k views

Choosing names for integration tests

With unit tests the domain is quite small, so it's easy. I used Osherove's methodName_conditions_result() scheme and found it very clear. But with integration tests I feel like it would make a very ...
7
votes
2answers
891 views

Test Driven Development, has it reduced stress for developers?

I understand the benefits of test driven development, but have there been any studies that reveal the level of satisfaction with the product or stress levels of the authoring developers with the ...
15
votes
6answers
4k views

Good workflow for software development with scrum and continuous integration

I'm studying an approach to understand better how the continuous integration workflow fits better in a software development company with the scrum method. I'm thinking something like this: Would ...
2
votes
4answers
212 views

Testing a file that relies heavily on a static array

I have a .c file that basically manages its own little database of people. There are add, remove, edit and search functions among some others. It has a static array which it uses to store the data. ...
19
votes
4answers
1k views

Should we always unit test bugs when correcting them?

When correcting bugs, it is encouraged where I work to first write a test that fails with the given bug, and then to fix the code until the test passes. This follows TDD practices, and is supposed to ...
2
votes
1answer
2k views

What metrics should be used to measure memory consumption of a program for performance test?

I am asked to provide performance statistics for a program, one of them being memory consumption. I noticed that in perfmon or in .NET API there is apparently many variable related to memory usage, ...
1
vote
2answers
716 views

Looking for good testing in multithreaded C or C++ open source projects [closed]

I have read a lot about the importance of unit testing, and testing in general. In particular I have read about TDD which, in theory, seems like a good way to ensure effective test coverage for a ...
77
votes
10answers
20k views

How should I test randomness?

Consider a method to randomly shuffle elements in an array. How would you write a simple yet robust unit test to make sure that this is working? I've come up with two ideas, both of which have ...
74
votes
16answers
15k views

When is unit testing inappropriate or unnecessary? [duplicate]

It seems to be generally assumed (on Stack Overflow at least) that there should always be unit tests, and they should be kept up to date. But I suspect the programmers making these assertions ...
2
votes
2answers
2k views

Parallel Testing options in Agile Development?

I've read through some very good resources on the internet trying to find out if my initial proposed testing process is a valid option. So please any advice or recommendations are appreciated. ...
47
votes
7answers
11k views

How to deal with static utility classes when designing for testability

We are trying to design our system to be testable and in most parts developed using TDD. Currently we are trying to solve the following problem: In various places it is necessary for us to use static ...
12
votes
4answers
528 views

How to handle bugs that I think I fixed, but I'm not entirely sure

There are some types of bugs which are very hard to reproduce, happen very rarely and seemingly by random. It can happen, that I find a possible cause, fix it, test the program, and can't reproduce ...
1
vote
2answers
5k views

How can I do test automation using a python script to test a c program?

I was wondering if I can use a Python script to test a C program automatically. Suppose I have a very simple C program which reads data (numbers as test cases) from the console, calculates them, then ...