Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

0
votes
2answers
8k views

What is the difference between a Software Test Engineer and Software Test Analyst? [closed]

Do they differ in role and responsibilities. Or the terms are dependant on geographical area.
1
vote
2answers
158 views

Automated Acceptance tests under specific contraints

This question is a follow up to my previous question, which was a bit general, so I shall be more specific with this one. I want to automate acceptance testing on a web application. Briefly, this ...
7
votes
7answers
5k views

Who should write the test plan?

I am in the in-house development team of my company, and we develop our company's web sites according to the requirements of the marketing team. Before releasing the site to them for acceptance ...
12
votes
6answers
532 views

How to improve testing your own code

Today I checked in a change on some code which turned out to be not working at all due to something rather stupid yet very crucial. I feel really bad about it and I hope I finally learn something from ...
23
votes
5answers
17k views

What is an integration test exactly?

My friends and I have been struggling to classify exactly what is an integration test. Now, on my way home, I just realised, that every time I try to give a real world example of an integration ...
4
votes
2answers
120 views

Do bugs from Fuzzing belong in my system tests?

I have recently implemented fuzz testing over one of my projects. Several bugs have come up, generally classifiable as (dare-I-say trivial?) input validation bugs, and I've fixed them. In no case so ...
6
votes
3answers
3k views

What issues tend to arise when working with HL7 messages?

I'm testing a product for health care businesses, and we're working with HL7 messages. I saw people groaning on another question about the issues with HL7 but not mentioning specifics. Can someone ...
5
votes
4answers
755 views

Mock Objects for Testing - Test Automation Engineer Perspective

How often QA engineers are responsible for developing Mock Objects for Unit Testing. So dealing with Mock Objects is just developer job ?. The reason i ask is i'm interested in QA as my career and am ...
5
votes
4answers
976 views

Software Bug Bash Tips

I am trying to put together a bug bash at my office and I was what was the best way to conduct it. Ideally, I'm looking for the most effective way to manage testing and provide the staff with ...
12
votes
7answers
2k views

How do big companies of software developers check for bugs in their programs?

I was wondering how big companies of software developers check for bugs in their programs. Do they just test it on several computers?
12
votes
4answers
3k views

Writing Acceptance test cases

We are integrating a testing process in our SCRUM process. My new role is to write acceptance tests of our web applications in order to automate them later. I have read a lot about how tests cases ...
18
votes
9answers
2k views

What should come first: testing or code review?

I'm quite new to programming design patterns and life cycles and I was wondering, what should come first, code review or testing, regarding that those are done by separate people? From the one side, ...
6
votes
6answers
466 views

Should testers automate their work?

We are trying to setup our testing process. We wonder if our testers should develop automated regression tests, or if the developers should do that. And what about other types of automated tests? ...
2
votes
1answer
404 views

How to organize a Coding Dojo?

Over on stack overflow it was asked how to organize a coding dojo (http://stackoverflow.com/questions/4338567/how-to-organize-a-coding-dojo-event). I believe that may have been the wrong forum... I ...
3
votes
3answers
129 views

Most efficient way for snapshotting Windows (no VM) [closed]

As the software I'm writing is using instrument I/O, I cannot use virtual machines to test my software in different configurations. Therefore I'm looking for the best way to make snapshots at ...
7
votes
5answers
1k views

What is the role of QA in a BDD-driven project?

If running a project using BDD with 100% coverage of user stories with automated acceptance tests, what would be the role of a tester / quality assurance person? I guess I am imagining that ...
9
votes
4answers
919 views

When writing specs BDD-style, should you use “should”, or should you not?

I realize this is somewhat subjective, but I can't find a good case for one or the other : it "should do something" it "does something" Proponents of the should style mention that it forces ...
7
votes
13answers
694 views

What have you learned from the bugs you helped discover and fix?

I liked the core of this question, and wanted to re-ask it in a way that made it less about 'fun' and more about 'What do these past mistakes tell us about how we can write and test software better?' ...
9
votes
4answers
4k views

How to simulate events that cause exceptions to test try/catch blocks?

I understand how exceptions work and how to catch and handle them in C# but how can I simulate events that may cause an exception to ensure that it is caught correctly? For example, is it possible to ...
2
votes
5answers
247 views

When in the project life-cycle would you fit in external penetration/security testing of the software?

Assuming that you're working on a piece of software which is required to pass a third party security/penetration test before being released to the client, at which point in the project life-cycle ...
17
votes
11answers
1k views

At what point would you drop some of your principles of software development for the sake of more money?

I'd like to throw this question out there to interestingly see where the medium is. I'm going to admit that in my last 12 months, I picked up TDD and a lot of the Agile values in software ...
9
votes
2answers
449 views

How to open-source a project whose git repository has copyrighted media in the history?

I want to release an audio fingerprinting software project under a free license, but the repository contains copyrighted audio files. The test cases also currently use these files. How do I release ...
8
votes
5answers
312 views

How do I check that my tests were not removed by other developers?

I've just came across an interesting collaborative coding issue at work. I've written some unit/functional/integration tests and implemented new functionality into application that's got ~20 ...
18
votes
7answers
1k views

TDD/Tests too much an overhead/maintenance burden?

So you've heard it many times from those who do not truly understand the values of testing. Just to start things out, I'm a follower of Agile and Testing... I recently had a discussion about ...
66
votes
19answers
7k views

Why does TDD work?

Test-driven development (TDD) is big these days. I often see it recommended as a solution for a wide range of problems here in Programmers SE and other venues. I wonder why it works. From an ...
34
votes
11answers
1k views

How is software used in critical life-or-death systems tested?

An airplane, as opposed to, for example, a website, is a system where any failure in certain systems is completely unacceptable, since errors in e.g. flight monitoring can cause the autopilot to ...
3
votes
4answers
1k views

What quantitative metrics do you use to measure the quality of an offshore testing team?

Are developers are in the US, our testers are in India. How do we measure their ability, quality, success? Some possibilities: - Coverage at the UI level - Total time needed to run regression ...
16
votes
4answers
2k views

Best practices for retrofitting legacy code with automated tests

I'm about to take on the task of reimplementing an already defined interface (a set of C++ header files) in a relatively large and old code base. Before doing this, I would like to have as complete ...
20
votes
7answers
4k views

Automated unit testing, integration testing or acceptance testing [closed]

TDD and unit testing seems to be the big rave at the moment. But it is really that useful compared to other forms of automated testing? Intuitively I would guess that automated integration testing is ...
6
votes
7answers
13k views

Career Advice: Change from developer to tester [closed]

I have three years and nine months of java development experience specifically in finance domain and now I want to move into testing (functional). But I took a break from my job due to location ...
2
votes
2answers
517 views

“Testing Plan Lite” for web project

How do you draft a quick & easy "Testing Plan Lite" for a medium-sized web project (70k lines, 2 developers)? I've seen many tutorials/articles on methods of testing, but all seem cumbersome. ...
4
votes
4answers
324 views

Where can I find statistics / figures on how long testing should / could take? [duplicate]

I'm trying to convince management that testing/QA takes considerably longer than non-developers think. Some smaller shops don't have budgets for testers and phbs automatically assume the developer ...
20
votes
8answers
1k views

What are the disadvantages of writing code before writing unit tests?

I have always seen the recommendation that we should first write unit tests and then start writing code. But I feel that going the other way is much more comfortable (for me) - write code and then the ...
4
votes
2answers
1k views

Advantages of Hudson and Sonar over manual process or homegrown scripts

My coworker and I recently got into a debate over a proposed plan at our workplace. We've more or less finished transitioning our Java codebase into one managed and built with Maven. Now, I'd like for ...
2
votes
2answers
274 views

Testing website content with graphs

I'm looking for a way to test my webpages that have dynamically generated graphs (using such things like Google Graphs). Does anyone know if there are such tools that exist (perhaps Selenium would do ...
7
votes
2answers
684 views

How Do You Test Your Software?

I'm currently working on 2 software projects: A Social Networking Web Site for an NGO A Patient Management System for a hospital Although I've been programming for 5 years, I can't just say that ...
16
votes
3answers
7k views

How do you do ASP.Net performance testing?

Our team is in need of a performance testing process. We use ASP.Net (both web forms and MVC) and performance testing is not currently built into our projects. We occasionally do some ad-hoc analysis, ...
5
votes
1answer
367 views

The use of Test-Driven Development in Non-Greenfield Projects?

So here is a question for you, having read some great answers to questions such as "Test-Driven Development - Convince Me". So my question is: "Can Test-Driven Development be used effectively on ...
6
votes
8answers
542 views

How to search for a tester?

As a freelance developer, a few times I tried to find some testers to be able to let them test my software/web applications. If I try to find them, it's because most of the customers are not intended ...
2
votes
3answers
222 views

What are your experiences with off-shore or outsourced testing?

Has anyone had experience with out-sourced testing? Is it worth the fairly high premium you have to pay? Can you simply hire some off-shore 'mechanical turks' (who offer the same services, but a lot ...
1
vote
5answers
361 views

Testing for Non Programmers [closed]

I would like to get my younger brother, who can't program, to test some code I am writing from requirements I provide him in documentation. Is there a way to get him going quickly? Ideas? Please and ...
7
votes
2answers
4k views

Can you recommend a good test plan template?

Can you recommend a good test plan template for an agile testing team? I know there are templates for testing on the web and have already looked at some found by search engines, but I could really ...
9
votes
2answers
1k views

design pattern for unit testing? [duplicate]

I am beginner in developing test cases, and want to follow good patterns for developing test cases rather than following some person or company's specific ideas. Some people don't make test cases and ...
10
votes
8answers
750 views

Should developers be involved in testing phases?

we are using a classical V-shaped development process. We then have requirements, architecture, design, implementation, integration tests, system tests and acceptance. Testers are preparing test cases ...
15
votes
12answers
1k views

How often do you run & test your code while programming? [closed]

Especially when writing new code from scratch in C, I find myself writing code for hours, even days without running the compiler for anything but an occasional syntax check. I tend to write bigger ...
7
votes
1answer
84 views

How do you organize your usability testings?

What is your process? How do you get feedback? What software do you use? (like Morae from TechSmith) Who does them? Have you measured how it positively affected the quality of your software? I'm ...
5
votes
2answers
2k views

What are good interview questions for a Software Tester with focus on automation? [closed]

Today's testing is not much like yesterday's testing. More services, more distributed systems, more automation. I want the kind of testers that are self-starters and will constantly work themselves ...
13
votes
10answers
6k views

Black box or white box testing - which do you do first?

On a very small team, where the black box and white box testing is done by the same person, which should the tester do first?
11
votes
2answers
5k views

RSpec vs Test::Unit in Rails

I've never been really convinced of the advantages that you get by switching over to RSpec from Test::Unit in Ruby on Rails (despite reading from time to time about RSpec). What is it about RSpec ...
6
votes
2answers
2k views

UI automation patterns and best practice for desktop applications

Background I'm currently automating some tests for a plugin for MS Office. We are creating Coded UI tests in VS 2010. I suppose I could use the "Coded UI test builder" tool, but it does not really ...