Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

5
votes
4answers
285 views

Are there any formalized/mathematical theories of software testing?

Googling "software testing theory" only seems to give theories in the soft sense of the word; I have not been able to find anything that would classify as a theory in the mathematical, information ...
7
votes
0answers
816 views

Math underpinnings of software testing? [duplicate]

In my software engineering course, we recently (briefly) covered testing. Over the course of the discussion some topics came up that made me wonder about the math underlying software testing (such as ...
3
votes
1answer
159 views

Is it reasonable for a client to expect automated test scripts as project deliverables?

Our company is currently halfway through a software project with a consulting firm. As someone who will be taking ownership of the project after the consultants finish, is it reasonable for our ...
-2
votes
3answers
79 views

What is the difference of smoke testing and black-box testing?

Main theme of my question is about the differences of Smoke Testing and other types of software testing specially Black-box testing but also I'm very curoius to know what is the purpose of this ...
1
vote
1answer
45 views

Could I use Selenium to automate UI testing? How would I do this?

We have a large inventory system where we work and making changes has the possibility to break things in other areas. This happens a lot, and it is hard to manually test for everything every time ...
0
votes
3answers
36 views

How to test Windows .NET TCP program handling of connection failure

I've written my own C# TCP communications module (using SocketAsyncEventArgs, although that's presumably irrelevant). My module runs at both ends of the connection, client and server. As part of the ...
58
votes
16answers
4k views

Is it reasonable to insist on reproducing every defect before diagnosing and fixing it?

I work for a software product company. We have large enterprise customers who implement our product and we provide support to them. For example, if there is a defect, we provide patches, etc. In other ...
195
votes
21answers
28k views

Leaving intentional bugs in code for testers to find

We don't do this at our firm, but one of my friends says that his project manager asked every dev to add intentional bugs just before the product goes to QA. This is how it works: Just before the ...
1
vote
2answers
30 views

Testing code in Java that is only loosely defined

My question is about testing in general. At school, professors say that testing has to be written before we begin to write some code. I guess we need to use EasyMock to represent the classes not ...
2
votes
1answer
49 views

How do you get complete testing/QA in a git/hg flow development process?

I have a question about working with independent testers (not about unit and regression testing.) In a flow process I do my work on a feature branch until I'm confident that it works and I haven't ...
0
votes
1answer
43 views

How can I automatically test my app on multiple OSes? [on hold]

I have a Python based desktop app that can run on Windows, Linux, and Mac. Each time I make an update, I would like to test that it works on each OS, because I have already had several OS-specific ...
-1
votes
0answers
15 views

Is there a service that can do multi-OS testing of my desktop app? [on hold]

I have a Python based desktop app that can run on Windows, Linux, and Mac. Each time I make an update, I would like to test that it works on each OS, because I have already had several OS-specific ...
-1
votes
0answers
37 views

Honest Career Advise [on hold]

I would be graduating soon and looking for internships presently. Before joining the Masters program, I did work for about 3 years as a developer and failed miserably at it. Since then I decided I ...
0
votes
1answer
21 views

Resources concerning system (application) monitoring [on hold]

I am a developer at the beginning of my career. My main "production" application recently had some huge issues. Funny thing is, right before I got the dreaded phone call that everything was f*'d, I ...
0
votes
0answers
32 views

DBUnit alternatives to test DAO layer

We have a lot of DAO tests written with DBUnit and (it's ugly) datasoure. It's not that hard to edit it and add some new entries but it's annoying. Worse is that we have only one datasource for all ...
0
votes
0answers
60 views

Automated Functional Tests for Openwrt based router [closed]

We have a wireless router based on Openwrt and I was thinking about automating most of the functional tests we perform on each firmware release. Looking around other StackExchange sites I've found ...
0
votes
1answer
207 views

Should developers be responsible for testing other developer and contractor/vendor code? [duplicate]

I have been working (~ 5 years & first IT job) as an application developer at a large financial institution with a strict corporate hierarchy, multiple LOBs, and heavily process-laden IT ...
6
votes
5answers
963 views

Test Driven Development: A good/accepted way to test file system operations?

I am working on a project at the moment that generates a table (among other things) based on the contents of a file-system, and and in turn does some meta-data modifications on the things it finds. ...
1
vote
1answer
73 views

Testing front-end app that hits a REST service

A lot of questions about testing here... And I have another one. Forgive me, but I want to make sure I do this right. Let's say I have a front-end application, be it a mobile app, or a single-page ...
4
votes
2answers
111 views

How deep should we dive into testing different layers, i.e. Drupal's db_query?

We use Drupal 7 as our base CMS tool. For one specific product, something like an ERP, we've created sort of a non-drupal layer, to keep our specific business code in. It would be something like ...
2
votes
3answers
73 views

Property based testing without reimplementing the code under test

Given a very simple method such as: def squaredDistance(p1: Point, p2: Point) = math.pow(p1.lon - p2.lon, 2.0) + math.pow(p1.lat - p2.lat, 2.0) What are some valuable property-based tests ...
4
votes
3answers
80 views

What is Black Box Testing? Are Functional and Usability Testing its types?

I am writing about testing and I am confused about the following: What exactly is Black-Box testing? Are functional testing and Usability testing two different types of testing and are they types of ...
0
votes
1answer
105 views

Where should I store and verify files manipulated by an app

I'm working on a little Ruby script to move screenshots while renaming them based on a specific convention. I'll be writing tests to confirm the behavior. Ruby has lots of conventions for where to ...
-3
votes
0answers
28 views

how to test django app using mock and unittest [duplicate]

I have a question on testing django app using unittest and mock python library. I am taking a web design class this semester and we need to work in group to make a website for the class project. My ...
56
votes
11answers
6k views

Does path coverage guarantee finding all bugs?

If every path through a program is tested, does that guarantee finding all bugs? If not, why not? How could you go through every possible combination of program flow and not find the problem if one ...
1
vote
1answer
60 views

PHPUnit > Best approach to mock container objects? (e.g. $item->id)

I'm using PHPUnit test doubles to mock models, libraries etc. But when I want to return an array perhaps of container objects, how best to do so. Here is what I'm currently doing: /** * This is just ...
2
votes
2answers
262 views

What UML diagram should be used for modelling permissions/users/files in Linux?

If I am planning a structure for support testing in Linux, a structure that will contain packages, such files as shell and build scripts, app configurations, DBs, sources, tests and jars for to be ...
2
votes
0answers
115 views

Testing a method that reads from standard input and outputs to standard output [migrated]

I have a method which reads lines from standard input and outputs them to standard output. In a JUnit test, how can I have it send standard input to the method and how can it make assertions about the ...
0
votes
2answers
118 views

Why not using questions in TDD tests descriptions [closed]

I've been a (small) while (ten months more or less) doing TDD for my own applications, trying to improve my skills following this workflow. Thus I am comfortable writing tests, stubbing, mocking, etc. ...
0
votes
1answer
54 views

Test logic with external data [duplicate]

I have a site programmed in PHP where I make more call to external server that return me big xml of data. For each record of the xml I have to make other external call to get other data. So my ...
3
votes
0answers
55 views

Is there an industry standard term for a build which uses the production API, but is specifically for internal testing? [closed]

I'm working on clearing up our build processes of a PhoneGap app we're developing for iOS and Android, and I want to develop a concise naming scheme for our different build types. Here's what I'm ...
2
votes
2answers
81 views

Managing scaffolding for debug vs production builds

The more I program the more I realize that most of my time is spent writing scaffolding for programs so that I can debug them and then strip away the scaffolding for production. The problem is that ...
3
votes
3answers
112 views

How to write tests for function that depends on a config file?

I have a function that uses information from a config file. How do I test the function? Ideally, I'd want to inject my own version of the config file and test from there, but I'm not using dependency ...
29
votes
7answers
3k views

How can QA staff test caching logic that they can't see?

I just implemented a caching layer in my web application, and now I'm wondering how QA is supposed to test it, since caching is transparent to the user. One idea I have is to put logging in the ...
5
votes
2answers
337 views

Load Test Methodology for a cache

I'm currently writing a load test for a cache which should test how a cache will react to persistent requests. A colleague and I had differing opinions on how this load testing should be performed. I ...
13
votes
6answers
1k views

Is creating the objects you think you will need ok in a first test in TDD

I'm fairly new to TDD and I have trouble when creating my first test when it comes before any of the implementation code. Without any framework to the implementation code I am free to write my first ...
28
votes
4answers
2k views

How to efficiently troubleshoot or test new code when hardware setup to reproduce bugs is difficult or impossible to obtain?

I work at a mid-sized company (150ish employees, ~10 size engineering team), and most of my projects involve interfacing with lab equipment (oscilloscopes, optical spectrum analyzers, etc) for the ...
2
votes
2answers
209 views

Don't repeat yourself vs do only one thing in a method

I am currently writing some test cases in python. I often end up calling the same two or three lines of code at the start of a test case in order to get the program I am testing going. For example: ...
0
votes
1answer
57 views

Cyclomatic complexity for 2 IFs - why not just FF or TT?

I know that cyclomatic complexity defines the number of independent paths in the code. Using the simple way, it can be calculated as number of IF +1. In that case, for a simple code with two IFs, CC ...
1
vote
3answers
149 views

Domain analysis - why OFF points are inside of the domain when the border is open

I have asked on a few other sites, no response but it must be something silly as many authors mention in their books. Here is the best text I found: My ultimate question is: Why the OFF point lies ...
0
votes
0answers
47 views

Domain analysis for discrete values - ON and OFF points in these cases

Following my previous question (with great answer from Bart van Ingen Schenau), I noticed a discrepancy I could not wrap my head around: Bart mentioned that: The point ON the boundary is by ...
3
votes
3answers
123 views

Helping testers who don't have specialized domain knowledge

I am a team lead on a project that develops specialized engineering software. My developers generally have advanced degrees and the domain knowledge needed to work with the software we develop, but my ...
0
votes
4answers
58 views

Testing generic errors

I've got a program that validates it's input, and then errors. So far for each kind of error I created a new derived class. But this was getting pretty unwieldy (the input is complex so there are ...
0
votes
1answer
75 views

Reproducing a bug in production that happens with a large database

We are running Oracle 12c and a custom application written in Java/JDBC (Java 8). Our production system is running a 5TB database and runs into deadlocks. However we have been unable to reproduce this ...
1
vote
1answer
71 views

how to unittest with thorough test coverage [duplicate]

I am trying to get into unit testing with python (though my question is not specific to python). I want to add a test for function I already have - I know I should do it the other way round, but here ...
8
votes
3answers
9k views

What is a Developer in Test?

I was recently talking with a recruiter who wants to put me at a company for a position of Developer in Test. He essentially made it sound like a position where you get to fiddle with new programming ...
6
votes
3answers
132 views

Where should I store test data?

I have smaller unit tests that use small snippets from real data sets. I would also like to test my program against full data sets for a multitude of reasons. The only problem is that a single real ...
0
votes
3answers
104 views

Should all possible counter-cases be tested? [duplicate]

I'm currently trying to unit test a behavior which, in some very particular cases, returns B instead of A. It may depend on the value of 3 different attributes for example. How should I test this? ...
1
vote
2answers
205 views

How to add rigor to my testing?

I work on a small/medium sized Java application. Over time, I've tried to ensure that the tests which I write are "good" tests, and that there's plenty of them. Hence I've been looking into various, ...
0
votes
1answer
99 views

Testing process on life critical systems [duplicate]

I currently work in web development - unit testing, functional testing are all good and really are part of what is considered being a professional developer. However, I also have a fear of flying and ...