Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

0
votes
1answer
64 views

Run coded UI tests on different projects

With little or none previous experience of testing, I'm looking into adding automated testing to a continuous integration process of SharePoint applications. I've learned how this can be achieved ...
8
votes
2answers
213 views

Strategies to troubleshoot an error that only happens on a specific device

As an Android developer, the target market I create apps for is very fragmented. While I can specify certain requirements - e.g. my app only supports Android version x.x or above, sometimes errors may ...
0
votes
0answers
34 views

Best practices for introducing testing to a large, stable, legacy Java application? [duplicate]

I'm working with a stable, but large legacy java application that is over 12 years old, maybe older. Although the code has been upgraded to java 6, it's lacks the features above java 1.4 for the most ...
8
votes
5answers
697 views

Why write tests for code that I will refactor?

I am refactoring a huge legacy code class. Refactoring (I presume) advocates this: write tests for the legacy class refactor the heck out of the class Problem: once I refactor the class, my ...
0
votes
3answers
74 views

Testing non-central features [closed]

Only 1% of our clients use particular features or scenarios. Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
3
votes
6answers
594 views

How to prevent the vicious circle of testing via customer

I recently asked this question and this comment and made me ponder the whole process of releasing an update to the customers. The next update for our software is planned and the previous time it went ...
1
vote
1answer
112 views

How to introduce testing in the development cycle

In our company, we are only two IT staffs, and I'm the only developper. I'm developping rich intranet applications using plain php and extjs as javascript framework. Our development cycle is usually ...
1
vote
2answers
91 views

avoiding hard coding of knowledge of algorithm in tests?

I have a package of code which is suppose to tell me where to allocate elements. When I add a new element it may require repositioning of existing elements to keep my 'tree' in a format that promises ...
1
vote
2answers
187 views

Testing a very specific function in a large, complex application

I'm new to testing but wholeheartedly realize how important it is. The main issue is that my company has no top-down support for testing at all. That is we don't have any unit testing and just a bit ...
2
votes
4answers
208 views

Test Doubles, Mocks and Stubs - when not to use & why, for Ruby, Rspec

I've learned about mocking and stubbing and I've seen how they can help me create great test suites that run blindingly fast and thus speed up my development process hugely. However I've also seen ...
0
votes
1answer
48 views

How to mark unit/integration tests when they do not apply for the current test configuration - Inconclusive or Passed?

In my test environment we are running the same set of integration (and sometimes unit) tests against different systems that have different capabilities. Some of the tests cannot be executed against ...
6
votes
3answers
383 views

Are “Stocks” a TDD/Unit testing anti pattern?

From Martin Fowler's Mocks Aren't Stubs he states that Stubs provide canned answers to calls made during the test while Mocks objects pre-programmed with expectations which form a specification of the ...
0
votes
2answers
53 views

Test Data in a Distributed System

A question that has been vexing me lately has been about how to effectively test (end-to-end) features in a distributed system. Particuarly, how to effectively manage (through time) test data for ...
6
votes
5answers
337 views

Viability of a Development Team with no *dedicated* Tester role [closed]

I've been thinking a lot lately about how to build a lean development team. Ultimately, I'd like to open up my own little software house with a small number of like-minded people. The goal won't be ...
2
votes
1answer
97 views

How can I improve quality on SQL reports?

I've recently ran into some issues where some reports were not generating the proper results. We already have a QA department that reviews the reports and then our business owners review them as well; ...
9
votes
5answers
569 views

In functional programming how does one achieve modularity through mathematical laws?

I read in this question that functional programmers tend to use mathematical proofs to ensure that their program is working correctly. This sounds alot easier and faster than unit testing, but coming ...
3
votes
1answer
185 views

Should front-end integration tests make HTTP requests?

I am developing a single-page web application using AngularJS. Data for this application is consumed over a REST API which is well tested in its own right. The Angular application has a bunch of unit ...
0
votes
0answers
49 views

Scheduled website testing: Searching for a lightweight, simple solution

Scheduled website testing: Searching for a simple solution. One of my clients is having some tens of sites, with webform-based landing pages. He wants to daily test 3 different use-cases pre site, in ...
3
votes
4answers
289 views

Testing all combinations

I need to do some performance measurements inside my application. I want to measure, change some parameters, measure again. There are different algorithms I want to test, and there are various ...
0
votes
2answers
119 views

Use of fixtures in unit testing

I'm trying to understand the use of fixtures in the context of unit testing models in a web MVC system. The problem I am trying to understand is that fixture data does no give a true representation ...
3
votes
2answers
181 views

Is it normal to get your software development products critiqued?

I am currently a software developer on coop that was in an interesting situation today. I cannot say too much, as the things I do are under NDA, but I make Grasshopper 3D (which is a Rhino plugin) ...
2
votes
1answer
187 views

Is it worth the time to run static analysis tools (e.g. Findbugs) on test classes? [closed]

How likely is it for a bug that can be discovered by a static analysis tool (namely Findbugs) in test classes mask a real bug in the actual code? Is this a realistic scenario? Is it really worth the ...
2
votes
7answers
354 views

Testing vs Don't Repeat Yourself (DRY)

Why is repeating yourself by writing tests so highly encouraged? It seems that tests basically express the same thing as the code, and hence is a duplicate (in concept, not implementation) of the ...
1
vote
5answers
242 views

How to unit test a missing case in a switch statement where all cases are true

I often use enum types in my code with a switch to apply logic to each type. In these cases it's important that each enum has code implemented. For example; public enum eERROR { REQUIRED, ...
-1
votes
4answers
233 views

“A well designed system is a testable system” [closed]

I'm thinking about something I've read in a book: "A well designed system is a testable system" and I'm wondering why it is so. Certainly, a system that is much tested is probably well designed. ...
2
votes
1answer
117 views

How to test a function that updates the password in database?

I have a test database with few user accounts. I don't want to break any tests. If I am writing a function that updates password for user in db and one that reads the password. Should I ideally reset ...
-1
votes
1answer
110 views

How should I test my application? [closed]

I have made a simple application which searches for files and folders on users computer. Since, I am a student currently in my 1st year and don't have any formal training and have made my application ...
-1
votes
1answer
117 views

Software process of small company [closed]

I'm wondering how should testing take place in small teams (or start-up teams). I'm talking 5-10 developers that are assigned to multiple development tasks. From my experience there is little to ...
0
votes
1answer
140 views

In TDD, is it bad practice to pass a test with code that would pass more than one test? [duplicate]

When using TDD, is it bad practice to pass a newly written test with code that could also pass another test? For example, take the following test (in PHP) public function ...
0
votes
3answers
104 views

What are the proper terms for desk/user testing?

Is there a common and accepted term for the manual tests done by programmers or users on software in lieu of or in addition to automated testing? For example, in a progression as follows: "Desk ...
2
votes
2answers
123 views

Automated testing of programs with graphical output

I am a lecturer for a post-graduate module where I expect my students to write Python code that replicates examples from the textbook. The project has been running for a couple of years and this year ...
0
votes
0answers
77 views

How to structure integration tests per environment

I have a set of integration tests written using MSTest. I want to deploy my application to various environments and run my integration tests on that environment. There are certain configuration ...
27
votes
7answers
2k views

Is it sufficient to use acceptance and integration tests instead of unit test?

Short introduction to this question. I have used now TDD and lately BDD for over one year now. I use techniques like mocking to make writing my tests more efficiently. Lately I have started a ...
2
votes
1answer
137 views

How can I automatically test a large, complex spreadsheet?

So, I've inherited one of those "Engineer's Special" spreadsheets -- the kind developed by Mort the Engineer, with lots of hairy VBA and WTF, complicated calculations, and no documentation. ...
1
vote
4answers
209 views

How to trace logical errors in algorithms [closed]

I am beginner in algorithms. Last year I participated in Google Code Jam. One of the major issues I faced during the competition was my code was working fine on my test cases, but when I submitted on ...
1
vote
3answers
170 views

How to test a website?

I found it's really hard to divide the task of developing a website to a team of people. The problem is a website should have consistent looking and be integrated in users' view. The style and page ...
3
votes
1answer
103 views

Testing: Should I wrap system notifications and send my own?

In the current Cocoa app I'm working on, I've got an object, RecordScheduler, which responds to two types of notifications, "day did pass" and "quicksaving interval did pass". In both cases, the ...
0
votes
6answers
402 views

English term for “Naive user test” or “idiot test”

In usability testing, it's common to select a set of users who have never used the software before. I've heard this process described by programmers as the "idiot test", or sometimes "naive user ...
1
vote
1answer
89 views

Does condition coverage subsume edge coverage?

I'm a little bit confused about code coverage criteria; especially condition and edge coverage. As stated in this book, edge coverage does not subsume condition coverage; BUT my lecture material ...
3
votes
3answers
413 views

Effective way to estimate dead code removal?

I've been working in an application with about 100k LOCs and basically We have been reworking features to comply with a new architecture based on a new technology stack. This work is almost finished ...
13
votes
4answers
376 views

How to structure tests where one test is another test's setup?

I'm integration testing a system, by using only the public APIs. I have a test that looks something like this: def testAllTheThings(): email = create_random_email() password = ...
6
votes
1answer
170 views

Testing: deterministic or non-deterministic?

Is it better to have either a Deterministic test suite, that results in the same tests succeeding Non-deterministic test suite, which potentially possibly covers more cases ? Example: You write a ...
5
votes
1answer
164 views

Managing false positives in TDD or BDD

I'm relatively new to TDD and have been thinking a lot about how to manage the perpetually growing pool of tests that comes with it. One of my biggest concerns is about false positives. In my ...
-1
votes
1answer
129 views

Making my code more robust [closed]

I have recently finished a piece of code that passed all tests. (Here is some idea what it does and Here is some actual code.) Problems began, however, when I run my code on the cloud with actual ...
2
votes
2answers
4k views

What is the difference between apache and tomcat in the xampp control panel? [duplicate]

I installed xampp in my machine. I wonder what is the difference between apache and tomcat in the xampp control panel. p/s: I started apache only and test with "localhost/index.html", it works. I ...
3
votes
3answers
242 views

Software without a testable goal

I hope you bear with me here. It's difficult to explain this problem, especially so without direct reference to the specific domain. I work on a component of a larger system which performs ...
12
votes
6answers
666 views

Contract Based Programming vs Unit Test

I am a somewhat defensive programmer and a big fan of Microsofts Code Contracts. Now I cannot always use C# and in most languages the only tool I have is assertions. So I usually end up with code ...
0
votes
1answer
178 views

How would you create useful tests for Oracle BI Publisher reports?

I'm curious about how to test reports that seem rather straightforward. I'm supposed to create test cases for an Oracle report(XML Publisher/BI Publisher). So for example, a report is supposed to just ...
6
votes
3answers
223 views

How many bugs to expect [closed]

At a previous job (circa 2010), my manager mentioned that he's doing some research into quality metrics. The bottom line is to answer the question how many bugs should I expect? The goal is to try and ...
1
vote
2answers
129 views

Which is better approach for writing automated tests? [duplicate]

Writing tests in single file or writing each test in a separate file? I have found few advantages of keeping test cases in separate file. Easy to maintain, better readability, easy to run single ...