Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

0
votes
2answers
155 views

Characterization in Testing: Unit test or Functional test [duplicate]

So I'm trying to push for more automated testing in my company, which focus a lot on prototype and proof of concept systems. We currently use Google Test for unit testing. This tests specific test ...
0
votes
1answer
114 views

Iteratively building a Test Framework

(Upfront, I'm not a test or agile expert, just trying to push us to be better. If I'm wrong on anything I'd love your guy's opinions). So I've been pushing for us to become a real agile shop and less ...
0
votes
1answer
75 views

How to I write tests for code that's driving Robot and other external features?

I've got some code I use to take regular screenshots of my screen - it's useful to work out how much of any given day I'm spending on various activities. It looks like this: /** * Code modified ...
0
votes
3answers
206 views

Automated GUI tests take too long because of doing same steps before the “main test action” can proceed

We are developing a desktop application and I am responsible for GUI testing. Currently we have around 500 tests which take 8 hours to complete. The tests are testing almost every button/menu/field ...
0
votes
1answer
199 views

Run coded UI tests on different projects

With little or none previous experience of testing, I'm looking into adding automated testing to a continuous integration process of SharePoint applications. I've learned how this can be achieved ...
8
votes
2answers
264 views

Strategies to troubleshoot an error that only happens on a specific device

As an Android developer, the target market I create apps for is very fragmented. While I can specify certain requirements - e.g. my app only supports Android version x.x or above, sometimes errors may ...
0
votes
0answers
38 views

Best practices for introducing testing to a large, stable, legacy Java application? [duplicate]

I'm working with a stable, but large legacy java application that is over 12 years old, maybe older. Although the code has been upgraded to java 6, it's lacks the features above java 1.4 for the most ...
9
votes
5answers
1k views

Why write tests for code that I will refactor?

I am refactoring a huge legacy code class. Refactoring (I presume) advocates this: write tests for the legacy class refactor the heck out of the class Problem: once I refactor the class, my ...
0
votes
3answers
77 views

Testing non-central features [closed]

Only 1% of our clients use particular features or scenarios. Do you think we should spend as much time testing these features and scenarios as we spend on our central features and scenarios, or we ...
3
votes
6answers
634 views

How to prevent the vicious circle of testing via customer

I recently asked this question and this comment and made me ponder the whole process of releasing an update to the customers. The next update for our software is planned and the previous time it went ...
2
votes
1answer
169 views

How to introduce testing in the development cycle

In our company, we are only two IT staffs, and I'm the only developper. I'm developping rich intranet applications using plain php and extjs as javascript framework. Our development cycle is usually ...
1
vote
2answers
100 views

avoiding hard coding of knowledge of algorithm in tests?

I have a package of code which is suppose to tell me where to allocate elements. When I add a new element it may require repositioning of existing elements to keep my 'tree' in a format that promises ...
2
votes
2answers
241 views

Testing a very specific function in a large, complex application

I'm new to testing but wholeheartedly realize how important it is. The main issue is that my company has no top-down support for testing at all. That is we don't have any unit testing and just a bit ...
2
votes
4answers
342 views

Test Doubles, Mocks and Stubs - when not to use & why, for Ruby, Rspec

I've learned about mocking and stubbing and I've seen how they can help me create great test suites that run blindingly fast and thus speed up my development process hugely. However I've also seen ...
0
votes
1answer
57 views

How to mark unit/integration tests when they do not apply for the current test configuration - Inconclusive or Passed?

In my test environment we are running the same set of integration (and sometimes unit) tests against different systems that have different capabilities. Some of the tests cannot be executed against ...
6
votes
3answers
471 views

Are “Stocks” a TDD/Unit testing anti pattern?

From Martin Fowler's Mocks Aren't Stubs he states that Stubs provide canned answers to calls made during the test while Mocks objects pre-programmed with expectations which form a specification of the ...
1
vote
2answers
68 views

Test Data in a Distributed System

A question that has been vexing me lately has been about how to effectively test (end-to-end) features in a distributed system. Particuarly, how to effectively manage (through time) test data for ...
6
votes
5answers
558 views

Viability of a Development Team with no *dedicated* Tester role [closed]

I've been thinking a lot lately about how to build a lean development team. Ultimately, I'd like to open up my own little software house with a small number of like-minded people. The goal won't be ...
3
votes
1answer
114 views

How can I improve quality on SQL reports?

I've recently ran into some issues where some reports were not generating the proper results. We already have a QA department that reviews the reports and then our business owners review them as well; ...
8
votes
5answers
621 views

In functional programming how does one achieve modularity through mathematical laws?

I read in this question that functional programmers tend to use mathematical proofs to ensure that their program is working correctly. This sounds alot easier and faster than unit testing, but coming ...
4
votes
1answer
334 views

Should front-end integration tests make HTTP requests?

I am developing a single-page web application using AngularJS. Data for this application is consumed over a REST API which is well tested in its own right. The Angular application has a bunch of unit ...
0
votes
0answers
62 views

Scheduled website testing: Searching for a lightweight, simple solution

Scheduled website testing: Searching for a simple solution. One of my clients is having some tens of sites, with webform-based landing pages. He wants to daily test 3 different use-cases pre site, in ...
3
votes
4answers
351 views

Testing all combinations

I need to do some performance measurements inside my application. I want to measure, change some parameters, measure again. There are different algorithms I want to test, and there are various ...
0
votes
2answers
248 views

Use of fixtures in unit testing

I'm trying to understand the use of fixtures in the context of unit testing models in a web MVC system. The problem I am trying to understand is that fixture data does no give a true representation ...
3
votes
2answers
191 views

Is it normal to get your software development products critiqued?

I am currently a software developer on coop that was in an interesting situation today. I cannot say too much, as the things I do are under NDA, but I make Grasshopper 3D (which is a Rhino plugin) ...
2
votes
1answer
205 views

Is it worth the time to run static analysis tools (e.g. Findbugs) on test classes? [closed]

How likely is it for a bug that can be discovered by a static analysis tool (namely Findbugs) in test classes mask a real bug in the actual code? Is this a realistic scenario? Is it really worth the ...
8
votes
10answers
659 views

Testing vs Don't Repeat Yourself (DRY)

Why is repeating yourself by writing tests so highly encouraged? It seems that tests basically express the same thing as the code, and hence is a duplicate (in concept, not implementation) of the ...
1
vote
5answers
602 views

How to unit test a missing case in a switch statement where all cases are true

I often use enum types in my code with a switch to apply logic to each type. In these cases it's important that each enum has code implemented. For example; public enum eERROR { REQUIRED, ...
-1
votes
4answers
248 views

“A well designed system is a testable system” [closed]

I'm thinking about something I've read in a book: "A well designed system is a testable system" and I'm wondering why it is so. Certainly, a system that is much tested is probably well designed. ...
2
votes
1answer
123 views

How to test a function that updates the password in database?

I have a test database with few user accounts. I don't want to break any tests. If I am writing a function that updates password for user in db and one that reads the password. Should I ideally reset ...
-1
votes
1answer
123 views

How should I test my application? [closed]

I have made a simple application which searches for files and folders on users computer. Since, I am a student currently in my 1st year and don't have any formal training and have made my application ...
-1
votes
1answer
155 views

Software process of small company [closed]

I'm wondering how should testing take place in small teams (or start-up teams). I'm talking 5-10 developers that are assigned to multiple development tasks. From my experience there is little to ...
0
votes
1answer
148 views

In TDD, is it bad practice to pass a test with code that would pass more than one test? [duplicate]

When using TDD, is it bad practice to pass a newly written test with code that could also pass another test? For example, take the following test (in PHP) public function ...
0
votes
3answers
107 views

What are the proper terms for desk/user testing?

Is there a common and accepted term for the manual tests done by programmers or users on software in lieu of or in addition to automated testing? For example, in a progression as follows: "Desk ...
3
votes
2answers
175 views

Automated testing of programs with graphical output

I am a lecturer for a post-graduate module where I expect my students to write Python code that replicates examples from the textbook. The project has been running for a couple of years and this year ...
37
votes
7answers
4k views

Is it sufficient to use acceptance and integration tests instead of unit test?

Short introduction to this question. I have used now TDD and lately BDD for over one year now. I use techniques like mocking to make writing my tests more efficiently. Lately I have started a ...
2
votes
1answer
164 views

How can I automatically test a large, complex spreadsheet?

So, I've inherited one of those "Engineer's Special" spreadsheets -- the kind developed by Mort the Engineer, with lots of hairy VBA and WTF, complicated calculations, and no documentation. ...
1
vote
4answers
312 views

How to trace logical errors in algorithms [closed]

I am beginner in algorithms. Last year I participated in Google Code Jam. One of the major issues I faced during the competition was my code was working fine on my test cases, but when I submitted on ...
1
vote
3answers
176 views

How to test a website?

I found it's really hard to divide the task of developing a website to a team of people. The problem is a website should have consistent looking and be integrated in users' view. The style and page ...
3
votes
1answer
128 views

Testing: Should I wrap system notifications and send my own?

In the current Cocoa app I'm working on, I've got an object, RecordScheduler, which responds to two types of notifications, "day did pass" and "quicksaving interval did pass". In both cases, the ...
0
votes
6answers
434 views

English term for “Naive user test” or “idiot test”

In usability testing, it's common to select a set of users who have never used the software before. I've heard this process described by programmers as the "idiot test", or sometimes "naive user ...
1
vote
1answer
144 views

Does condition coverage subsume edge coverage?

I'm a little bit confused about code coverage criteria; especially condition and edge coverage. As stated in this book, edge coverage does not subsume condition coverage; BUT my lecture material ...
3
votes
3answers
490 views

Effective way to estimate dead code removal?

I've been working in an application with about 100k LOCs and basically We have been reworking features to comply with a new architecture based on a new technology stack. This work is almost finished ...
13
votes
4answers
422 views

How to structure tests where one test is another test's setup?

I'm integration testing a system, by using only the public APIs. I have a test that looks something like this: def testAllTheThings(): email = create_random_email() password = ...
6
votes
1answer
488 views

Testing: deterministic or non-deterministic?

Is it better to have either a Deterministic test suite, that results in the same tests succeeding Non-deterministic test suite, which potentially possibly covers more cases ? Example: You write a ...
6
votes
1answer
184 views

Managing false positives in TDD or BDD

I'm relatively new to TDD and have been thinking a lot about how to manage the perpetually growing pool of tests that comes with it. One of my biggest concerns is about false positives. In my ...
3
votes
2answers
16k views

What is the difference between apache and tomcat in the xampp control panel? [duplicate]

I installed xampp in my machine. I wonder what is the difference between apache and tomcat in the xampp control panel. p/s: I started apache only and test with "localhost/index.html", it works. I ...
2
votes
3answers
250 views

Software without a testable goal

I hope you bear with me here. It's difficult to explain this problem, especially so without direct reference to the specific domain. I work on a component of a larger system which performs ...
12
votes
6answers
878 views

Contract Based Programming vs Unit Test

I am a somewhat defensive programmer and a big fan of Microsofts Code Contracts. Now I cannot always use C# and in most languages the only tool I have is assertions. So I usually end up with code ...
0
votes
1answer
331 views

How would you create useful tests for Oracle BI Publisher reports?

I'm curious about how to test reports that seem rather straightforward. I'm supposed to create test cases for an Oracle report(XML Publisher/BI Publisher). So for example, a report is supposed to just ...