Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

3
votes
0answers
105 views

Does the games industry use automated testing for visual parts of games/rendering? How?

Some parts of a game are easy to test in an automated way (logic, maths, input handling); but there's also a lot that's purely visual and not easily testable. I would be surprised if the games ...
3
votes
4answers
203 views

Convincing my boss that touching the Database is integration testing [on hold]

I am currently working on introducing continuous integration and switching to git, and as part of that, we must also better structure our tests. We have agreed on splitting the tests in "integration" ...
21
votes
5answers
2k views

Is Testing a necessary part of Agile methodology?

I have been on numerous teams that try to practice Agile methodologies and often these teams are test centric. Is testing a necessary part of practicing the Agile methodology or is it just a XP ...
0
votes
1answer
49 views

How can I test my camera-dependent android app on most devices? [duplicate]

We are developing an app for taking photos faster. We do this by actually taking videos instead of photos and processing the individual images in the video on the fly and combine them to create a ...
2
votes
4answers
253 views

Who is a tester? [duplicate]

I don't really understand the concept of testers. I just graduated and before I joined into workplace I thought I'd be pair programming with testers and using TDD where they will be writing tests and ...
-2
votes
0answers
77 views

How can I capture the http request and fake it later as a server? [closed]

So the reason is based on some facts: A program use a third party web service via http A bug been found on live server and can't be recreate on testing server. Keep debugging against third party ...
1
vote
1answer
57 views

Onshore / Offshore (Team and Testing)

Can anyone describe to me what Onshore / Offshore team is and what Onshore / Offshore testing is? Because i am studying this article and I can't find anywhere the specific meanings about the above ...
1
vote
0answers
23 views

remote feature control for apps for a/b testing

I have a published app (Android/iOS) and I'd like to instrument the next version so that I can remotely enable/disable or adjust features, through a web interface. This could facilitate a/b testing ...
3
votes
4answers
191 views

Wrap all external calls with flag to fight against recursion and double-entry?

Producing predictable output for each possible input is the responsibility of each module. For example (in C#): class Logger { public ITextWriter Writer { get; set; } private uint counter; ...
10
votes
1answer
341 views

Testing strategy for games

I've inherited a web-based educational game. Over the past year I've worked towards stabilizing the code and adding new features. Most of the logic is in the front-end, so back-end unit tests, while ...
0
votes
1answer
80 views

How does one learn QA? [closed]

When starting to learn programming you would usually point someone over to Code Academy, or Learn Python the Hard Way or even The C Programming language and tell them start writing code until it ...
0
votes
0answers
43 views

Mocks and Stubs - Classes and methods? [duplicate]

I'm trying to get a high level understanding of mocks and stubs. My language/frameworks are ruby, rails, rspec, jasmine I heard this very high level definition: Mocks are used to represent objects ...
2
votes
2answers
82 views

Static Test-Data in Helper Class: Getter vs Public Constant

Currently I am in process of writing large batches of Unit-Tests in the Project I am working on. Additionally we recently Introduced GUI-Testing. This project is a relatively simple webapp, on basis ...
-3
votes
1answer
50 views

How create unit test the performance of an application? [closed]

What I want is to run automatically methods to tests the performance of an application. Just like the unit tests, but with the purpose of evaluate the performance and create reports if is it possible. ...
1
vote
1answer
59 views

Using Mockito.reset

I've just read a lot of arguments against using Mockito.reset and can't make much sense of it. Put differently, I agree in general, but there's always a case which looks like using reset is useful or ...
0
votes
3answers
84 views

Is it anti-pattern to mix unit test and web test? [duplicate]

It is a language agnostic question, e.g. I have a unit test like # Unit test User user = User.create('john'); assertEquals("User name is john", "john", user.getName()); # Web test start from here ...
2
votes
6answers
243 views

Can unit tests verify software requirements?

I have often heard unit tests help programmers build confidence in their software. But is it enough for verifying that software requirements are met? I am losing confidence that software is working ...
1
vote
3answers
163 views

How do I test my code in Python other than by doing it by hand?

I am used to user testing in Java, and I also manually test each section of code I write, but now, I want to automate it. There is no GUI for this project, so user testing is not required and I can ...
1
vote
1answer
68 views

Question about mocking externals [duplicate]

at company we're developing quite a big project and we're arguing at the testing strategy. The question is: should all of the tests be executed in isolation of external services like database or APIs ...
1
vote
1answer
68 views

Testing for Authentication loop holes / bugs

We've got a web application which is 99% complete prior to public beta, were currenlty securing the site from security perspective, locking down the server, db etc, one thing I'm concerned about but ...
3
votes
1answer
105 views

Android testing - bugs not reproducible [duplicate]

We have the following problem: at the end of the iteration we give our Android app to our customers to test. Our customers report bugs that are not reproducible on our test devices. How can we deal ...
4
votes
2answers
78 views

Testing strategy for production environment [closed]

In an ideal world, dev/ops are working together as one team to release something onto production. However, there are organizations with limitations so that release engineers/teams are kept ...
1
vote
4answers
615 views

Is having some logic in source code in order to perform some tests a good practice?

The question is not about changing the method/function visibility or extract local variable into instance variable in order to perform unit tests. There are cases where we could include some logic ...
2
votes
2answers
260 views

How redundant should my tests be?

This is something I often struggle with in testing, yet can never find a canonical or reasonable answer to. Simple scenario A function, f(), takes a file, processes it, and returns the processed ...
0
votes
2answers
91 views

SOAP message testing

I am working in Scala/Java. I'm testing the messaging infrastructure of a part of my system that I did several years ago with CXF and Java. More specifically, I'm re-writing the specification of the ...
2
votes
3answers
158 views

How important is automated testing in rapid release, non-critical (web) apps?

I think I understand the theoretical benefits of automated testing, especially unit testing. However, I'm not sure what the optimal amount of testing is when the project is a non-critical, rapidly ...
1
vote
1answer
176 views

Testing an MMO server

I'm working on a server for a very large (feature wise) MMO. After some bad experiences with breaking changes that caused bugs weeks down the line, we'd like to add unit/automated/regression tests to ...
0
votes
4answers
145 views

Should each method have a seperate JUnit test class?

I am writing JUnit unit tests for my classes. Is it better to have a separate class for each method, or have just one test class for every actual class?
4
votes
3answers
221 views

What is the best use case for selenium?

I've been trying to develop web applications while at the same time creating the testing. I understand unit testing, I can declare a test method and test specific methods in my application. But I ...
1
vote
1answer
193 views

Which is the more testable C function implementation?

I write code in C. I have been striving to write more testable code but I am a little confused on deciding between writing pure functions that are really good for testing but require smaller functions ...
3
votes
4answers
184 views

How to identify and run the most relevant automated tests?

Suppose you have a reasonably large codebase (0.5 - 1 msloc) with a large test-suite (6-7hr single-threaded runtime; with a mix of unit-tests and integration-tests built with different tools). You ...
4
votes
1answer
120 views

How can I test a search engine for an uncommon human language?

We are writing a search engine from scratch in a quite uncommon language, Aramaic, mostly for learning purposes but also because few resources are available in given language. The engine is/will be ...
17
votes
3answers
368 views

How to test and optimize when you can't reproduce the environment?

In the past, I've worked in a variety of environments. Desktop apps, games, embedded stuff, web services, command line jobs, web sites, database reporting, and so on. All of these environments shared ...
3
votes
1answer
87 views

Testing gap between unit and integration: Integration in the Small, Component, Unit Integration Tests

Over the past few weeks I've been mulling and researching how to fill a gap in our testing methodology. In simplified terms unit tests are too small and traditional integration tests are too big. A ...
2
votes
2answers
135 views

What UML diagram should be used for modelling permissions/users/files in Linux?

If I am planning a structure for support testing in Linux, a structure that will contain packages, such files as shell and build scripts, app configurations, DBs, sources, tests and jars for to be ...
-3
votes
1answer
76 views

How does the experience of any tester count? [closed]

A developer learns a lot of stuffs at work. For eg. Lets think of a Java or C++ developer, as years pass by he learns a lot about the technology, design patterns, new frameworks and etc ... This I ...
12
votes
7answers
540 views

Coding and testing in the same sprint

How is testing handled within the same sprint as coding, if all or most of the coding is not done until the end of the sprint? (I'm referring to the "soup-to-nuts" development and testing of a single ...
0
votes
0answers
30 views

How to test for performance or locking issues of sharing a database with another app

I have a typical Spring/Hibernate Tomcat webapp that has a user_info table. I’m trying to create another webapp that will do CRUD actions on the user_info table. I'm considering sharing the same ...
6
votes
1answer
228 views

Suggested method for extracting a standalone C library from an existing R package?

My group has been developing an R package to simulate plant growth (see GitHub repository). The R package uses .Call to interface with C. We have decided that it would be worthwhile to create a ...
1
vote
0answers
46 views

Should I have different automated Selenium tests for different screen resolutions?

A website I'm creating is going to have three breakpoints: desktop, tablet landscape, mobile. Should I write a test for each resolution?
2
votes
1answer
84 views

Testing complex compositions

I have a rather large collection of classes which check and mutate a given data structure. They can be composed via the composition pattern into arbitrarily complex tree-like structures. The final ...
4
votes
2answers
256 views

What kind of code would Kent Beck avoid unit testing? [duplicate]

I've been watching a few of the Is TDD Dead? talks on youtube, and one of the things that surprised me is Kent Beck seems to acknowledge that there are just some kinds of programs that aren't worth ...
4
votes
1answer
158 views

Continuous Integration using Docker

One of the main advantages of Docker is the isolated environment it brings, and I want to leverage that advantage in my continuous integration workflow. A "normal" CI workflow goes something like ...
0
votes
1answer
85 views

How to unit test models in MVC / MVR app?

I'm building a node.js web app and am trying to do so for the first time in a test driven fashion. I'm using nodeunit for testing, which I find allows me to write tests quickly and painlessly. In this ...
0
votes
1answer
123 views

Jasmine BDD vs Integration Tests

Let's say I need to write a test for the front end, in the following BDD style: A user visits buysomething.com, saves something to their wishlist, and a saved item count is updated. The result ...
4
votes
3answers
256 views

How to analyze a scenario where a bug didn't get caught and adjust development workflow to prevent similar errors

I had a bug that was really difficult to track down, because all the unit tests were green, but the production application didn't work properly. Here's what happened: I had a filter class that set ...
2
votes
3answers
102 views

Is there any point in writing a random tester for code that deals with inductive data structures?

Let's say we're writing a simple JSON parser and we've fully covered the code with unit tests: it can parse primitives "0", "123", "-456", '""', '"asd"', true, false it can parse arrays "[]", "[1, ...
2
votes
1answer
116 views

Separate Action from Assertion in Unit Tests

Setup Many years ago I took to a style of unit testing that I have come to like a lot. In short, it uses a base class to separate out the Arrangement, Action and Assertion of the test into separate ...
2
votes
2answers
102 views

Specification languages vs automated tests

I recently listened to an episode of Software Engineering Radio in which Leslie Lamport was interviewed. One thing he discussed was his specification language, TLA+. Essentially, he seemed to be ...
25
votes
4answers
1k views

How to efficiently troubleshoot or test new code when hardware setup to reproduce bugs is difficult or impossible to obtain?

I work at a mid-sized company (150ish employees, ~10 size engineering team), and most of my projects involve interfacing with lab equipment (oscilloscopes, optical spectrum analyzers, etc) for the ...