Verifying the behavior of a software system against the expected behavior of that system.

learn more… | top users | synonyms

0
votes
0answers
15 views

remote feature control for apps for a/b testing

I have a published app (Android/iOS) and I'd like to instrument the next version so that I can remotely enable/disable or adjust features, through a web interface. This could facilitate a/b testing ...
-3
votes
0answers
32 views

How to test API's using Jmeter [on hold]

my question is...how to test API's,in particular restful API'S using Jmeter???I am kind of new in this field....and I was told that there are these test scripts which have to be written to check the ...
3
votes
3answers
147 views

Wrap all external calls with flag to fight against recursion and double-entry?

Producing predictable output for each possible input is the responsibility of each module. For example (in C#): class Logger { public ITextWriter Writer { get; set; } private uint counter; ...
10
votes
1answer
316 views

Testing strategy for games

I've inherited a web-based educational game. Over the past year I've worked towards stabilizing the code and adding new features. Most of the logic is in the front-end, so back-end unit tests, while ...
0
votes
1answer
72 views

How does one learn QA? [closed]

When starting to learn programming you would usually point someone over to Code Academy, or Learn Python the Hard Way or even The C Programming language and tell them start writing code until it ...
0
votes
1answer
49 views

Where should I store and verify files manipulated by an app

I'm working on a little Ruby script to move screenshots while renaming them based on a specific convention. I'll be writing tests to confirm the behavior. Ruby has lots of conventions for where to ...
0
votes
0answers
43 views

Mocks and Stubs - Classes and methods? [duplicate]

I'm trying to get a high level understanding of mocks and stubs. My language/frameworks are ruby, rails, rspec, jasmine I heard this very high level definition: Mocks are used to represent objects ...
2
votes
2answers
76 views

Static Test-Data in Helper Class: Getter vs Public Constant

Currently I am in process of writing large batches of Unit-Tests in the Project I am working on. Additionally we recently Introduced GUI-Testing. This project is a relatively simple webapp, on basis ...
3
votes
1answer
101 views

Android testing - bugs not reproducible [duplicate]

We have the following problem: at the end of the iteration we give our Android app to our customers to test. Our customers report bugs that are not reproducible on our test devices. How can we deal ...
1
vote
1answer
43 views

Using Mockito.reset

I've just read a lot of arguments against using Mockito.reset and can't make much sense of it. Put differently, I agree in general, but there's always a case which looks like using reset is useful or ...
0
votes
3answers
83 views

Is it anti-pattern to mix unit test and web test? [duplicate]

It is a language agnostic question, e.g. I have a unit test like # Unit test User user = User.create('john'); assertEquals("User name is john", "john", user.getName()); # Web test start from here ...
27
votes
5answers
2k views

Testing multi-threaded race conditions

Reading the comments to this answer, specifically: Just because you can't write a test doesn't mean it's not broken. Undefined behaviour which usually happens to work as expected (C and C++ are ...
2
votes
2answers
115 views

What UML diagram should be used for modelling permissions/users/files in Linux?

If I am planning a structure for support testing in Linux, a structure that will contain packages, such files as shell and build scripts, app configurations, DBs, sources, tests and jars for to be ...
4
votes
1answer
476 views

Is there an effective way to test XSL transforms/BizTalk maps?

Creating repeatable tests for BizTalk maps is frustrating. I can't find a way to handle testing them like I'd do unit testing, because I can't find ways to break them into logical chunks. They tend to ...
-3
votes
1answer
46 views

How create unit test the performance of an application? [closed]

What I want is to run automatically methods to tests the performance of an application. Just like the unit tests, but with the purpose of evaluate the performance and create reports if is it possible. ...
1
vote
2answers
578 views

Where (if there is) is the IEEE glossary newer than 1990?

I have been looking for some formal definitons but could not find any IEEE newer than 610, which is from 1990. Could you help me please?
3
votes
1answer
87 views

Testing my model for hybrid scheduling in Embedded Systems

I am working on a project for school, where I have to analyze the performances of a few fixed-priority servers algorithms (polling server, deferrable server, priority exchange) using a simulator in ...
3
votes
9answers
11k views

What are the differences between QA engineers and software engineers?

The way I see it is if you write code that does something useful then you're a software engineer but from what I gather QA engineers seem to have an inferiority complex. It seems like QA engineers are ...
2
votes
6answers
239 views

Can unit tests verify software requirements?

I have often heard unit tests help programmers build confidence in their software. But is it enough for verifying that software requirements are met? I am losing confidence that software is working ...
0
votes
3answers
360 views

How to verify the code that could take a substantial time to compile? [closed]

As a follow up to my prev question: What is the best aproach for coding in a slow compilation environment To recap: I am stuck with a large software system with which a TDD ideology of "test often" ...
1
vote
3answers
157 views

How do I test my code in Python other than by doing it by hand?

I am used to user testing in Java, and I also manually test each section of code I write, but now, I want to automate it. There is no GUI for this project, so user testing is not required and I can ...
1
vote
1answer
66 views

Question about mocking externals [duplicate]

at company we're developing quite a big project and we're arguing at the testing strategy. The question is: should all of the tests be executed in isolation of external services like database or APIs ...
4
votes
2answers
799 views

How and what should I be (unit) testing for in this method?

I am relatively new to unit testing and have a query about what/how I should be testing a certain method. For the following (psudo-c#) method I have created (not a real-life example) what would you ...
1
vote
1answer
68 views

Testing for Authentication loop holes / bugs

We've got a web application which is 99% complete prior to public beta, were currenlty securing the site from security perspective, locking down the server, db etc, one thing I'm concerned about but ...
4
votes
2answers
71 views

Testing strategy for production environment [closed]

In an ideal world, dev/ops are working together as one team to release something onto production. However, there are organizations with limitations so that release engineers/teams are kept ...
1
vote
4answers
613 views

Is having some logic in source code in order to perform some tests a good practice?

The question is not about changing the method/function visibility or extract local variable into instance variable in order to perform unit tests. There are cases where we could include some logic ...
2
votes
2answers
260 views

How redundant should my tests be?

This is something I often struggle with in testing, yet can never find a canonical or reasonable answer to. Simple scenario A function, f(), takes a file, processes it, and returns the processed ...
1
vote
2answers
52 views

Mimicking a bluetooth disconnection

I've written a program to control a bluetooth device. I'm trying to test cases when the bluetooth disconnects, i.e. if its out of range. Physically taking the device out of range is one possibility, ...
1
vote
4answers
10k views

How to apply verification and validation on the following example

I have been following verification and validation questions here with my colleagues, yet we are unable to see the slight differences, probably caused by language barrier in technical English. An ...
1
vote
1answer
174 views

Testing an MMO server

I'm working on a server for a very large (feature wise) MMO. After some bad experiences with breaking changes that caused bugs weeks down the line, we'd like to add unit/automated/regression tests to ...
0
votes
2answers
89 views

SOAP message testing

I am working in Scala/Java. I'm testing the messaging infrastructure of a part of my system that I did several years ago with CXF and Java. More specifically, I'm re-writing the specification of the ...
2
votes
3answers
155 views

How important is automated testing in rapid release, non-critical (web) apps?

I think I understand the theoretical benefits of automated testing, especially unit testing. However, I'm not sure what the optimal amount of testing is when the project is a non-critical, rapidly ...
0
votes
4answers
140 views

Should each method have a seperate JUnit test class?

I am writing JUnit unit tests for my classes. Is it better to have a separate class for each method, or have just one test class for every actual class?
4
votes
3answers
216 views

What is the best use case for selenium?

I've been trying to develop web applications while at the same time creating the testing. I understand unit testing, I can declare a test method and test specific methods in my application. But I ...
1
vote
1answer
192 views

Which is the more testable C function implementation?

I write code in C. I have been striving to write more testable code but I am a little confused on deciding between writing pure functions that are really good for testing but require smaller functions ...
3
votes
4answers
178 views

How to identify and run the most relevant automated tests?

Suppose you have a reasonably large codebase (0.5 - 1 msloc) with a large test-suite (6-7hr single-threaded runtime; with a mix of unit-tests and integration-tests built with different tools). You ...
2
votes
1answer
516 views

Using JMeter with a utility that does not support proxies

Currently I'm checking some client and server software and I wish to expand the testing coverage for it. Specifically I want to increase the quality of the load and stress testing that is performed so ...
16
votes
7answers
2k views

Are testers considered low profile? [closed]

I happened to know some system admin and according to him, testing guys are not given preferences in an organization in comparison to developers. No doubt software releases are not possible without ...
17
votes
3answers
364 views

How to test and optimize when you can't reproduce the environment?

In the past, I've worked in a variety of environments. Desktop apps, games, embedded stuff, web services, command line jobs, web sites, database reporting, and so on. All of these environments shared ...
4
votes
1answer
119 views

How can I test a search engine for an uncommon human language?

We are writing a search engine from scratch in a quite uncommon language, Aramaic, mostly for learning purposes but also because few resources are available in given language. The engine is/will be ...
18
votes
4answers
5k views

What is the correct way to handle debug output in Java?

As my current Java projects grow bigger and bigger, I feel a likewise growing need to insert debug output in several points of my code. To enable or disable this feature appropriately, depending on ...
10
votes
3answers
605 views

Questions for a peer code review

I am in the process of creating a short check-list for peer code reviews. So far I have come up with the following... Is there a unit test? Is there a integration test? Do you understand the code ...
3
votes
7answers
569 views

Why don't I see many unit test projects that bring up and tear down a DB? (ASP.NET MVC)

I see all the examples that demonstrate unit testing code and mocking the calls to the DB since you are not suppose to touch the DB. But it seems to me having a set up tasks that uses the actually ...
3
votes
1answer
85 views

Testing gap between unit and integration: Integration in the Small, Component, Unit Integration Tests

Over the past few weeks I've been mulling and researching how to fill a gap in our testing methodology. In simplified terms unit tests are too small and traditional integration tests are too big. A ...
-1
votes
1answer
197 views

What is a UNiversal IT Test (UNITT) and how do I prepare for one?

I will be taking an advanced PHP UNiversal IT Test (UNITT) for a position I am applying for. However, I am unfamiliar with the term 'unitt test'. What is a unitt test and how would a company ...
6
votes
1answer
227 views

Suggested method for extracting a standalone C library from an existing R package?

My group has been developing an R package to simulate plant growth (see GitHub repository). The R package uses .Call to interface with C. We have decided that it would be worthwhile to create a ...
-3
votes
1answer
71 views

How does the experience of any tester count? [closed]

A developer learns a lot of stuffs at work. For eg. Lets think of a Java or C++ developer, as years pass by he learns a lot about the technology, design patterns, new frameworks and etc ... This I ...
12
votes
7answers
522 views

Coding and testing in the same sprint

How is testing handled within the same sprint as coding, if all or most of the coding is not done until the end of the sprint? (I'm referring to the "soup-to-nuts" development and testing of a single ...
0
votes
0answers
30 views

How to test for performance or locking issues of sharing a database with another app

I have a typical Spring/Hibernate Tomcat webapp that has a user_info table. I’m trying to create another webapp that will do CRUD actions on the user_info table. I'm considering sharing the same ...
1
vote
0answers
45 views

Should I have different automated Selenium tests for different screen resolutions?

A website I'm creating is going to have three breakpoints: desktop, tablet landscape, mobile. Should I write a test for each resolution?