# Tagged Questions

The tag has no usage guidance.

18 views

### Library for finding rules (based upon correlations) between columns in a database

I have a database table with 100.000 rows. One column contains transaction texts from bank statements like: "Paid Google Adwords for July invoice 4343434" while another one contains a manual ...
58 views

### Estimate if benchmark sampling difference is significative

In order to estimate the fastest function in various cases in a non fully deterministic context, I'm running an experiment calling one or the other at random and recording the duration of the ...
36 views

### Alternative to Wilson Score when I only have the number of ratings and the average rating?

I'm getting a list of items from an external API and each item has a number of ratings and an average rating out of 5. What is the best way to rank them? Is it statistically sound to just convert an ...
162 views

### Algorithm for predicting outcome based on parameters

I've never done anything with statistics, so I'm unsure of how to start with this problem that I need to solve for some software that I'm working on. Basically, there are three parameters An ...
117 views

### Estimating in groups - How to extract useful statistics / estimates?

As many other projects we have to estimate our jira tasks up front. This is obviously not fun and I've started hacking on a simple webapp to "gameify" this tedious process. My idea is that an issue ...
234 views

### Oscillations detector: how to effectively detect oscillations of a variable?

I monitor a variable in real-time where new value is generated every 1/25 second. Depending on the conditions, this variable may either be stable, i.e. fluctuate a little (+/-1%) around some value (...
235 views

### Simplifying Some Probabilistic If-Then Spaghetti Code

I've got a fairly substantial code base that I'm trying to simplify. One section in particular deals with probabilistically creating objects. It currently uses hundreds of random number generator ...
90 views

### Advantage of non-deterministic staistical analysis?

I am working with a Java Library used for identifying the language of a given text. It relies on an n-gram analysis of the text to return a set of languages it might be and the "confidence" that it ...
125 views

### When designing a replacement application, how can I compare its performance to the original, if there are no existing statistics?

I don't believe there are any performance statistics kept for the application I'm being asked to replace, and don't want to ask the individuals doing the work to manually record things like how long ...
272 views

### PHP MySql - Statistical Reporting - Best Approach to query appointment system time utilization

I have built an appointments system for various medical practices. Practice schedule appointments - I am looking to provide analysis on the amount of time that has been utilised by the practice. I ...
115 views

### Does it make sense to express reliability as a ratio of number of tests and system failures? [closed]

I have seen a reliability of the system expressed like this: Rel=No of tests executed / Sum of crashes or other critical events Does it make sense and what actually is the output?
177 views

### Permutation tests for large sequences

I would like to perform a permutation test on a particularly large data set, i.e. around 4 million entries. Basically, I need to get some number of random permutations of this data set. Usual way to ...
408 views

### Count unique visitors by group of visited places

I'm facing the problem of counting the unique visitors of groups of places. Here is the situation: I have visitors that can visit places. For example, that can be internet users visiting web pages, ...
988 views

### Word recognition in a string without spaces or punctuation marks

I have a small C# project that reads a file and gives me an output: a string that does not contain spaces nor any types of punctuation marks. It may also contain a few misspellings. Ex. Output: ...
154 views

### Is it possible to get probabilities from a support vector machine?

From what I understand, SVM's take a discrete number of x and y values from which to learn from, then when given new x values map it to one y value (category). Is it possible to use SVM's or something ...
238 views

### scipy.stats.percentileofscore() wrong?

i'm a data scientist and python noob, but I seem to have found a bug with scipy.stats.percentileofscore. it may be "by design" but please bear with me. if you have an array, you will get an upper ...
142 views

### How do I mutate a value in a genetic algorithm using Gaussian distribution?

I've been reading 'Introduction to Evolutionary Algorithms'. This method is stated, but not described, and I can't find anything more specific online. p44/45 of 2nd Ed for reference. adding to the ...
290 views

### Unit Testing with an Optimization Problem

Suppose I'm making an algorithm that identifies the subject of a picture. It could be anything that a computer doesn't do that well, but I'm not expecting to get the right answer every time - 80% is ...
88 views

### Even distribution through a chain of resources

I'm working on an algorithm which routes tasks through a chain of distributed resources based on a hash (or random number). For example, say you have 10 gateways into a service which distribute tasks ...
278 views

### How to do inference in a card game?

In the game there are 5 players, each with 8 cards in hand. No other card is present. Using Monte Carlo (MCTS) I run many simulations of the game from the current state to the end of the match. In ...
249 views

### Algorithm for generating hyperexponential distribution

I need to generate a hyperexponential distribution for my project. I have already implemented a poisson generating algorithm given by Donald Knuth, but I couldn't find an algorithm for generating a ...
390 views

### Algorithm, AI, or intelligent agent suggestions for ingesting poorly-formatted & variable data from different document types

Thanks for looking! Background I have been tasked with writing a program to normalize and ingest data from various sources to a common database. For the sake of simplicity, let's say that the ...
623 views

### Statistics collection engine for C++ systems

We have a research project with idea->prototype->statistics development cycle. Anyway, our final product is a prototype, so the statistics collection suite is not used persistently. Supposing I have ...
146 views

### Randomness of wrapped RNG

There are plenty of questions around regarding random number generation, but I couldn't find anything that exactly matched my question. Apologies if I missed one. Most random number generators in ...
340 views

### Is code that terminates on a random condition guaranteed to terminate?

If I had a code which terminated based on if a random number generator returned a result (as follows), would it be 100% certain that the code would terminate if it was allowed to run forever. while (...
103 views

### Statistical Software Quality Control References

I'm looking for references about hypothesis testing in software management. For example, we might wonder whether "crunch time" leads to an increase in defect rate - this is a surprisingly difficult ...
94 views

### How would I go about measuring the impact an article has on the internet?

For an application of mine, I analyze the sentiment of articles, using NLTK, to display sentiment trends. But right now all articles weigh the same amount. This does not show a very accurate picture ...
478 views

### statistics for checking imported data?

I'm working on a data migration of several hundred nodes from a Drupal 6 to a Drupal 7 site. I've got the data exported to the new site and I want to check it. Harkening back to my statistics classes, ...
1k views

### Get system info from C program?

I'm writing a little program in C that I want to use to output some system stats to my HD44780 16x2 character display. The system I'll be working with is a Debian ARM system and, although irrelevant, ...
14k views

### Programming language trends

Are there some statistics out there that show the approx. number of users that popular programming languages have and the rate this number increases over time?
361 views

### why is a naturally ordered set generated at 9 but not 10 digits

code found at: fatal error...Java Runtime Environment: EXCEPTION_ACCESS_VIOLATION Presuming that the problem indicated above is due to the test app and not due specifically to method ...
67 views

### Testing applications with statistical features [duplicate]

Possible Duplicate: How should I test randomness? Are their some techniques described for testing applications that have as a requirement some statistical or probabilistic features? They may ...
583 views

### Impact of Website Redesign on Google Analytics

I just finished a redesign for a website that is currently using Google Analytics. I want to continue to use Google Analytics, but I'm not sure if I should create a new profile for the new site or ...
7k views

### Google Analytics with multiple environments

We are planning to use Google Analytics in our organization and I am in charge for setting it up. I was wondering how to deal with multiple environments. We sure do not want to collect data during ...
334 views

### Calculate statistics for web application

I'm planning to add a couple of usage statistics to my web application. Some common things like: registered users, amount of comments/posts, etc. over time (last 24 hours / last week / last month / ...
15k views

### Where can I get a diverse set of sample text? [closed]

I am trying to gather statistics on character or word sequences used in the English language for use in a software project. Where can I can get a large amount (several GB would be nice) of English ...
206 views

### Google Analytics and customers privacy

I work in a company that sells SaaS web applications for HR and financial issues. Our customers are key accounts to which we guarantee the privacy of their data, for obvious reasons. We need to make ...
650 views

### What kind of metrics should I collect for a website/web app

I have a website that allows users to register for accounts, login, and renew an annual membership fee. They can also update their personal profile, their personal profile, look at a list of their ...
1k views

### Are 70% of programs/business applications/something based in COBOL? [closed]

I heard this number and a quick google search reveals a whole lot of touting this number and absolutely zero data (honestly most articles promoting COBOL read like 95% propoganda). Perhaps it's true ...
304 views

### Incanter for real world statistical projects [closed]

I'm interested in statistical computing. R is a leader platform obviously but what about Incanter? Incanter is at the top of my list since I'm a Clojure and JVM guy. Do you have any real world ...
2k views

### distribution of programming languages in embedded systems

I am looking for statistics concerning the distribution of programming languages in the embedded sector. Do you know any good websites, articles or books? I found this as a first reference but am ...
941 views

### Learning the rules of chess

A similar question asks whether a computer can learn to play optimally in chess by analyzing thousands of games. If a machine can look at the state of the board for a few games of chess (or a few ...
2k views

### Debugging Facts and Statistics [closed]

I'm trying to find a research answering a question: "How much time developers spend on development vs debugging?". I found several interesting links on the Net but they are little too old. This 2002 ...
1k views

### How did they count the number of lines of code executed at runtime?

There was a PC game released in 2001 called Black & White by Lionhead studios in which there was a lengthy statistics page which updated in real-time. There were stats such as how many people ...
871 views

### Design: Object method vs separate class's method which takes Object as parameter?

For example, is it better to do: Pdf pdf = new Pdf(); pdf.Print(); or: Pdf pdf = new Pdf(); PdfPrinter printer = new PdfPrinter(); printer.Print(pdf); Another example: Country m = new Country("...
1k views

### How important would a statistics course be to a software developer? [closed]

How important would a statistics course be to a software developer? More specifically given the description: 2510 Statistics for Physical Science Students (F) & (W) examines elements of ...
1k views

### Where is this from (originally)?: “80% of the lifetime cost of a piece of software goes to maintenance” [closed]

In the Sun Java coding conventions document (here: http://www.oracle.com/technetwork/java/codeconv-138413.html), it states: "80% of the lifetime cost of a piece of software goes to maintenance" Does ...
178 views

### When profiling a function for time use, what information is desirable?

I'm writing a program similar to Python's timeit module. The idea is to time a function by executing it anywhere from 10 to 100,000 times depending on how long it takes and then report results. I've ...