Data are values of qualitative or quantitative variables, belonging to a set of items. Data in computing (or data processing) are represented in a structure, often tabular (represented by rows and columns), a tree (a set of nodes with parent-children relationship) or a graph structure (a set of ...

learn more… | top users | synonyms

0
votes
1answer
57 views

Looking for a certain datatype if it exists

I'm looking for the kind of a certain datatypes. The main idea of this datatype is to describe a productionline containing several steps. Each step should be represented as a "vertex" containing an ...
4
votes
1answer
47 views

Deleting Content from Service [closed]

I'm not quite sure what the real practice is in the programming community. But when a user deletes content from your service (ie. deleting a status update, a photo of theirs, a comment they made). ...
0
votes
1answer
17 views

Place measurement data in database (access)

In a software I use records of measurement data. Each record contains basic information like a name, some parameters and the actual measurement data in the form of three arrays of double values that ...
4
votes
1answer
288 views

Should reflection be part of design?

I'm currently designing a somewhat large program that will involve the simulation of math/physics models and collection of data (I have not implemented any code yet). One of the main problems I'm ...
0
votes
1answer
48 views

scipy.stats.percentileofscore() wrong?

i'm a data scientist and python noob, but I seem to have found a bug with scipy.stats.percentileofscore. it may be "by design" but please bear with me. if you have an array, you will get an upper ...
2
votes
3answers
134 views

Building presentation layer directly on data layer

My application is currently quite a mess and I'm trying to untangle it all. My current idea is that I should have 3 separate layers: data layer that knows how to keep stuff in database (and handle ...
0
votes
0answers
27 views

Filling in gaps in time interval data (python) [migrated]

I have a program (written by a friend) which takes an input file (attached) and breaks up the time into 100ms intervals and cuts off at the sentence duration time. The problem is, there are gaps in ...
3
votes
2answers
165 views

What is a scalable and practical way to search existence of a group of strings in a huge file

Context: I built an app which generates around 1000 domain names based on user input. I need to check if they are available or not by matching against a huge zone file of parsed domain names which is ...
0
votes
0answers
26 views

modelling data / UI models in relation with the Data Layer

I have a user interface in Asp.Net MVC, which would for example need to load a list of products to show. Let us assume this calls ProductRepository.GetProducts() . In the data layer, I have a class ...
0
votes
1answer
39 views

Test Data in a Distributed System

A question that has been vexing me lately has been about how to effectively test (end-to-end) features in a distributed system. Particuarly, how to effectively manage (through time) test data for ...
0
votes
0answers
24 views

What data should QR-Code contain to serve both my own and external QR-Code reader

My webapplication uses codes (in form of http://www.url.com/code/105820582020204), that I want to encode as QR-Code. I assume that such generated QR-Code will be scanned by both people using my mobile ...
4
votes
3answers
214 views

Big Data: Can it be pre-processed?

My question is about "big data". Basically, big data involves the analysis of a large amount of data to make meaningful insights from it. I would like to know: Whether or not large amounts of data ...
0
votes
2answers
73 views

Data sharing across processes [closed]

I have a C# .NET app that downloads a users Tweets using LinqToTwitter. This is for TV broadcast - the client wants to show Tweets on air. We have two other apps that need to access these tweets. One ...
0
votes
1answer
48 views

Using MVC strictly with DAAB?

I am the only one at my company that is familiar with MVC and they are getting more pressure to modernize and switch to MVC for future projects, so I was tasked to create a template to use as a base ...
0
votes
0answers
13 views

Article about “painting” coorelation between complex data [closed]

I am trying to get an understanding of quite a big data set. I have 20 different inputs parameters and 10 different outputs. The control algorithm is made and seems to work, but now I need to ...
3
votes
1answer
76 views

Algorithm that determines relevant attributes in ordered list

Suppose I have a list of objects sorted by a person based on that person's subjective taste. Let's assume that this person is being somewhat consistent in their sorting and that there are quantifiable ...
0
votes
1answer
161 views

Design pattern for configuring objects

Context In a Cocoa application I am developing, I need to load a data model that is defined in plist files. So, I have something like: root (Array) ---- item (Dictionary) -------- name : "objects" ...
1
vote
1answer
182 views

Is it ethical or even legal to track user data/metrics using IP [closed]

This one is a bit tough. It is publicly available information, is it not? But it's can also be used maliciously. So is it legal/ethical to store and/or gather information on users based on IP? It's ...
1
vote
3answers
101 views

Starting with BI / Data Analysis [closed]

We have a bunch of data about our customers and we'd like to learn more about it. Writing queries to pull data out is not a problem, and we're doing that right now, but we'd like to take it to the ...
1
vote
4answers
299 views

Data duplication vs Encapsulating. Which design to use?

The problem that I face is how to combine encapsulating and optimal memory use. I can't show you my code and therefore explain it on extensive (I hope) example. Let's say we need to have a database ...
0
votes
0answers
67 views

Searching in a large dataset

I am working on a model of social interactions in mice. I have mice and boxes and a simulation that outputs which mouse stays in which box during which time period. The problem is how to obtain, in ...
5
votes
1answer
122 views

Version control and data provenance in charts, slides, and marketing materials that derive from code ouput

I develop as part of a small team that mostly does research and statistics stuff. But from the output of our code, other teams often create promotional materials, slides, presentations, etc. We run ...
2
votes
1answer
499 views

AngularJS dealing with large data sets (Strategy)

I am working on developing a personal temperature logging viewer based on my rasppi curl'ing data into my web server's api. Temperatures are taken every 2 seconds and I can have several temperature ...
0
votes
2answers
69 views

Cleaning a dataset of song data - what sort of problem is this?

I have a set of data about songs. Each entry is a line of text which includes the artist name, song title, and some extra text. Some entries are only "extra text". My goal is to resolve as many ...
-2
votes
1answer
60 views

Turning a problem into a data

OK, I have an app that I'm creating but I'm just really not sure about how to approach the problem. The idea is fairly simple. I'm just not sure how to wrap it in a data model (or even if I should). ...
0
votes
2answers
169 views

Perfomance of 8 bit operations on 64 bit architechture

I am usually a Python / Database programmer, and I am considering using C for a problem. I have a set of sequences, 8 characters long with 4 possible characters. My problem involves combining sets of ...
2
votes
1answer
335 views

Is there a situation where DataSet is better than using EF? [closed]

We are starting to develop web application for our client. Though I am not convinced, we are going to use DataSet as our data access. One of the reason is that most of the team members have experience ...
4
votes
2answers
244 views

Deduplication of complex records / Similarity Detection

I'm working on a project that involves records with fairly large numbers of fields (~15-20) and I'm trying to figure out a good way to implement deduplication. Essentially the records are people along ...
1
vote
1answer
139 views

Consolidating hotels data from various booking sites with different IDs or reference

In one of my projects, I have data for hotels, and other booking sites are able to book this hotel. For example: Hotel A - Booking (ID = 4002), Expedia (ID = 123), Priceline (ID = 147) The three ...
0
votes
0answers
35 views

Program design with multiple data sets, algorithms and results [duplicate]

I have a question regarding the design of my software. The question has already been posted by me at ...
1
vote
3answers
226 views

Program design with multiple data sets, algorithms and results

I have a question regarding the design of my software. There are four different data sets and three consecutive algorithms operating on the data sets and on the results from the previous algorithm ...
2
votes
1answer
324 views

Storing graphs with json and db

I have a Rails 4 app having to do with graphs. These graphs need to be stored and I'm not sure of the best way to do it. Firstly, the app has a SQLite db in development and PostgreSQL in production. I ...
5
votes
2answers
1k views

Data Synchronization in mobile apps - multiple devices, multiple users

I'm looking into building my first mobile app. One of the core features of the application is that multiple devices/users will have access to the same data -- and all of them will have CRUD rights. I ...
0
votes
1answer
184 views

Version-control friendly, append-only file format: “binary” or “text”?

I'm designing an append-only ("journaled") file format, and I'd like it to be friendly towards being stored in VCS (git/Mercurial/...). On one hand, I'd like if after each change, only delta ...
0
votes
0answers
119 views

why are safearray structures seen differently in visual basic.net then c++? (interop)

I seem to see some components on the web that still use com and require a safe array of variants. It seems from research that sometimes object in vb.net does not cut it (I currently have a com library ...
4
votes
5answers
352 views

Should I encrypt files saved by my program

I'm trying to decide on what format I should save data in, and hopefully this question will help me come to a decision. The program I'm writing uses 'databases' in which word=meaning (not a ...
2
votes
2answers
190 views

Why do CSV file formats normally use quoting instead of escaping?

There are a lot of variants of the CSV "standard" (or lack thereof). I've never personally see any that use an escape character (like \) instead of surrounding each field with double quotes. Instead ...
1
vote
1answer
177 views

Best approach for near real time message passing from server to client across router?

I am developing an application which must run on up to thousands of client systems that I control (Linux) which are connected behind common NAT devices to public Internet. Each of these client ...
2
votes
3answers
213 views

Storing data in 2 different systems/database structures

My company is an online retailer, and we use an homebrew ecommerce platform. In the last year or so, we've partnered with a accounting software vendor, as our homebrew solution was unable to produce ...
1
vote
1answer
102 views

Are there any standard for exchanging rules rather than data?

Just out of curiosity. There are many open standards for data exchange, as well as standards for exchanging code (jsonp, for example). But are there any standards for exchanging formulas/rules, for ...
1
vote
2answers
404 views

Radix exchange sort implementation?

I need a little help understanding the implementation of radix exchange sort algorithm. Radix exchange (I don't know if it's the exact name in english based literature) is a lot similar to quicksort, ...
0
votes
0answers
31 views

What stack can handle some data preprocessing and output in ARFF format?

I used to do my preprocessing of data in Python, loading CSV or other things and constructing a specific program for each problem I had to address where an output in a ARFF format was needed. Of ...
1
vote
1answer
884 views

Dataset with coordinates of borders of countries

I am creating an application that visually displays world regions, e.g. to place markers within an administrative region. Does a dataset exist with geometrical or geographical (long/lat) descriptions ...
2
votes
1answer
1k views

Why retrieves a native app data faster than one with PhoneGap?

I know that an app developed with PhoneGap is slower than a native one because at PhoneGap the whole code must be interpreted at runtime into a native one. But could someone explain or has a good ...
1
vote
0answers
173 views

Single write, multiple read of stateful objects

Scenario: One data input feed (call this Source) Multiple objects (call these Layer1) read this Source, and analyze the feed. This analysis is stateful. Layer1 objects have configuration parameters. ...
0
votes
1answer
129 views

The best approach to building a mobile service that's also available when the connection drops?

Hopefully this question will be a good suit for P.SE since it is a whiteboard-level 'how can this be done' conceptual question. I'm trying to build a product that needs to be available to someone on ...
0
votes
0answers
107 views

Matching two lists of data with different conventions

I have two lists of data, A and B. These lists are themselves aggregated from multiple sources, and contain typos, abbreviations not found in the other, and also lack a 1-1 mapping, but will never ...
2
votes
2answers
107 views

Looking for session/event analytics analysis tool [closed]

I have data that is basically made up of a set of sessions filled with events. For example: Session1 - [Event1] [Event2] [Event3]...[Event64] Session2 - [Event1] [Event3] [Event4]...[Event64] The ...
-1
votes
1answer
343 views

Data aggregation like polyvore.com [closed]

I'm creating a website that is going to aggregate women shoes from across the web into one website. Kinda like polyvore.com does with all their products but mine is only going to be shoes. Which ...
0
votes
2answers
386 views

Design pattern for data privileges

I'm designing a financial system that should grant access to data based on roles and privileges. For example, a manager can see the financial transaction of users under his domain but not information ...