Data are values of qualitative or quantitative variables, belonging to a set of items. Data in computing (or data processing) are represented in a structure, often tabular (represented by rows and columns), a tree (a set of nodes with parent-children relationship) or a graph structure (a set of ...

learn more… | top users | synonyms

0
votes
2answers
3k views

Passing the data of a certain page to another page. Windows Phone 7

The user will fill out information in page 1, and the data will be seen in the other page listed in a listbox. Is it advisable to use data binding? I've been studying/researching about data binding ...
4
votes
1answer
340 views

Data service API design

We're designing a data service that will store a large number of statistics about stocks, including historical data. The client will be a web application, which will need to pull various bits of data ...
1
vote
1answer
300 views

Developing an analytics's system processing large amounts of data - where to start

Imagine you're writing some sort of Web Analytics system - you're recording raw page hits along with some extra things like tagging cookies etc and then producing stats such as Which pages got most ...
2
votes
2answers
121 views

What is the best strategy for transforming unicode strings into filenames?

I have a bunch (thousands) of resources in an RDF/XML file. I am writing a certain subset of the resources to files -- one file for each, and I'm using the resource's title property as the file name. ...
1
vote
1answer
457 views

Countour Mapping API

I have done some searching on Google, but haven't come up with much as of yet. I am wanting to take a set of point data, which I had previously been using to create weighted points for a heat map ...
9
votes
5answers
13k views

Getting data from a webpage in a stable and efficient way

Recently I've learned that using a regex to parse the HTML of a website to get the data you need isn't the best course of action. So my question is simple: What then, is the best / most efficient and ...
1
vote
2answers
454 views

Almost Realtime Data and Web application

I have a computer that is recording 100 different data points into an OPC server. I've written a simple OPC client that can read all of this data. I have a front-end website on a different network ...
0
votes
3answers
298 views

From where do financial firms obtain the stock data to analyze [closed]

I've been thinking about the subject and I've always wondered, from where do they obtain the data that is analized in applications, I've looked at Nasdaq's website and they do not seem to have any ...
0
votes
2answers
233 views

What companies hire data scientists? [closed]

What kind of data jobs are there in the software industry for someone with a B.S. in pure mathematics and a minor in statistics but with little experience in programming? I want to work on the data ...
0
votes
1answer
413 views

How to get a list of valid addresses?

I need to get a list of valid addresses in 4 or 5 clusters (cities) in both the UK and US. It's to generate sample data for an application that will do geolocation and searching. At the moment I'm ...
22
votes
6answers
10k views

Why the static data members have to be defined outside the class separately in C++ (unlike Java)?

class A { static int foo () {} // ok static int x; // <--- needed to be defined separately in .cpp file }; I don't see a need of having A::x defined separately in a .cpp file (or same file ...
2
votes
4answers
218 views

Data migration to a single shared SQL table

We have three internal web applications we use at my company. Unfortunately none of my predecessors had the foresight of sharing tables amongst those apps. It has become necessary to share some ...
2
votes
4answers
1k views

Data Structures usage and motivational aspects

For long student life I was always wondering why there are so many of them yet there seems to be lack of usage at all in many of them. The opinion didn't really change when I got a job. We have ...
2
votes
1answer
138 views

Ensure data entered by users adjusts to what actually is

This is more of a usability issue I'd say, looking of suggestions on it. I have a system that depends on the data entered by the users to be correct, as in the address exists, the name is correct, ...
1
vote
1answer
138 views

Approach for housekeeping production data

If you are going write a set of program to housekeep the production data, how can you ensure your program will work correctly? We cannot housekeep the data based on their creation time. We would ...
2
votes
2answers
430 views

How to handle encryption key conflicts when synchronizing data?

Assume that there is data that gets synchronized between several devices. The data is protected with a symmetric encryption algorithm and a key. The key is stored on each device and encrypted with a ...
3
votes
3answers
297 views

Designing access to file-based “database”

It happened frequently that I have to provide access to a bunch of files organized in a directory tree according to some (sometimes loosely specified) rules. My standard pattern is to provide a ...
3
votes
2answers
264 views

Getting and maintaining data from a large number of sources on the web

For the sake of an exercice I want to aggregate price listings with prices coming from a series of web sites in a structured form (XML, JSON...). If I have control on both sides how can I go about ...
3
votes
3answers
412 views

Where can I locate business data to use in my application?

This question talks about any and all free public raw data which appeared to have valuable pieces but nothing that really provides what I am looking for. Instead of using a socially defined listing ...
8
votes
3answers
2k views

How do Data Scientists Use Python? [closed]

Do you know how Data Scientists use Python and if it requires data, where I can get sample data to practice with? I'm currently learning the language and plan on applying for Data Scientists jobs, so ...
5
votes
1answer
192 views

What are graph datastores better at doing than other datastores and why?

Where previously there was only relational databases, the data store world is now rife with options like Key-Value, Document, and Graph datastores. Unfortunately, every datastore likes to show how it ...
40
votes
12answers
3k views

Is there an alternative to bits?

Is there an alternative to bits as the smallest unit of data? Something that won't be only 0 or 1, but actually hold many possible states in between? Wouldn't it be more natural to store floats like ...
0
votes
2answers
165 views

Optimal storage space calculation for name, address, phone, fax and email data

Given the following assumptions: The amount of available data storage is highly limited All data is international As much storage as possible must be preserved since it will be used for something ...
19
votes
1answer
359 views

How should HTML data formats be applied in everyday situations?

Given Google's shift towards a stronger focus on page markup data, how do the data formats used in Schema.org work alongside those for Microformats? How do these (and other specs) compliment each ...
3
votes
3answers
2k views

Where can I find a large dataset of tweets?

I'm trying some machine learning with Twitter, and I was wondering if there were any pre-collected just massive tweet data that anyone knew about before I went and just used the API (which has a ...
2
votes
1answer
191 views

How do you define, organize, and document your data?

Please feel free to suggest a better name or way of explaining this question - I wasn't quite sure what to call it. The situation is one that may just come under the heading of "be organized" but I ...
1
vote
1answer
355 views

How much data validation is too much? [duplicate]

Possible Duplicate: Data input validation - Where? How much? I'm a new PHP developer and am into Powershell quite a bit but this question is language agnostic. I've been questioning my code ...
3
votes
2answers
140 views

Design review for application facing memory issues

I apologise in advance for the length of this post, but I want to paint an accurate picture of the problems my app is facing and then pose some questions below; I am trying to address some self ...
3
votes
1answer
193 views

Programming to ANSI standards (for engineering)

I am currently tasked to write a software to help engineers design standard compliant designs. If there is a bad design, software will report an error or warning. Maybe it's just me, but anyone who ...
7
votes
3answers
250 views

Are there best practices for checking for errors in business logic for DB refreshes? [closed]

I'm working for a company with very large databases which all refresh overnight, ready for users to interrogate in the morning. These over night loads essentially truncate all the tables, and reload ...
0
votes
2answers
212 views

Data acquisition, storage and management

I have a device that can measure different values over time, one sample per second. After one measurement run I can export the data in form of a CSV-file. One row per second with timestamp and about ...
17
votes
7answers
3k views

Why does Garbage Collection only sweep the heap?

Basically, I've learned so far that garbage collection erases forever any data structure that is not currently being pointed to. But this only checks the heap for such conditions. Why doesn't it also ...
4
votes
4answers
403 views

Randomly Accessing Data Packets in a Compressed File

In my line of work I deal with very large files, hundreds of Gigabytes in size. The nature of the data in these files is such that compression would greatly reduce their size. The problem is, the ...
1
vote
2answers
180 views

Tdd on a datadriven webapp

How would one go about to use tdd/bdd on a mostly data driven webapp? For example a blog or a forum?
0
votes
4answers
201 views

What is ideal range (Min and Max date) for Calendar backup?

I need to take backup of calendar on my phone. We have requirement that we need to take backup of entire calendar data. Now, phone always supports recurring events. So, event may exist from 01-01-1601 ...
3
votes
4answers
221 views

Reading Java book — I'm confused on this explanation of the difference between information and data?

From "Demystifying Java".. For many of us, the terms information and data are synonymous. However, information and data are distinctly different in programming. Data is the smallest amount of ...
8
votes
3answers
323 views

Data “unsort” / homogeneity algorithm

In an attempt to not reinvent a wheel, I'm asking if anyone has ideas on a data homogeneity algorithm. A brief example: My data has several elements maybe like Number Color Fruit Letter There ...
2
votes
6answers
1k views

what is the benefit of using key/value stores with respect to database sharding?

What has key/value stores got to do with making database sharding easier? Because if I do not use a key/value store, I can easily shard my database too right? (Like say, I can easily say users with ...
4
votes
2answers
309 views

A Question about using different data access layers for different database providers

I have a question about whether we should use different Data access layers for different database providers like SQL Server, MySQL Server, Oracle etc.. Is it not better to use a single data access ...
1
vote
4answers
234 views

how to create a data model for the following problem

How to tackle 2-D and 3-D space in data ? lets say you are working on a power grid problem. You need to represent Towers; transmission lines; transformers and every thing else in a 2-D space. How ...
19
votes
5answers
3k views

Data input validation - Where? How much? [closed]

Data input validation always was quite an internal struggle to me. On the verge of adding a real security framework and code to our legacy application rewrite project (which so far pretty much keeps ...
1
vote
2answers
130 views

Path of Replication

I'm currently developing a replication system to keep data in-synch between an arbitrary number of servers. Some of these servers exist in one cluster on one LAN. Others exist somewhere else in the ...
5
votes
3answers
913 views

How to do data synchronisation between two applications?

Our client has a CRM application (let's call it A) and a custom built Windows application (VB.NET) (let's call it B) that directly writes to and reads from the CRM database. Application A is used ...
7
votes
1answer
348 views

Does current evidence support the adoption of Contextual over Canonical Data Models?

The "canonical" idea is pervasive in software; patterns like Canonical Model, Canonical Schema, Canonical Data Model and so on, seem to come up again and again in development. Like many developers, ...
6
votes
5answers
1k views

How to decide between storage formats and what are example use cases for some of them?

We have different ways to store program data (save files in games, employee databases, program configuration etc.): Plain text (think .ini and .conf) XML Databases (MySQL, SQLite...) .zip and ...
2
votes
2answers
234 views

Server requests optimisation - size vs frequency

my map-like app loads data from google map API but it also loads some extra data - in the form of XML - from my server. When the app loads it really needs only small amount of data to cover the ...
5
votes
2answers
253 views

How to ensure data integrity (when an external system is involved)

Say you have this task in an application that consists of two parts: 1) Delivery of a file to an external system (not in your control) 2) A database transaction in our system, with information about ...
2
votes
3answers
237 views

Starter BOOKS On Data Analytics and Algorithms in Computer Science

Am Programmer cum Co-Founder of Start-up,Am a computer Science Graduate though am not good at Algorithms,I want to learn and sharp that side.Please suggest me some nice books for starters and Advance ...
13
votes
3answers
6k views

Is there a list of common usernames to reserve in a new system?

I need to reserve usernames in my new website. These generally fall into three categories 1) usernames no-one should have (eg: admin, user, service, help, root, etc) 2) names of super famous people ...
5
votes
2answers
99 views

Resources on how to relate structured and semi- / un-structured information

I don't have a great background in information organisation / retrieval, but I know of a few ways of dealing with the problem. For structured information, it's possible to go OOish - everything ...