Data are values of qualitative or quantitative variables, belonging to a set of items. Data in computing (or data processing) are represented in a structure, often tabular (represented by rows and columns), a tree (a set of nodes with parent-children relationship) or a graph structure (a set of ...

learn more… | top users | synonyms

3
votes
2answers
142 views

Design review for application facing memory issues

I apologise in advance for the length of this post, but I want to paint an accurate picture of the problems my app is facing and then pose some questions below; I am trying to address some self ...
3
votes
1answer
194 views

Programming to ANSI standards (for engineering)

I am currently tasked to write a software to help engineers design standard compliant designs. If there is a bad design, software will report an error or warning. Maybe it's just me, but anyone who ...
7
votes
3answers
269 views

Are there best practices for checking for errors in business logic for DB refreshes? [closed]

I'm working for a company with very large databases which all refresh overnight, ready for users to interrogate in the morning. These over night loads essentially truncate all the tables, and reload ...
0
votes
2answers
256 views

Data acquisition, storage and management

I have a device that can measure different values over time, one sample per second. After one measurement run I can export the data in form of a CSV-file. One row per second with timestamp and about ...
19
votes
7answers
4k views

Why does Garbage Collection only sweep the heap?

Basically, I've learned so far that garbage collection erases forever any data structure that is not currently being pointed to. But this only checks the heap for such conditions. Why doesn't it also ...
5
votes
4answers
524 views

Randomly Accessing Data Packets in a Compressed File

In my line of work I deal with very large files, hundreds of Gigabytes in size. The nature of the data in these files is such that compression would greatly reduce their size. The problem is, the ...
1
vote
2answers
186 views

Tdd on a datadriven webapp

How would one go about to use tdd/bdd on a mostly data driven webapp? For example a blog or a forum?
0
votes
4answers
228 views

What is ideal range (Min and Max date) for Calendar backup?

I need to take backup of calendar on my phone. We have requirement that we need to take backup of entire calendar data. Now, phone always supports recurring events. So, event may exist from 01-01-1601 ...
3
votes
4answers
229 views

Reading Java book — I'm confused on this explanation of the difference between information and data?

From "Demystifying Java".. For many of us, the terms information and data are synonymous. However, information and data are distinctly different in programming. Data is the smallest amount of ...
8
votes
3answers
344 views

Data “unsort” / homogeneity algorithm

In an attempt to not reinvent a wheel, I'm asking if anyone has ideas on a data homogeneity algorithm. A brief example: My data has several elements maybe like Number Color Fruit Letter There ...
2
votes
6answers
1k views

what is the benefit of using key/value stores with respect to database sharding?

What has key/value stores got to do with making database sharding easier? Because if I do not use a key/value store, I can easily shard my database too right? (Like say, I can easily say users with ...
4
votes
2answers
350 views

A Question about using different data access layers for different database providers

I have a question about whether we should use different Data access layers for different database providers like SQL Server, MySQL Server, Oracle etc.. Is it not better to use a single data access ...
1
vote
4answers
244 views

how to create a data model for the following problem

How to tackle 2-D and 3-D space in data ? lets say you are working on a power grid problem. You need to represent Towers; transmission lines; transformers and every thing else in a 2-D space. How ...
20
votes
5answers
3k views

Data input validation - Where? How much? [closed]

Data input validation always was quite an internal struggle to me. On the verge of adding a real security framework and code to our legacy application rewrite project (which so far pretty much keeps ...
1
vote
2answers
131 views

Path of Replication

I'm currently developing a replication system to keep data in-synch between an arbitrary number of servers. Some of these servers exist in one cluster on one LAN. Others exist somewhere else in the ...
6
votes
3answers
1k views

How to do data synchronisation between two applications?

Our client has a CRM application (let's call it A) and a custom built Windows application (VB.NET) (let's call it B) that directly writes to and reads from the CRM database. Application A is used ...
7
votes
1answer
393 views

Does current evidence support the adoption of Contextual over Canonical Data Models?

The "canonical" idea is pervasive in software; patterns like Canonical Model, Canonical Schema, Canonical Data Model and so on, seem to come up again and again in development. Like many developers, ...
7
votes
5answers
2k views

How to decide between storage formats and what are example use cases for some of them?

We have different ways to store program data (save files in games, employee databases, program configuration etc.): Plain text (think .ini and .conf) XML Databases (MySQL, SQLite...) .zip and ...
2
votes
2answers
286 views

Server requests optimisation - size vs frequency

my map-like app loads data from google map API but it also loads some extra data - in the form of XML - from my server. When the app loads it really needs only small amount of data to cover the ...
3
votes
1answer
375 views

Watson Information Encoding [closed]

IBM's Watson has a lot of book information encoded into a 'database' that Watson searches in real time. Does anyone know how that information is coded? It seems hard to imagine how humans could type ...
5
votes
2answers
320 views

How to ensure data integrity (when an external system is involved)

Say you have this task in an application that consists of two parts: 1) Delivery of a file to an external system (not in your control) 2) A database transaction in our system, with information about ...
2
votes
3answers
255 views

Starter BOOKS On Data Analytics and Algorithms in Computer Science

Am Programmer cum Co-Founder of Start-up,Am a computer Science Graduate though am not good at Algorithms,I want to learn and sharp that side.Please suggest me some nice books for starters and Advance ...
16
votes
3answers
8k views

Is there a list of common usernames to reserve in a new system?

I need to reserve usernames in my new website. These generally fall into three categories 1) usernames no-one should have (eg: admin, user, service, help, root, etc) 2) names of super famous people ...
5
votes
2answers
103 views

Resources on how to relate structured and semi- / un-structured information

I don't have a great background in information organisation / retrieval, but I know of a few ways of dealing with the problem. For structured information, it's possible to go OOish - everything ...
4
votes
2answers
613 views

How can large data handling be a special requirement for job?

I chanced to see some job requirements of Oracle SQL programmer or C# developer jobs, who want a person who can handle terabytes of data in ETL or data migration. I have worked on data migration to ...
1
vote
2answers
610 views

What are the most common options for data storage in desktop applications?

When I was working as a website designer/engineer I primarily used databases for storage of much of my dynamic data. It was very easy and convenient to use this method and seemed like a standard ...
8
votes
5answers
916 views

Sensitive Data Storage - Best Practices

I recently started working on a personal project where I was connecting to a database using Java. This got me thinking. I have to provide the login information for a database account on the DB server ...
3
votes
4answers
3k views

Are the only types of data “sources” static and dynamic?

Thinking that there might be others, but not sure -- but before getting into that, let me explain what I mean by static and dynamic data sources. Static (or datastore) - Meaning that the data's ...
5
votes
3answers
179 views

Why do people store shipping and handling in the order header and not a line item

I have worked on several ordering systems. Every one of them has tracked the shipping and handling as part of the order header rather then tracking it as a line item. To me, it would make more sense ...
10
votes
2answers
203 views

Should there be a “data hygiene” index for software - to indicate how clean the program is? not leaving temp files, etc

Should there be a "data hygiene" index for software - to indicate how clean the program is? not creating unused temp files, registry entries, environment variables, etc. For example, look in your ...
6
votes
4answers
443 views

Is a yobibit really a meaningful unit? [closed]

Wikipedia helpfully explains: The yobibit is a multiple of the bit, a unit of digital information storage, prefixed by the standards-based multiplier yobi (symbol Yi), a binary prefix ...