This tag is for general database questions; if you question is specific to SQL use that tag instead.

learn more… | top users | synonyms (1)

0
votes
1answer
60 views

Three-Phase Commit (3PC) question

I've been reading about 3PC in a text book, but there aren't any diagrams or examples, so I found one on wikipedia that I posted below. My question is, what does it mean by "cohorts?" There is no ...
1
vote
3answers
222 views

Pattern / methodology for representing large database records as objects

A bit of background information: We have an old database application written in Access that lets users monitor their workload, and the code is... 'procedural' might be too kind. The vast majority of ...
1
vote
0answers
46 views

Three phase commit protocol

I'm trying to understand the three phase commit protocol by reading the wiki page (http://en.wikipedia.org/wiki/Three-phase_commit_protocol#Motivation). In the description for the diagram I posted ...
-1
votes
0answers
22 views

Polyglot database architecture [on hold]

I'm currently working on my first data-centric app, and I'm wondering what the most efficient architecture is. I am wanting multiple databases; Mongo, SQL, Titan, Cassandra, and ElasticSearch. I am ...
-4
votes
0answers
28 views

Mediation Transition [on hold]

What is Mediation Transition and Data Intregration in terms of Database ? I do understand the ETL which says Extract, Transform and Load which is migration. I have a hard time figuring out the ...
12
votes
8answers
644 views

When does one hard-code actual data values into the code as opposed to using a DB?

A long-standing question for me has been: when do I store data (actual values) in a database table, and when do I store them right in the code? The untold consensus (*) has typically been as such: ...
-5
votes
0answers
29 views

Project help and advice? [closed]

I am looking for advice and help if you kindly could. I need to find a ggod set up for my project. I am working on a project. I am at beginner level in python !! I want to learn Python and refine my ...
0
votes
2answers
150 views

Database Handler and SQL injection prevention

I've written a database model class in PHP and have written a controller class that specifically validates the data before sending it to db. I'm getting criticism that I should handle the data in ...
-1
votes
1answer
68 views

SQLDatabase: Read a lot of data at once and process in memory or read the data when I need it?

I'm not sure how to approach this problem. I require a big chunk of data records from the SQL server. This chunk is based on variables, so I don't know before what records I need. I need to do a large ...
-2
votes
0answers
52 views

Architecture for “Friend of a friend 'likes' feature” [closed]

I read a few of existing posts like facebook calculate, fb db design and also some of the neo4j notes, also the pit falls of going with mongo for diaspora. I signed up into one of the diaspora pods. ...
1
vote
1answer
53 views

How can I share a managed DBConnection across various objects?

I am implementing what I thought was a simple object wrapper around a database where one object "PartRecord" represents one row of a database table. I want a client to be able to request a given ...
0
votes
0answers
18 views

searching for a user's friends

I have a rails that uses sunspot/solr for searching a number of models in our app. We are now adding a feature for searching for a user's friends. So if I look for "joe" all of my friends named ...
0
votes
1answer
318 views

Why would I use ElasticSearch if I already use a graph database?

I don't find any deep explanation on the web about a comparison between ElasticSearch and the graph databases. Both are optimized to traverse data. ElasticSearch seems to be optimized for analytics. ...
1
vote
1answer
31 views

What should the payload of a “domain event” generated through “change data capture” include?

Using domain driven design and event sourcing ... Given I have a table of 3 columns: (A, B, C) with an existing row of data: (1, 2, 3), when I update the row to contain values (1000, 2, 3) and I run ...
0
votes
1answer
39 views

OpenLDAP as tree database [closed]

I have some data which is hierarchical in nature (actually a forest) and rather big in size, although not enormous, in the order of tens of GB, or billions of nodes. This data is not going to change, ...
0
votes
3answers
87 views

Website testable design [duplicate]

I have developed two web services. The main service is a RESTful service (using DB), and another UI service that uses the RESTful service. Say I want to test the UI for now (integration tests), every ...
44
votes
13answers
3k views

Is it necessary to create a database with as few tables as possible

Should we create a database structure with a minimum number of tables? Should it be designed in a way that everything stays in one place or is it okay to have more tables? Will it in anyway affect ...
1
vote
1answer
82 views

Database choice [closed]

I am working on a system where I am replacing and existing Cobol system with C#. For the database I have hit some requirement which I am having a hard time to find complete support for (tried SQLite ...
1
vote
1answer
325 views

Organising data access for dependency injection

In our company we have a relatively long history of database backed applications, but have only just begun experimenting with dependency injection. I am looking for advice about how to convert our ...
2
votes
2answers
72 views

Communication/Updates between units of works/entity framework contexts, colliding with user changes

I'm developing a WPF application using Entity Framework for my database communication. The application has a hierarchy of tabs where each tab has a db context. Each tab allows the user to view some ...
1
vote
1answer
84 views

Representing list of polymophic objects in db

Let's suppose I have a list of derived objects from some base: class Circle : public Shape; class Rectangle : public Shape; There is object, which has vector of Shape * as member variable: class ...
2
votes
3answers
183 views

Is there a 'standard' SQL that can replace all the various custom versions?

I have been writing SQL for over 10 years now. I am extremely proficient at it and have experience working in SQL Server, Oracle, MySQL, PostgreSQL, etc. While there are multiple standards out there, ...
6
votes
4answers
5k views

Handling database schema changes when pushing new versions

During times of heavy development, the database schema changes both rapidly and continuously, and by the time our weekly push to the beta build comes around, the schema has changed so much that the ...
3
votes
2answers
194 views

implementing dynamic query handler on historical data

EDIT : Refined question to focus on the core issue Context: I have historical data about property (house) sales collected from various sources in a centralized/cloud data source (assume info ...
15
votes
4answers
3k views

Databases: Where should the application logic run? [duplicate]

http://highscalability.com/blog/2010/11/9/facebook-uses-non-stored-procedures-to-update-social-graphs.html talks about how Facebook moved logic out of the database into the application in order to ...
1
vote
2answers
102 views

When should I implement authentication in a database?

I'm currently embarking on a MongoDB project (a simple user login system), and I notice that there is an option for authentication. Here is the server string, with the userinfo shown as optional ...
0
votes
0answers
27 views

How can I aggregate data from separated databases in more efficient way?

Firstm I'm using PostgreSQL 9.3. I'm solving the problem which is to retrieve a data from a separated databases and to render it into a web page. The web project is on the Java (JSF 1.2). Presently ...
-3
votes
1answer
94 views

How can I test a method which aggregates data from a database? [closed]

I'm developing the web Java application and come across the following issue: I'm using jUnit 4.5. Suppose that I have a method which aggregates data from a database for the rendering their to a ...
2
votes
1answer
81 views

Combine union with distinct

Situation: I need distinct results from two tables, that both have duplicates. I would like to know if I should combine UNION and DISTINCT. Example 1 - Only use distinct SELECT DistinctValue FROM ...
0
votes
2answers
175 views

SOA, Java EE and data organization

At the company I work for, we're currently splitting up our monolith solution into a number of small services (SOA). The purpose of this is to make the developers working on each chunk of code ...
1
vote
1answer
97 views

Best approach for a server configuration data collection and reporting solution from a legacy script?

I have a project which involves collecting config data from windows servers in our (very large) server estate. My manager wants me to collect over 150 data items across all configuration areas ...
2
votes
1answer
51 views

Which approach would be better for persisting these overridable configuration keys and values? A simple key-value store, or a graph database?

I'm creating a system where there are config keys and values. So for example: config.key = 10 Is an example of a configuration key and a value. These keys can also have overrides based on ...
0
votes
1answer
42 views

SaaS model, 1DB per client

The context we're building a web-based system and one of the design decisions (database related) was whether to have 1 main DB manage all client data VS having 1 DB per client. After reading a lot ...
0
votes
2answers
57 views

Are the concept of database driven website and the CMS made website same?

I'm having little difficult time of understanding the few logics of web development. Should I call home page, about page (or any other pages of a website whose contents change very rarely and no ...
0
votes
6answers
115 views

Should I rebuild my read only database every time I launch my server?

I'm getting into web development, and I'm trying to get a grip on databases. In an app I want to make, there is a read only database that will be filled up with a large amount of data, which will be ...
0
votes
1answer
94 views

Organise C++ classes around SQL database

My question is about how best to organize C++ classes around a database model, and I understand this may appear very elementary. The software I propose to create will do the following. It is intended ...
0
votes
0answers
93 views

Evaluating local storage for data persistence for small, stand-alone applications

TL;DR - I have a standalone application that will remain relatively small. I'm trying to evaluate between using XML files or a lightweight database for local storage of data that needs to be ...
0
votes
1answer
81 views

Properly design program database to reflect organization structure

I'm having trouble setting up my program's database the 'right' way. I was hoping you guys could give me suggestions on doing it properly. I am creating a database+client for a non-profit organization ...
3
votes
1answer
152 views

End user query syntax?

I'm making a command line tool that allows end users to query a statically-schemed database; however, I want users to be able to specify boolean matchers in their query (effectively things like "get ...
0
votes
1answer
44 views

How to implement a Daily Recap email of Database records modified the previous day sent to Subscribed Users like Basecamp does?

I am building a Project Management module for SugarCRM. It consists of a "Project" which has information on the project like Name, description, start and completion dates, creator name, status ...
4
votes
3answers
319 views

database design, how to handle freelancers

The context i'm modeling a database for a small ERP system. However I've recently hit a difficult spot that I'm having a hard time wrapping my head around. The logic of it involves a few special ...
1
vote
1answer
120 views

Are CRUD operations intended to be used with collections?

CRUD operations, by definition are... interfaces that permit users to create, remove, modify or retrieve data Implementations of CRUD interfaces can come in various shapes and sometimes they are ...
0
votes
1answer
56 views

Real time middleware system: Direct DB access vs REST API access

I'm developing a complex environment which involves a web application, a mobile app and a real time middleware system which accesses the DB for on-site tag readings. Currently, the web application ...
11
votes
6answers
7k views

Is there any reason to use varchar over text columns in a database?

Is varchar just a remnant from before text came around, or are there use cases where you would want to use a varchar? (Or char for that matter..) (I use Postgres and MySQL (MyISAM) daily, so those ...
7
votes
5answers
4k views

What is needed to deploy an application that uses Microsofts new LocalDB?

I'd like to know what microsoft components need to be installed for this new LocalDB to run on a users machine. Now in CTP3: SQL Server Express LocalDB LocalDB is a new lightweight deployment ...
0
votes
2answers
87 views

Is a mocking framework useful if I'm unit testing a repository/database? [duplicate]

I'm trying to improve my testing skills. I frequently hear about mocking framework to build fake objects (as far as I understand). Right now I need to test my repository (the usual add, remove, update ...
3
votes
2answers
134 views

Is a bad practice create database structure on the runtime?

Im creating a crawler app that will always in the beggining, when the Class constructor, ensure that the basic database structure exists. Is this a bad practice? What is the advantage os creating the ...
0
votes
2answers
74 views

Is it a bad practice to keep database schema scripts (DDL) and manipulation (DML) scripts in different modules

we have a project structure like the following "module-shared" module depends on "module-database" module and some other modules depend on "module-shared" but no other module depends on ...
2
votes
2answers
77 views

Unit test database insert/remove and atomicity

I create my compact test database. This is a SDF file, embedded as a visual studio resource. When test suite starts this database is copied in %LOCALAPPDATA% so my test can use it. The first method ...
5
votes
4answers
2k views

What's stopping Oracle from supporting identity (auto-numeric) columns? [closed]

EDIT: As gavenkoa's answer points out, Oracle Database 12c (released a couple of years after this question was asked) has support for Identity Columns. As far as I know, Oracle's RDBMS is one of ...