168 reputation
1212
bio website None
location London, Brighton, UK
age
visits member for 3 years, 3 months
seen Dec 15 at 13:59

Mainly a SQL Developer, but also develop using:

C#, JavaScript, VB.NET, SSIS, SSRS, SSAS.


Sep
24
awarded  Autobiographer
Sep
6
asked SQL Dev and Prod Environments
Jul
18
awarded  Popular Question
May
10
awarded  Fanatic
Mar
28
awarded  Informed
Feb
25
awarded  Caucus
Feb
25
awarded  Constituent
Jun
27
awarded  Critic
Jun
8
awarded  Caucus
May
16
awarded  Analytical
Mar
28
comment Designing a large database with multiple sources
Thankfully we do have a specialist and experienced OLAP developer.
Mar
28
comment Designing a large database with multiple sources
I thought of that, but would it noto be difficult to say normalise one source during the ETL, then add to those normalised tables during the next sources ETL, and the same for the next etc. It sounded like an odd way to go about it. Could be wrong of course!
Mar
28
comment Designing a large database with multiple sources
Primarily in the fact that all the data needs to be standardised I would say. But then the whole system has flaws of varying severities, lack of intelligent indexing, table structure, code etc. My thinking was to take a step back, and try and implement something extensible, with best practice in mind, rather than fixing and making do.
Mar
28
revised Designing a large database with multiple sources
edited title
Mar
28
comment Designing a large database with multiple sources
1) Yes, it does have to happen overnight. The other servers are production servers used for modelling and reporting and their DBAs get angry if we touch them during business hours. 2) There is currently only a PK on the large table. 3) This is certainly a possibility I have been thinking about, but I'm not sure if this is the most efficient way to let the data to consumed by the cubes and web app. 4) The servers are certainly powerful enough, I think its just the lack of best practice over the years causing inefficiencies.
Mar
28
awarded  Commentator
Mar
28
comment Designing a large database with multiple sources
Good spot! Ill leave it here for a while and see what happens, or bow the greater wisdom of the community and ask for it to be migrated.
Mar
28
revised Designing a large database with multiple sources
edited body
Mar
28
asked Designing a large database with multiple sources
Feb
27
awarded  Enthusiast