Data mining is the process of locating patterns and trends within a given data-set, that may not be immediately obvious or intuitive.

learn more… | top users | synonyms

-1
votes
1answer
67 views

Word recognition in a string without spaces or punctuation marks

I have a small C# project that reads a file and gives me an output: a string that does not contain spaces nor any types of punctuation marks. It may also contain a few misspellings. Ex. Output: ...
-2
votes
0answers
28 views

Scraping data from wikipedia using Scrapy - why/when do errors occur due to processing URLs? [migrated]

I am just starting to use Scrapy, and I am learning to use it as I go along. Please can someone explain why there is an error in my code, and what this error is? Is this error related to an invalid ...
0
votes
1answer
188 views

Beginning Data Mining

For simplicity, my database has entities and transactions. Each transaction has a DateCreated and a foreign key to the entity. I'd like to have the ability to find entities that have had a recurring ...
0
votes
0answers
13 views

Article about “painting” coorelation between complex data [closed]

I am trying to get an understanding of quite a big data set. I have 20 different inputs parameters and 10 different outputs. The control algorithm is made and seems to work, but now I need to ...
0
votes
2answers
69 views

Cleaning a dataset of song data - what sort of problem is this?

I have a set of data about songs. Each entry is a line of text which includes the artist name, song title, and some extra text. Some entries are only "extra text". My goal is to resolve as many ...
2
votes
0answers
370 views

Clustering Strings on the basis of Common Substrings

I have around 10000+ strings and have to identify and group all the strings which looks similar(I base the similarity on the number of common words between any two give strings). The more number of ...
0
votes
0answers
29 views

What stack can handle some data preprocessing and output in ARFF format?

I used to do my preprocessing of data in Python, loading CSV or other things and constructing a specific program for each problem I had to address where an output in a ARFF format was needed. Of ...
0
votes
1answer
159 views

What is the basic process and tools needed for crawling a source code repository for the purpose of data mining?

This all is with respect to Microsoft project CodeBook: CodeBook There is huge amount of code in the repository, many classes , a call hierarchy of functions, testcases etc. I am interested in ...
3
votes
0answers
124 views

Which prediction model for web page recommendation?

I am trying to implement a web page recommendation wherein registered users will be given a recommendation of which page to visit depending upon the previous data. So with initial study I decided ...
0
votes
1answer
50 views

Create association between informations

I deployed a project some days ago that allow to extract some medical articles using the results of a questionnaire completed by a user. For instance, if I reply on questionnaire I'm affected by ...
2
votes
2answers
144 views

Suggesting albums based on friends' top ten lists

Just wondering if someone could suggest a good algorithm in the collaborative filtering vein that I could use to suggest music choices based on top ten lists. This is a personal project, I am a ...
2
votes
5answers
2k views

Data Mining Books [closed]

I'm passionate about data mining, I have read some books like Programming Collective Intelligence, and I would like to know more good books, specially practical ones, about data mining in conjunction ...
4
votes
3answers
1k views

How do I cluster strings based on a relation between two strings?

If you don't know WEKA, you can try a theoretical answer. I don't need literal code/examples... I have a huge data set of strings in which I want to cluster the strings to find the most related ones, ...
1
vote
2answers
217 views

How can I make my career in supply chain optimisation and data mining?

There is a company in my city which does supply chain optimization, data mining and predictive modelling. I tried hard but was not able to enter there. Now I want to do similar sort of work. They ...
1
vote
1answer
423 views

Pattern for SQL data mining app

We have an app that is used for data mining on our client database. Typical uses include getting a list of clients and their email addresses, running reports about user transactions between certain ...
3
votes
1answer
157 views

Modern approaches to retrieve useful content from a web page?

What are the modern ways to (effectively) determine which part of page contains useful text, data tables, etc. and which are not (e.g. ads, navigation, etc.)? What were the last valuable ...
3
votes
2answers
650 views

web services, J2EE, spring, DB integration project ideas- maybe data mining related?

I am a graduate CS student (Data mining and machine learning) and have a good exposure to core JAVA (>3 years). I have read up a bunch of stuff on Design patterns J2EE Web services( soap and rest) ...
1
vote
1answer
96 views

Social Analytics in your current data

By now everyone is aware of the massive boom in social-networking (Twitter, Facebook, LinkedIn) and obviously a big part of its business model revolves around being able to mine this data to create ...