The following tips can help you become an ethical data miner. This may also help your data mining efforts perform faster than unethical data mining.
Specify! Be very specific about the data that you wish to glean from your provider. Keep your mining efforts focused on very specific content and your results will be created faster. Seeking out common words and phrases becomes a waste of time and resources. Imagine how many times you can find the word 'the', or the phrase, 'the phrase'?
Every information provider has a help section where you can find useful tips on how to search their content for the most valuable and efficient results. Invest a few minutes to read your favorite data providers help section and you will save much more time and effort in the future. Some examples of specific data-mining content include:
1. File Types. ( mp3, wav, fla, swf, pdf, doc, txt)
2. Unique Keywords
3. Shorter Date Ranges
4. Literal phrases.
5. Do not seek out common words and phrases.
Information providers also appreciate and benefit from ethical data-miners. You will find many are happy to nurture business relationships with ethical data miners. Google and Yahoo both have various programs to help data-miners glean the most valuable information.
Yahoo Search Marketing Developers Forum can be found online at http://tech.groups.yahoo.com/group/yws-searchmarketi ng/.
Google's advanced search tips can be found online at http://www.google.ca/intl/en/help/refinesearch.html.