Thursday, December 16, 2010

Where to find good data sets

O'Reilly Media has been a big advocate of Open Data and believes that is where a lot of computing is going to be headed in the future.  I think they are definitely on to something.  Yet the future could be now.  There is a lot of opportunities to find good data sources immediately.  One of my favorite blogs, OReilly Radar, has an article by Edd Dumbill on Where To Find Data.  There is plenty of good data available on the internet for download to explore and mine new information.  These places not only offer great sources of data but many of them offer an API to allow quick and seamless access.  Below is a link summary from the article.


An all-things graph database.  The website focuses on trends of certain cultural and interest topics.

Amazon Public Data Sets

Amazon is probably considered the cloud computing mecca next to Google.  Amazon Web Services offers a lot.  One of which is storage of public data sets.  They offer a huge variety of public data.

Windows Azure Data Marketplace

Surprisingly Microsoft has an open data protocol data source.  This data market offers quite a few points of interest data sets.

Yahoo Query Language

YQL is an interesting API that is very similar to SQL.  YQL is essentially a language that allows to grab data from cloud services.  This could be very handy to grabbing data quickly and dynamically.  YQL offers to connect to a lot of data sources as well.


Infochimps is a data marketplace warehouse.  They offer to host, sell, and distribute data sets.  Some of their data comes at a cost but a lot of their data is free as well.  This is an interesting startup and will be very interesting to follow their growth.  Also there is a new Infochimps R package that uses their API to gather data and process Infochimps data.


DBpedia is a wikipedia for data sets.  In fact the data itself comes from Wikipedia. 

Some other sources not from the article include the World Bank open data and the U.S. Census data.


Paul Rubin said...

Oh, man, I wish they'd had these available when I was teaching forecasting methods to MBAs.

Anonymous said...

Thanks for the information. With the start of email, it is becoming less and general to write letters, but the few letters that you will write will maybe be very significant ones. It was really great to visit verified services for more information.

Vashikaran Prediction said...

Really ! Marvellous post it is. I like this post too much. Has wide range of knowledge and useful for readers.Tahnks for share this post with us .
vashikaran specialist
vashikaran love spell
Vashikaran Mantra in hindi
Vashikaran Mantra for love
Black Magic Specialist
Vashikaran Astrologer
Love problem solution
Love marriage specialist
Vashikaran Mantra for Husband
Vashikaran by kamakhya sindur

astrologer vinodkumar said...

Excellent work is done by you . Thanks for share this informative post . I like it.
Vashikaran Specialist
Vashikaran Mantra
Vashikaran Specialist Baba
Blackmagic Specialist
Lost love Back Solution
Love Marriage Specialist
Love Guru Specialist

Anonymous said...

Great article it is. It's an informative post . Thanks to share it with us .
vashikaran specialist In Chennai
Blackmagic Specialist In Chennai

Love Guruindia said...

Excellent article .Thanks to share this informative post with us .
Vashikaran Mantra In Hindi
Love Marriage Specialist
World Famous Astrologer
Vashikaran Marriage Love Spell
Vashikaran Mantra
Vashikaran Specialist Baba
Black Magic Specialist

astrologer guruinindia said...

Nice post it is . Thanks for share it .
Love Marriage Problem Solution By Vashikaran Mantra
Love Marriage Vashikaran Specialist
Love Vashikaran Specialist Astrologer
Husband Wife Relationship Problem Solution Baba Ji
Lost Love Back By Astrology
Vashikaran Mantra For Love Marriage Specialist
Love Vashikaran Specialist Astrologer
Vashikaran Specialist Baba Ji

Paul Smith said...

I'm so happy t have found this short article; thanks a lot for sharing it with others.Neddless to say, you're a great blogger:) We wish you to keep up the good job! Best regards, online paper editing service -

Alvin Clark said...

Silk Road Research is an independent market research firm focused on providing on-the-ground business intelligence in Emerging Asia.

Enrique Rivera DNOISE said...

You can find some free Twitter datasets (about 200,000 tweets per dataset) in Datasets section of

This section is brand new (2016 / 04) and we are adding about 2 or 3 new datasets per week
If you need custom datasets (paid) in this URL you can see pricing for datasets from 2000 to 200,000 tweets!/store/historical/?utm_source=WOM&utm_medium=Foros%20%2F%20Preguntas&utm_campaign=Datasets

Alex John said...

I am profoundly pulled in by your post. It is truly a decent and useful one. I will prescribe it to my companions.
ColdFusion Project Help

Alex John said...

Goodness! It's wonderful to be sure! I am certain we can utilize numerous thoughts from this post for our assistance with exposition composing!
Deborah Cullinan and Yerba Buena Center for the Arts Case Solution

IndianVedicAstrology said...

Now, i am see your blog site style is good.i am likewise perused your site remarks so decent

Vedic Astrologer London | Best Indian Astrologer Consultant in London | Best Vedic Astrologer London

pauledwards124 said...

Our website is number 1 in Case Study assignment help, online Case Solution & Case Analysis experts. Feel free to contact us to get your case studies done.
Case Study Assignment Help

lisa roberts said...

Our website is number 1 in Assignment Provider, Assignment Help for University Students in UK, USA, Australia, and Malaysia. You Can Ask Every Thing You Want. Our Team Work 24/7.Assignment Help Provider.

Olaf AE said...

Thanks for sharing.This is nice and helpful post.

Faiza Ashraf said...

Faiza Ashraf said...

Faiza Ashraf said...

Faiza Ashraf said...

Faiza Ashraf said...

anusha said...

Full Stack Development Training in Chennai Searching for Full Stack Development training in chennai ? Bita Academy is the No 1 Training Institute in Chennai. Call for more details

Custom Boxes Wholesale said...

custom Packaging Boxes usa
it is wonderful

Melissa hogan said...

My husband left me last year after 25 years of marriage (he turned 50). It has been the most difficult year of my life, but full of lessons about myself and what life and marriage are all about. I am passionate about marriage and i didn't give up on my husband. resides in USA, I entered online in search of advice on how i can amend my marriage while i was at work. I saw so many positive reviews and nice feed back about how a Doctor called______________Robinson.buckler@ yahoo. com has been wonderful with his work. I gave a shot to make contact with him via his Email and he assured me that my marriage will be peaceful and i believed in his words. 16 hours after he finished work, my husband came back home pleading and now, we are living peacefully again. Get in contact with him if you need any help. he is the real deal WE’RE BACK!!!!!!!!!!!!!!!!!!!!!

Assignment Help said...

Thanks for sharing such great information with us. Your Post is very helpful and information is reliable for new readers. Keep Thanks again for sharing such a useful post.
Data Analysis Assignment Help

faizaashraf said...
Gatwick Airport Taxi
Mitcham Taxi
Gatwick Airport Taxi

faizaashraf said...
Gatwick Airport Taxi
Mitcham Taxi
Gatwick Airport Taxi