Thursday, December 16, 2010

Where to find good data sets

O'Reilly Media has been a big advocate of Open Data and believes that is where a lot of computing is going to be headed in the future.  I think they are definitely on to something.  Yet the future could be now.  There is a lot of opportunities to find good data sources immediately.  One of my favorite blogs, OReilly Radar, has an article by Edd Dumbill on Where To Find Data.  There is plenty of good data available on the internet for download to explore and mine new information.  These places not only offer great sources of data but many of them offer an API to allow quick and seamless access.  Below is a link summary from the article.

Freebase

An all-things graph database.  The website focuses on trends of certain cultural and interest topics.

Amazon Public Data Sets

Amazon is probably considered the cloud computing mecca next to Google.  Amazon Web Services offers a lot.  One of which is storage of public data sets.  They offer a huge variety of public data.

Windows Azure Data Marketplace

Surprisingly Microsoft has an open data protocol data source.  This data market offers quite a few points of interest data sets.

Yahoo Query Language

YQL is an interesting API that is very similar to SQL.  YQL is essentially a language that allows to grab data from cloud services.  This could be very handy to grabbing data quickly and dynamically.  YQL offers to connect to a lot of data sources as well.

Infochimps

Infochimps is a data marketplace warehouse.  They offer to host, sell, and distribute data sets.  Some of their data comes at a cost but a lot of their data is free as well.  This is an interesting startup and will be very interesting to follow their growth.  Also there is a new Infochimps R package that uses their API to gather data and process Infochimps data.

DBpedia

DBpedia is a wikipedia for data sets.  In fact the data itself comes from Wikipedia. 


Some other sources not from the article include the World Bank open data and the U.S. Census data.

21 comments:

Paul A. Rubin said...

Oh, man, I wish they'd had these available when I was teaching forecasting methods to MBAs.

Anonymous said...

Thanks for the information. With the start of email, it is becoming less and general to write letters, but the few letters that you will write will maybe be very significant ones. It was really great to visit verified services for more information.

Unknown said...

Really ! Marvellous post it is. I like this post too much. Has wide range of knowledge and useful for readers.Tahnks for share this post with us .
vashikaran specialist
vashikaran love spell
Vashikaran Mantra in hindi
Vashikaran Mantra for love
Black Magic Specialist
Vashikaran Astrologer
Love problem solution
Love marriage specialist
Vashikaran Mantra for Husband
Vashikaran by kamakhya sindur

Unknown said...

Excellent work is done by you . Thanks for share this informative post . I like it.
Vashikaran Specialist
Vashikaran Mantra
Vashikaran Specialist Baba
Blackmagic Specialist
Lost love Back Solution
Love Marriage Specialist
Love Guru Specialist

Unknown said...

Nice post it is . Thanks for share it .
Love Marriage Problem Solution By Vashikaran Mantra
Love Marriage Vashikaran Specialist
Love Vashikaran Specialist Astrologer
Husband Wife Relationship Problem Solution Baba Ji
Lost Love Back By Astrology
Vashikaran Mantra For Love Marriage Specialist
Love Vashikaran Specialist Astrologer
Vashikaran Specialist Baba Ji

paulsmith198914@gmail.com said...

I'm so happy t have found this short article; thanks a lot for sharing it with others.Neddless to say, you're a great blogger:) We wish you to keep up the good job! Best regards, online paper editing service - edit-ing.services

Unknown said...

You can find some free Twitter datasets (about 200,000 tweets per dataset) in Datasets section
http://followthehashtag.com/datasets/?utm_source=WOM&utm_medium=Foros%20%2F%20Preguntas&utm_campaign=Datasets) of Followthehashtag.com

This section is brand new (2016 / 04) and we are adding about 2 or 3 new datasets per week
If you need custom datasets (paid) in this URL you can see pricing for datasets from 2000 to 200,000 tweets

http://analytics.followthehashtag.com/#!/store/historical/?utm_source=WOM&utm_medium=Foros%20%2F%20Preguntas&utm_campaign=Datasets

Alex John said...

I am profoundly pulled in by your post. It is truly a decent and useful one. I will prescribe it to my companions.
ColdFusion Project Help

Alex John said...

Goodness! It's wonderful to be sure! I am certain we can utilize numerous thoughts from this post for our assistance with exposition composing!
Deborah Cullinan and Yerba Buena Center for the Arts Case Solution

IndianVedicAstrology said...

Now, i am see your blog site style is good.i am likewise perused your site remarks so decent

Vedic Astrologer London | Best Indian Astrologer Consultant in London | Best Vedic Astrologer London

faizaashraf said...

https://topacademictutors.com/buy-assignment-online//


faizaashraf said...

https://topacademictutors.com/coursework-writing-service-uk/

faizaashraf said...

https://tnhboxes.com/
https://www.paperslibrary.com/
https://topacademictutors.com/
https://liveassignmenthelp.com/
http://rankhawks.com/
http://www.quotehawks.com/
https://cosmocarparts.com/
http://aiwah.pk/

anusha said...


Full Stack Development Training in Chennai Searching for Full Stack Development training in chennai ? Bita Academy is the No 1 Training Institute in Chennai. Call for more details

Custom Boxes Wholesale said...



custom Packaging Boxes usa
it is wonderful

Melissa hogan said...

My husband left me last year after 25 years of marriage (he turned 50). It has been the most difficult year of my life, but full of lessons about myself and what life and marriage are all about. I am passionate about marriage and i didn't give up on my husband. resides in USA, I entered online in search of advice on how i can amend my marriage while i was at work. I saw so many positive reviews and nice feed back about how a Doctor called______________Robinson.buckler@ yahoo. com has been wonderful with his work. I gave a shot to make contact with him via his Email and he assured me that my marriage will be peaceful and i believed in his words. 16 hours after he finished work, my husband came back home pleading and now, we are living peacefully again. Get in contact with him if you need any help. he is the real deal WE’RE BACK!!!!!!!!!!!!!!!!!!!!!

Assignment Help said...

Thanks for sharing such great information with us. Your Post is very helpful and information is reliable for new readers. Keep Thanks again for sharing such a useful post.
Data Analysis Assignment Help

The Custom Boxes Print said...

Loved the article, there is a great mix of detailed information for businesses to start taking advantage of social media. I found it great that you included the fact that growing on social media takes engaging with your audience as it’s one of the biggest things our company tries to emphasize on. Wonderful article.
Custom Printed Boxes
Custom Boxes with Logo

The Custom Boxes Print said...


We offer custom boxes that give you full liberty of customizing the entire packaging at every step. Packaging is the first thing a customer notices. It has to be spot on to appeal to the customers. The visual appeal ticks a customer before they could actually choose a product. Packaging is the first impression we are committed to make that leaves a lasting impact on the customers.
Custom Packaging Boxes USA
Soap Boxes
Slider Boxes
Nail Polish Boxes
Lipstick Boxes
Pillow Boxes
Custom Lip Balm Boxes

Olaf Ae said...

nice blog, thanks for providing the search for the great information.

Heathrow Taxi London Heathrow Taxi

London Chauffeurs London Chauffeur Company

Best Crossbow for the Money

Fastest Crossbow

Heathrow taxi cheap, Heathrow taxi

Mitcham Taxi

Arulraj said...

Very good article,Thank you
For sofa repair service contact thesofastore they gives
Sofa Refurbishing in Doddanekundi,Bangalore