Wednesday, September 24, 2014

Watson Analytics Tool

IBM has released a new tool for performing analytics on big data.   The name of the tool is "Watson Analytics," and the name refers to Watson, the famous IBM computer that won on Jeopardy. Essentially this tool allows users to pose natural language questions and get answers derived from large data sets.  An example given in the New York Times article linked below is "What high-value customers am I most likely to close sales with in the next 30 days?"     The idea is that a business user can use the tool without having to talk to a data scientist first.  The author of the New York times article ponders whether this is the "killer app" for Big Data.

Here is the link:

http://nyti.ms/1qbtCnt

Saturday, January 11, 2014

New ways of representing data

The New York Times Bits blog this week has an article titled "A Makeover for Maps" that talks about cutting edge visualizations of data.  The article cites some interesting new depictions of data--such as the one created by Eric Rodendeck of  Stamen Design that creates  "...a representation of how photos spread on Facebook that looks like ice crystals forming on a car window."

The article goes on to talk about the idea of creating visualizations that can be used by different audiences -- like a dynamic chart of Nasdaq financial data that can be read one way by a pension fun manager looking for trends and another way by an SEC investigator looking into an unusual spike in trading during a given day.

Check out the full article with multiple visualization examples at

http://bits.blogs.nytimes.com/2014/01/06/a-makeover-for-maps/?smid=pl-share

Monday, October 14, 2013

Looking at the problems on the healthcare.gov site

You may have heard the news about people in the U.S. experiencing problems trying to sign up for healthcare on the new healthcare.gov site.  This site is perhaps the most visible manifestation of the Affordable Care Act, aka "Obamacare."  On healthcare.gov, users can search the "Health Insurance Marketplace" for coverage.  However, the site has been plagued by reports of slowness and poor user experience. 

Several online articles attempt to surmise what is going wrong with the site from a technical perspective.  Regardless of your personal views on the Affordable Care Act, I think these are relevant for us to read because they provide us a chance to avoid making the same (apparent) technical mistakes in our projects.  I'd like to highlight some general points that I have read so far:

  • Load test both the interface _and_ the back end functionality. 
  • User experience (UX) should not be an afterthought
  • Poor validation logic (eg requiring numbers as part of username/password but not informing user of this beforehand or in error messages) leads to extremely poor UX

For more on the technical issues with healthcare.gov, see the following articles:




And here is a contrarian opinion, stating that the architecture of healthcare.gov is sound, but that the project was rushed:

Friday, September 27, 2013

Google updates its search algorithm

Google has updated its search algorithm for the first time since 2010.  According to this post in the Bits Blog on the New York Times site, this is the most extensive overhaul of the algorithm since 2000.

Although Google is not revealing specific details of the new algorithm, code named "Hummingbird," the main thrust of the changes are geared toward understanding longer and more complex queries.  To that end, Google is employing its Knowledge graph, which is a map of semantic relationships.

One of the drivers for understanding longer queries is that more people are speaking queries into their phones using natural language, which is by its nature more complex than a simple keyword query typed into a search box.

For more information, see:

Forbes article:
http://www.forbes.com/sites/roberthof/2013/09/26/google-just-revamped-search-to-handle-your-long-questions/

Search Engine Land FAQ on Hummingbird:
http://searchengineland.com/google-hummingbird-172816

Google "15th anniversary" blog post (includes a great "Google Search Timeline" graphic):
http://insidesearch.blogspot.com/2013/09/fifteen-years-onand-were-just-getting.html

Google post on the Knowledge graph (2012):
http://googleblog.blogspot.com/2012/05/introducing-knowledge-graph-things-not.html



Saturday, May 11, 2013

YouTube trends map

YouTube Trends map

YouTube has a new feature called "Trends Map" that allows you to see what people in different parts of the country are watching.

Here is the YouTube trendsmap site:
http://www.youtube.com/trendsmap

And here is an article describing the new feature:
http://philadelphia.cbslocal.com/2013/05/11/youtubes-trends-map-shows-popular-videos-by-geographic-location/


Monday, April 8, 2013

"Predatory journals" in science

Interesting NYTimes article today about a disturbing phenomenon in academic research:  "predatory" journals and conferences that charge (unadvertised) fees for publication.  

http://www.nytimes.com/2013/04/08/health/for-scientists-an-exploding-world-of-pseudo-academia.html?smid=pl-share


Tuesday, February 5, 2013