Monday, July 16, 2007

Humans to the rescue

Images like the one above are familiar to any of us who have ever used webmail, Ticketmaster, or any other web service that wants to prevent automated spammers and scalpers from exploiting their systems. The distorted, fuzzy letters don't provide a challenge to humans, but are indecipherable to the most sophisticated computer algorithms. Our genius is facilitated by our "invariant" perceptual abilities; that is, we can recognize objects, faces, and letters independent of rotation, translation, and scale.

However, these CAPTCHAs (Completely Automated Public Turing Test to Tell Computers and Humans Apart) were designed with a wonderfully clever ulterior motive. In addition to preventing rogue bots from devastating our virtual lives, CAPTCHAs like the one above are actually exploiting you, the human, and the invariance of your human perception, to help digitize the world. The words presented in these CAPTCHAs are pulled from the book-scanning project of the Internet Archive, which aims to scan millions of public-domain books and put them online for free. One word of the CAPTCHA is known to the computer, and is used to verify your humanness, while the other was indecipherable to the Archive's scanners. When you type in that word, you're actually translating the image into text for the Archive.

There's a fantastic article in Wired Magazine about this type of "human computation," "the art of using massive groups of networked human minds to solve problems that computers cannot." The article profiles the work of Luis von Ahn, who designs clever ways to harness the powerful brains of bored web surfers to solve computing problems (e.g. judging random pictures as "pretty," tagging images and audioclips, etc.)

From Wired Magazine:
If people could so easily recognize pictures of letters and numbers, could [they] use this ability to identify and label the vast number of images on the Web?

...

The way to do it, he realized, was as a game. It would pull images off the Web, then randomly pair two players from around the world. They would be shown the same images, then each would type in as many words as they could to describe those images, hoping to hit upon the same ones as their anonymous partner. They'd get 50 points for each match, and two and a half minutes to earn as many points as possible. Von Ahn suspected that whenever the players agreed on a word — "meadow" to describe a tree-lined clearing, for example — they would be choosing a highly accurate label for the picture.

Von Ahn cobbled the game together in a week — "crappy, totally terrible code," he admits — and threw it online. He dubbed it The ESP Game and emailed the URL to a few friends. Within days it was Slashdotted, whereupon his server nearly crashed under the load of new players. Astonished, von Ahn watched for the next four months as 13,000 players produced 1.3 million labels for some 300,000 images — with a few hardcore fans clocking more than 50 hours of play. "It's like crack," as one player complained in an email to von Ahn. The labels his players generated were far more accurate than what other image-search technologies produced. Most search engines are limited to sniffing out words associated with a picture, such as the name given to the image, words in the page around it, or links pointing to it. That's inherently imprecise: When von Ahn recently searched for "dog" on Google, a third of the pictures showed no dogs at all. When he queried the ESP database, almost all the results contained canines. Better yet, players often generated labels that were subtle and nuanced. A search for "funny" found a picture of Ronald McDonald being hauled away by police and one of Queen Elizabeth picking her nose.
Even the DHS wants to employ your brainpower as you procrastinate on the web:
This spring, von Ahn got a call from the Department of Homeland Security. He went to Washington to meet with DHS officials, and together they devised a game in which people are challenged to find dangerous objects in images of x-rayed baggage. The pictures would be fed from airport scanners, and players would act as a second set of eyes for overtaxed security employees. If enough players noticed something amiss, an alert would be triggered.
Von Ahn's other games that capitalize on human superiority (supposedly available at Games with a Purpose "in July," but as of now the site isn't running yet) include:
1) Matchin' Players are shown the same pair of images, then each tries to pick the one they'll both agree is more attractive. Creates a database of images searchable by aesthetic value, a task no algorithm can perform.

2) Babble Two English-speaking players are shown a sentence in a foreign language that neither of them speak. A list of possible English meanings appears below each word. Players try to agree upon a set of English words that forms the most coherent sentence. Translates foreign text into English without requiring anyone fluent in both languages.

3) InTune Players listen to the same audioclip and then try to come up with the same phrase to characterize it. Tags sounds with searchable descriptive text.

4) Squigl Two players are shown the same picture and a word describing an element within the image (e.g., a picture of a dog and the word "leash"). They each draw a border around the element. Produces a set of pictures with their internal components tagged — terrific for very specific image searches.

5) Verbosity One player is given a word, and the other tries to guess that word by completing phrases such as "It is near a ____" or "It is a type of ____." The first player answers "true" or "false" but can't use the word itself. Creates a database of commonsense knowledge describing the objects.

Link to the full Wired article.

232 comments:

«Oldest   ‹Older   201 – 232 of 232
Anonymous said...

Not only is it much harder to qualify for these grants.
You might want to be the end of the 12 month introductory rate.

This will not improve your credit status rather than borrowing more money on an annual
basis than they earn.

Also visit my site loans for people with bad credit

Anonymous said...

Putting clothes straight into the washing how do i get a girlfriend machine may also be
suddenly interested in being in good shape.
Children do it for long, especially if you two are
communicating at the moment. This way you can keep her interested.



my blog: how do you get a girlfriend

Anonymous said...

I love what you guys are up too. Such clever work and reporting!
Keep up the wonderful works guys I've incorporated you guys to our blogroll.

My page pirater un compte facebook

Anonymous said...

They want men with masculine dominance and masculine intent to fuck them.

She will be so obvious to many women that a guy can keep that from happening in the dating world, you need to do publicity like this just because his single is out.
You can use Psychological and Expert Tips to get your ex attract
women back again. By the time you used to run away from the crocodile.
Men need to step up and say" Hi.

Also visit my web blog; ways to attract women

Anonymous said...

What are the three biggest mistakes I learned that could be an indicator she's cheating. Why you have to ooze yourself with confidence. You just have to determine ways to attract women how much is too much? This is why I decided to just take the necessary steps.

Anonymous said...

What's up, for all time i used to check blog posts here early in the dawn, for the reason that i enjoy to find out more and more.

Here is my website ... Psn Code Generator

Anonymous said...

I like the valuable information you provide in your articles.
I will bookmark your weblog and check again here regularly.
I am quite certain I'll learn plenty of new stuff right here! Good luck for the next!

Here is my web page ... Code Psn Gratuit

Anonymous said...

Nice post. I learn something new and challenging on sites I stumbleupon everyday.
It will always be helpful to read articles from other authors and practice something from their web sites.


Feel free to visit my web page; World Of Tanks Hack

Anonymous said...

Hello to every single one, it's genuinely a nice for me to pay a visit this web page, it includes useful Information.

My blog post Dragon City Cheat Engine

Anonymous said...

Hi there! This article couldn't be written much better! Going through this article reminds me of my previous roommate! He constantly kept preaching about this. I most certainly will send this article to him. Fairly certain he will have a very good read. Thanks for sharing!

Feel free to visit my blog post World of tanks hack

Anonymous said...

Hello there, just became aware of your blog through Google,
and found that it's really informative. I'm going to
watch out for brussels. I'll appreciate if you continue this in future. Many people will be benefited from your writing. Cheers!

Have a look at my webpage Code Psn Gratuit

Anonymous said...

Investment-grade companies sold $44 billion of bonds backing acquisitions this year through July, almost twice the $24 billion they sold in all 2011, according to the National Highway Traffic Safety Administration
NHTSA. A good, cheap auto insurance san antonio quote without sacrificing protection.
Before you give any consideration to the assigned pool
for high risk drivers. Participating in the Pennsylvania assigned risk program.



Feel free to visit my site car insurance - Http://philsautoinsurance.Com -

Anonymous said...

What a stuff of un-ambiguity and preserveness of valuable knowledge
concerning unexpected feelings.

Check out my page - Psn Code Generator

Anonymous said...

If you want to get back together with their ex how to attract women tips
back but one of the few guys that actually does
pose questions to her beliefs and ideas. You taste what you
smell, etc. You just have to listen to him.

Anonymous said...

Good article! We are linking to this particularly great content on our website.
Keep up the great writing.

my site Minecraft Gift Code Generator

Anonymous said...

Hey! Do you use Twitter? I'd like to follow you if that would be ok. I'm undoubtedly enjoying
your blog and look forward to new updates.

Here is my blog post: Free Psn Codes (Http://Www.Youtube.Com/)

Anonymous said...

you are in reality a just right webmaster.

The web site loading pace is amazing. It seems that you are doing any unique trick.
Also, The contents are masterwork. you've performed a excellent task on this matter!

Have a look at my page: virility ex ()

Anonymous said...

Great post but I was wondering if you could write a litte more on this subject?

I'd be very grateful if you could elaborate a little bit further. Thank you!

my website - body detox

Anonymous said...

you are really a excellent webmaster. The web site loading speed is amazing.
It seems that you are doing any unique trick.
Also, The contents are masterpiece. you've done a great process on this subject!

Also visit my website :: Minecraft Crack

Anonymous said...

Hi there to every single one, it's really a fastidious for me to pay a quick visit this website, it consists of valuable Information.

my web blog; Minecraft Crack

Anonymous said...

You should take part in a contest for one of the greatest blogs on the web.
I most certainly will highly recommend this web site!


My site ... skyline film discussions

Anonymous said...

Hey I know this is off topic but I was wondering if you knew of any widgets
I could add to my blog that automatically tweet my newest
twitter updates. I've been looking for a plug-in like this for quite some time and was hoping maybe you would have some experience with something like this. Please let me know if you run into anything. I truly enjoy reading your blog and I look forward to your new updates.

Look at my weblog; ps3 jailbreak 2

Anonymous said...

Incredible. This received my Lexmark e210 working. It is constantly an obstacle in Windows to get this printer
working, this is the third driver I've had to make use of for many years.

Feel free to surf to my homepage :: xerox phaser 8560mfp

Unknown said...

I think that this is a genius idea. I knew that they were doing this with words but when they started doing this with your addresses, I think its kind of creepy.
Steve | http://www.sproulemacnaughton.com/profile/

Toko Herbal said...

Good Article
Pengobatan Tradisional Kanker Payudara Stadium 2
Pengobatan Tradisional Untuk Kanker Payudara Stadium 2
Cara Pengobatan Tradisional Kanker Payudara Stadium 2
Pengobatan Tradisional Buat Kanker Payudara Stadium 2
Artikel Pengobatan Tradisional Kanker Payudara Stadium 2

Anonymous said...

good
Jual Obat Kondiloma Akuminata
Obat Kondiloma Akuminata Pada Pria
Obat Kondiloma Akuminata
Jual Obat Ampuh Kondiloma Akuminata Pada Pria
Resep Obat Kondiloma Akuminata
Obat Kondiloma Akuminata Pada Pria
Obat Kondiloma Akuminata
Resep Obat Ampuh Kondiloma Akuminata Pada Pria
Beli Obat Kondiloma Akuminata
Obat Kondiloma Akuminata
Beli Obat Penyakit Kondiloma Akuminata Pada Pria
Beli Obat Alami Kondiloma Akuminata Pada Pria
Cari Obat Kondiloma Akuminata
Cari Obat sakit Kondiloma Akuminata Pada Pria
Obat Kondiloma Akuminata Pada Pria
Cari Obat Alami Kondiloma Akuminata Pada Pria
Obat Kondiloma Akuminata Pada Pria
Obat Kondiloma Akuminata
Obat Kondiloma Akuminata di Apotik
Pengobatan Kondiloma Akuminata Pada Pria di Apotik
Artikel Obat sakit Kondiloma Akuminata Pada Pria
Artikel Obat Alami Kondiloma Akuminata Pada Pria
Artikel Obat Kondiloma Akuminata
Artikel Obat Kondiloma Akuminata Pria
obat kondiloma akuminata
obat kondiloma akuminata pria
pengobatan kondiloma akuminata
pengobatan kondiloma akuminata pada pria
Obat Ambeien Tanpa Operasi
Jual Obat Ambeien
Jual Obat Ambeien Tanpa Harus Operasi
Jual Obat Ambeien Wasir Tanpa Operasi
Obat Ambeien Tanpa Operasi
Artikel Obat Ambeien
Artikel Obat Ambeyen
Artikel Obat Ambeien Wasir Tanpa Operasi

Health e Happy said...

I just came across your blog and reading your beautiful words. I thought I would leave my first comment but I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often.

Unknown said...

Well, I am so excited that I have found this your post because I have been searching for some information about it almost three hours. You helped me a lot indeed and reading this your article I have found many new and useful information about this subject. Health e Happy

Unknown said...

thank you
ST3 Telkom

Unknown said...
This comment has been removed by the author.
Adel Jopong said...

nice..

ST3 Telkom

James E Lutz said...

Essentially wish to say the article is astounding. The clarity in this post is simply fantastic.

office furniture

«Oldest ‹Older   201 – 232 of 232   Newer› Newest»