Sikuli is a visual technology to search and automate
graphical user interfaces (GUI) using images (screenshots).
The first release of Sikuli contains Sikuli Script,
a visual scripting
API for Jython, and Sikuli IDE,
an integrated development environment
for writing visual scripts with screenshots easily.
Sikuli Script automates anything you see on the screen
without internal API's support.
You can programmatically control a web page,
a desktop application running on
Windows/Linux/Mac OS X,
or even an iphone application running in an emulator.
http://groups.csail.mit.edu/uid/sikuli/
(original post)