| Gesture / Voice recognition research? [message #598791] |
Mon, 20 June 2005 21:48 |
 Erkki Lindpere
Messages: 90
Registered: July 2009 |
Member |
|
|
Hello!
Are there any Eclipse-related research projects in gesture / voice
recognition? I know about the Voice Tools Project, but I'm thinking of
gesture and voice recognition *in* the IDE.
I am doing most of my Java developement work in IDEA (hoping to move to
Eclipse as WTP matures) and there's a really simple but nice Mouse
Gesture plugin available for it. It lets you bind orthogonal mouse
gesture sequences (Left, Right, Left, Up, Down etc.) to IDEA's menu
items. I find this somewhat useful and have bound some of the most
common tasks to gestures, so I can avoid remembering keystrokes or
navigating menus. I find it easier to draw the letter C for Commit, U
for Update, backwards C for rollback etc. than to remember the shortcut
keys. And somewhy I feel like it gives me this sense of power -- can't
really explain.
The IDEA plugin is based on a LGPL Mouse Gesture library (search for
Java Mouse Gestures to find it) that is very simple and easy to use. I
tried porting it from Swing to SWT and got the basic gesture recognition
working in Eclipse, but I'm not progressing very fast towards a usable
plugin, being a beginner in Java and not having touched SWT before. Is
anyone else trying to do something similar?
An extension to this idea would be hand gesture recognition, with help
from a webcam. You could move your hand a bit up from the keyboard and
make a gesture without having to reach for the mouse. There seem to be
some open source computer vision projects that already have code that
can do this, maybe they could be leveraged for an eclipse plugin?
One I found is HandVu, that makes use of Intel's OpenCV project:
http://www.cs.ucsb.edu/~matz/HGI/HandVu.html
Another related interesting area of interaction would be programming by
voice, but I don't have the slightest clue about what advances have been
made there.
I am not really knowledgeable in this field, I've only had a casual
interest in it so far, but it seems to me that about now would be a good
time to experiment with future interaction technologies in various
environments. I want to be using an interface similar to the one in the
movie "Minority Report" by 2010! :)
With best regards,
Erkki "Villane" Lindpere
|
|
|
Powered by
FUDForum. Page generated in 0.03048 seconds
] 
Search
Help
Register
Login
Home
