Skip to main content


Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Archived » Voicetools » Re: Programming by voice
Re: Programming by voice [message #506532] Thu, 07 January 2010 16:14 Go to next message
Eric Rizzo is currently offline Eric RizzoFriend
Messages: 3070
Registered: July 2009
Senior Member
You should probably familiarize yourself with the Voice Tools Project
(http://www.eclipse.org/vtp/) - I don't think it really covers the area
that you're talking about, but it might be something that you can
leverage in an implementation of your idea. I'm not sure how active or
dormant that project is, however.

I've copied the VTP forum group on this reply
(http://www.eclipse.org/forums/eclipse.technology.voicetools)

Hope this helps,
Eric


On 1/7/10 1:41 AM, Frank Sem-Jacobsen wrote:
> Hi,
>
> I am currently deciding whether it is worth my while to create a
> project, probably within the research institution where I work, to
> create a efficient toolkit for programming by voice.
>
> My main idea is some tight integration with an IDE like eclipse to take
> care of formatting and navigating around projects, and also a voice
> syntax and grammar to write the actual lines of code. Examples of the
> former may be "add public integer X to class coordinates" which would,
> regardless of the current position of the cursor, add the correct
> variable to the correct class and return to the original position of the
> cursor. Much of the tedious navigation and formatting can be fixed this
> way.
>
> Regarding syntax and grammar, in order for this to work with multiple
> programming languages, one would have to to identify common programming
> constructs and create a comprehensive and uniform way of dictating this.
>
> Does anyone know whether such projects are underways anywhere, and how
> much interest would there be for such a project? I have found a
> reference to an editor called VASDE which was based on Eclipse around
> 2006. I have not found any references to this in Google.
>
> If it appears that no one is doing anything similar, and we agree that
> the approach is feasible, then I would like to try to arrange it. I know
> that some of you have tried this before with the old voicecode project,
> but I guess it is fair to say that that is pretty dead now.
>
> I have just started the process of figuring out from where I may get
> funding for such a project, and thinking that we need at least one guy
> for a year working 100% on this in order to get anything implemented at
> all. I think that the Eclipse integration should be quite
> straightforward (relatively speaking), and the most time would be spent
> on trying to create the language constructs to support it.
>
> This is a bit of what I'm thinking now, and I would greatly appreciate
> any feedback/ideas/comments you might have on the subject. Especially if
> could be useful to get in contact with those of you who have tried this
> before.
>
> Best regards,
> Frank Olaf Sem-Jacobsen, Ph.D. Postdoctoral Fellow Simula Research
> Laboratory
Re: Programming by voice [message #506685 is a reply to message #506532] Fri, 08 January 2010 17:54 Go to previous messageGo to next message
Randy Childers is currently offline Randy ChildersFriend
Messages: 121
Registered: July 2009
Senior Member
Hi Frank and Eric--

The VTP project is not at all dormat, though the newsgroup doesn't see a
lot of action. I'm not sure how useful the VTP project would be in this
situation, but there might be a few bits of the project that would be
useful, particularly around the VXML construction.

Frank, good luck with your project -- sounds interesting. Let us know
if you think we might be able to help.

Randy Childers
OpenMethods

In <hi5imf$qjs$1@build.eclipse.org> Eric Rizzo wrote:
> You should probably familiarize yourself with the Voice Tools Project
> (http://www.eclipse.org/vtp/) - I don't think it really covers the
> area that you're talking about, but it might be something that you
> can leverage in an implementation of your idea. I'm not sure how
> active or dormant that project is, however.
>
> I've copied the VTP forum group on this reply
> (http://www.eclipse.org/forums/eclipse.technology.voicetools)
>
> Hope this helps,
> Eric
>
>
> On 1/7/10 1:41 AM, Frank Sem-Jacobsen wrote:
>> Hi,
>>
>> I am currently deciding whether it is worth my while to create a
>> project, probably within the research institution where I work, to
>> create a efficient toolkit for programming by voice.
>>
>> My main idea is some tight integration with an IDE like eclipse to
>> take care of formatting and navigating around projects, and also a
>> voice syntax and grammar to write the actual lines of code. Examples
>> of the former may be "add public integer X to class coordinates"
>> which would, regardless of the current position of the cursor, add
>> the correct variable to the correct class and return to the original
>> position of the cursor. Much of the tedious navigation and formatting
>> can be fixed this way.
>>
>> Regarding syntax and grammar, in order for this to work with multiple
>> programming languages, one would have to to identify common
>> programming constructs and create a comprehensive and uniform way of
>> dictating this.
>>
>> Does anyone know whether such projects are underways anywhere, and
>> how much interest would there be for such a project? I have found a
>> reference to an editor called VASDE which was based on Eclipse around
>> 2006. I have not found any references to this in Google.
>>
>> If it appears that no one is doing anything similar, and we agree
>> that the approach is feasible, then I would like to try to arrange it.
>> I know that some of you have tried this before with the old voicecode
>> project, but I guess it is fair to say that that is pretty dead now.
>>
>> I have just started the process of figuring out from where I may get
>> funding for such a project, and thinking that we need at least one
>> guy for a year working 100% on this in order to get anything
>> implemented at all. I think that the Eclipse integration should be
>> quite straightforward (relatively speaking), and the most time would
>> be spent on trying to create the language constructs to support it.
>>
>> This is a bit of what I'm thinking now, and I would greatly
>> appreciate any feedback/ideas/comments you might have on the subject.
>> Especially if could be useful to get in contact with those of you who
>> have tried this before.
>>
>> Best regards,
>> Frank Olaf Sem-Jacobsen, Ph.D. Postdoctoral Fellow Simula Research
>> Laboratory
>
>
Re: Programming by voice [message #507359 is a reply to message #506685] Wed, 13 January 2010 05:55 Go to previous message
Mike Greenawalt is currently offline Mike GreenawaltFriend
Messages: 10
Registered: July 2009
Junior Member
It seems to me that what Frank wants to do is not necessarily to build
on the base of the vtp project. Rather what he seems to want to do is to
build a voice application (in VXML) which itself becomes a
voice-actuated IDE for writing code in one or more traditional
programming languages. This is an interesting idea for the use of voice
recognition in the programming arena.

He would want to use the vtp to develop his voice application, which
would need to include VXML and grammars to implement actions from some
stylized language he would have to design. Then he would need to have or
have access to a voice browser on which to run the voice application.
The voice application would have all the logic of responding to voice
commands to write code implemented in Javascript. He could interface
this to an Eclipse plugin of his own design which then could manage the
resulting files of code written in the destination language. Potentially
a lot of interaction between local and remote computers.

This would be a project of considerable complexity, I think.

-- Mike

Randy Childers wrote:
> Hi Frank and Eric--
>
> The VTP project is not at all dormat, though the newsgroup doesn't see a
> lot of action. I'm not sure how useful the VTP project would be in this
> situation, but there might be a few bits of the project that would be
> useful, particularly around the VXML construction.
>
> Frank, good luck with your project -- sounds interesting. Let us know
> if you think we might be able to help.
>
> Randy Childers
> OpenMethods
>
> In <hi5imf$qjs$1@build.eclipse.org> Eric Rizzo wrote:
>> You should probably familiarize yourself with the Voice Tools Project
>> (http://www.eclipse.org/vtp/) - I don't think it really covers the
>> area that you're talking about, but it might be something that you
>> can leverage in an implementation of your idea. I'm not sure how
>> active or dormant that project is, however.
>>
>> I've copied the VTP forum group on this reply
>> (http://www.eclipse.org/forums/eclipse.technology.voicetools)
>>
>> Hope this helps,
>> Eric
>>
>>
>> On 1/7/10 1:41 AM, Frank Sem-Jacobsen wrote:
>>> Hi,
>>>
>>> I am currently deciding whether it is worth my while to create a
>>> project, probably within the research institution where I work, to
>>> create a efficient toolkit for programming by voice.
>>>
>>> My main idea is some tight integration with an IDE like eclipse to
>>> take care of formatting and navigating around projects, and also a
>>> voice syntax and grammar to write the actual lines of code. Examples
>>> of the former may be "add public integer X to class coordinates"
>>> which would, regardless of the current position of the cursor, add
>>> the correct variable to the correct class and return to the original
>>> position of the cursor. Much of the tedious navigation and formatting
>>> can be fixed this way.
>>>
>>> Regarding syntax and grammar, in order for this to work with multiple
>>> programming languages, one would have to to identify common
>>> programming constructs and create a comprehensive and uniform way of
>>> dictating this.
>>>
>>> Does anyone know whether such projects are underways anywhere, and
>>> how much interest would there be for such a project? I have found a
>>> reference to an editor called VASDE which was based on Eclipse around
>>> 2006. I have not found any references to this in Google.
>>>
>>> If it appears that no one is doing anything similar, and we agree
>>> that the approach is feasible, then I would like to try to arrange it.
>>> I know that some of you have tried this before with the old voicecode
>>> project, but I guess it is fair to say that that is pretty dead now.
>>>
>>> I have just started the process of figuring out from where I may get
>>> funding for such a project, and thinking that we need at least one
>>> guy for a year working 100% on this in order to get anything
>>> implemented at all. I think that the Eclipse integration should be
>>> quite straightforward (relatively speaking), and the most time would
>>> be spent on trying to create the language constructs to support it.
>>>
>>> This is a bit of what I'm thinking now, and I would greatly
>>> appreciate any feedback/ideas/comments you might have on the subject.
>>> Especially if could be useful to get in contact with those of you who
>>> have tried this before.
>>>
>>> Best regards,
>>> Frank Olaf Sem-Jacobsen, Ph.D. Postdoctoral Fellow Simula Research
>>> Laboratory
>>
Re: Programming by voice [message #578921 is a reply to message #506685] Wed, 13 January 2010 05:55 Go to previous message
Mike Greenawalt is currently offline Mike GreenawaltFriend
Messages: 10
Registered: July 2009
Junior Member
It seems to me that what Frank wants to do is not necessarily to build
on the base of the vtp project. Rather what he seems to want to do is to
build a voice application (in VXML) which itself becomes a
voice-actuated IDE for writing code in one or more traditional
programming languages. This is an interesting idea for the use of voice
recognition in the programming arena.

He would want to use the vtp to develop his voice application, which
would need to include VXML and grammars to implement actions from some
stylized language he would have to design. Then he would need to have or
have access to a voice browser on which to run the voice application.
The voice application would have all the logic of responding to voice
commands to write code implemented in Javascript. He could interface
this to an Eclipse plugin of his own design which then could manage the
resulting files of code written in the destination language. Potentially
a lot of interaction between local and remote computers.

This would be a project of considerable complexity, I think.

-- Mike

Randy Childers wrote:
> Hi Frank and Eric--
>
> The VTP project is not at all dormat, though the newsgroup doesn't see a
> lot of action. I'm not sure how useful the VTP project would be in this
> situation, but there might be a few bits of the project that would be
> useful, particularly around the VXML construction.
>
> Frank, good luck with your project -- sounds interesting. Let us know
> if you think we might be able to help.
>
> Randy Childers
> OpenMethods
>
> In <hi5imf$qjs$1@build.eclipse.org> Eric Rizzo wrote:
>> You should probably familiarize yourself with the Voice Tools Project
>> (http://www.eclipse.org/vtp/) - I don't think it really covers the
>> area that you're talking about, but it might be something that you
>> can leverage in an implementation of your idea. I'm not sure how
>> active or dormant that project is, however.
>>
>> I've copied the VTP forum group on this reply
>> (http://www.eclipse.org/forums/eclipse.technology.voicetools)
>>
>> Hope this helps,
>> Eric
>>
>>
>> On 1/7/10 1:41 AM, Frank Sem-Jacobsen wrote:
>>> Hi,
>>>
>>> I am currently deciding whether it is worth my while to create a
>>> project, probably within the research institution where I work, to
>>> create a efficient toolkit for programming by voice.
>>>
>>> My main idea is some tight integration with an IDE like eclipse to
>>> take care of formatting and navigating around projects, and also a
>>> voice syntax and grammar to write the actual lines of code. Examples
>>> of the former may be "add public integer X to class coordinates"
>>> which would, regardless of the current position of the cursor, add
>>> the correct variable to the correct class and return to the original
>>> position of the cursor. Much of the tedious navigation and formatting
>>> can be fixed this way.
>>>
>>> Regarding syntax and grammar, in order for this to work with multiple
>>> programming languages, one would have to to identify common
>>> programming constructs and create a comprehensive and uniform way of
>>> dictating this.
>>>
>>> Does anyone know whether such projects are underways anywhere, and
>>> how much interest would there be for such a project? I have found a
>>> reference to an editor called VASDE which was based on Eclipse around
>>> 2006. I have not found any references to this in Google.
>>>
>>> If it appears that no one is doing anything similar, and we agree
>>> that the approach is feasible, then I would like to try to arrange it.
>>> I know that some of you have tried this before with the old voicecode
>>> project, but I guess it is fair to say that that is pretty dead now.
>>>
>>> I have just started the process of figuring out from where I may get
>>> funding for such a project, and thinking that we need at least one
>>> guy for a year working 100% on this in order to get anything
>>> implemented at all. I think that the Eclipse integration should be
>>> quite straightforward (relatively speaking), and the most time would
>>> be spent on trying to create the language constructs to support it.
>>>
>>> This is a bit of what I'm thinking now, and I would greatly
>>> appreciate any feedback/ideas/comments you might have on the subject.
>>> Especially if could be useful to get in contact with those of you who
>>> have tried this before.
>>>
>>> Best regards,
>>> Frank Olaf Sem-Jacobsen, Ph.D. Postdoctoral Fellow Simula Research
>>> Laboratory
>>
Previous Topic:How to Download VTP 3.0 Source Code
Next Topic:Webservice call in openVXML
Goto Forum:
  


Current Time: Thu Mar 28 16:18:39 GMT 2024

Powered by FUDForum. Page generated in 0.01812 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top