[jawsscripts] Re: Scripting Avaya One-X Agent

  • From: Soronel Haetir <soronel.haetir@xxxxxxxxx>
  • To: jawsscripts@xxxxxxxxxxxxx
  • Date: Fri, 8 Nov 2013 11:49:07 -0900

Looking at the manifest embedded in AccessibleObjectTools.dll,
"FreedomSci.AccessibleTree" is the only comClass element with a progId
attribute.

There is also an IDL style definition for IAccessibleObject in
HomerowUIAObject.jss in the shared scripts directory.

The only other file I was able to find in the jaws progream directory
that contains an embedded type library is UIAScriptAPI.dll, which can
be used to create objects with progid "FreedomSci.UIA".

On 11/8/13, Jim Bauer <holdsworthfan@xxxxxx> wrote:
> If you did, I never saw it. :-) I for one would find a summary of this
> lib useful.
>
>
> On 11/8/2013 12:14 PM, Doug Lee wrote:
>> My first method of doing this was to find the DLL and open it in
>> Word's VBA COM viewer. More recently I wrote something that creates a
>> summary of a COM lib's properties and methods. It's not perfect and I
>> didn't write it in a very easily portable way, but sometimes I've used
>> it to produce a usage summary to post here. I think I already did that
>> for this lib, but if not and you need it, write back here and I'll
>> post one to this list again.
>>
>> On Fri, Nov 08, 2013 at 11:27:24AM -0500, John Robichaud wrote:
>> Doug,
>> How do you find the COM typelib information for the accessibleTree?
>> John
>>
>> -----Original Message-----
>> From: jawsscripts-bounce@xxxxxxxxxxxxx
>> [mailto:jawsscripts-bounce@xxxxxxxxxxxxx] On Behalf Of Doug Lee
>> Sent: Tuesday, October 29, 2013 5:49 AM
>> To: jawsscripts@xxxxxxxxxxxxx
>> Subject: [jawsscripts] Re: Scripting Avaya One-X Agent
>>
>> I found the VS FS code for getting an accessibleObjectTree and wrote code
>> based on that to get one of those. Then I examined the COM typelib
>> information for those objects to find out what I could do with them.
>>
>> On Tue, Oct 29, 2013 at 09:13:23AM +0200, Stefan Moisei wrote:
>> It's very unfortunate that UIA scripting is not documented at all. An
>> increasing number of applications use it. Ironically, I think NVDA
>> provides
>> a better scripting support for it, once you get past the initial details.
>> Still, Doug, did you use only the functions found in visual studio
>> scripts,
>> or did you find about others from some UIA interfaces?
>> Thanks.
>> www.Vortex.IM
>> -----Original Message-----
>> From: Doug Lee
>> Sent: Saturday, October 26, 2013 11:37 AM
>> To: jawsscripts@xxxxxxxxxxxxx
>> Subject: [jawsscripts] Re: Scripting Avaya One-X Agent
>>
>> When I coded that part of BX, I used FS scripts  for, I believe, Visual
>> Studio as a reference.
>>
>> On Sat, Oct 26, 2013 at 09:22:02AM +0200, Bram Duvigneau wrote:
>> John,
>> I've had some discussion about this earlier on the list when I was
>> struggling with the MSAA functions and getting no usable results. The
>> idea
>> to use this COM object came from the BX Utilities source code.
>> However, I still haven't found any official documentation what so ever
>> about
>> this mechanism, which is to bad because we'll need it more and more in
>> the
>> future.
>>
>> Bram
>> On 26-10-2013 3:53, John Robichaud wrote:
>>> Bram,
>>> In your example, how did you determine the COM class for the first
>>> parameter and the manifest file for the third parameter in
>>> CreateObject Ex?
>>> John Robichaud
>>>
>>> -----Original Message-----
>>> From: jawsscripts-bounce@xxxxxxxxxxxxx
>>> [mailto:jawsscripts-bounce@xxxxxxxxxxxxx] On Behalf Of Bram Duvigneau
>>> Sent: Friday, October 25, 2013 3:01 AM
>>> To: jawsscripts@xxxxxxxxxxxxx
>>> Subject: [jawsscripts] Re: Scripting Avaya One-X Agent
>>>
>>> Hello,
>>> I recently scripted another Avaya product and only got access to the
>>> controls through UIA. Please see the simple function below that I used
>>> to display incoming call notifications in a message box:
>>>
>>> Void Function HandleIncomingCall ()
>>> var object builder = createObjectEx("FreedomSci.AccessibleTree",
>>> False, "AccessibleObjectTools.x.manifest"),
>>>      object o = builder.Build(hCallWindow),
>>>      String title,
>>>      String callType,
>>>      String caller,
>>>      String message
>>>
>>>      let o = o.firstChild
>>>
>>>      let title = FormatString("%1", o.Name)
>>>
>>>      let o = o.nextSibling
>>>      let o = o.nextSibling
>>>      let o = o.nextSibling
>>>      let callType = o.Name
>>>
>>>      let o = o.nextSibling
>>>      let caller = o.Name
>>>
>>>      let message = FormatString("%1: %2", callType, caller)
>>>
>>>      ExMessageBox (message, title, MB_OK) EndFunction
>>>
>>>
>>> Good luck,
>>>
>>> Bram
>>> On 25-10-2013 6:18, Jitendra wrote:
>>>> Well, I don't know if you can get any fruit out of it, but Dlee.org
>>>> and download the audio player scripts from there, and look the time
>>>> module code, if you have several windows, you may reach them, and for
>>>> MSAA, you may download the skype scripts, and examine the code to
>>>> work with objects.
>>>> if it does not help, and the software is trial or free to download, I
>>>> can try helping you.
>>>> Thanks, Jitendra, India.
>>>> John Robichaud wrote:
>>>>> Wondering if anyone has attempted scripting Avaya One-X Agent
>>>>> version
>>> 2.5.
>>>>> This is a telphone control system.
>>>>> Although Avaya's controls are spoken accurately when tabbing through
>>>>> the interface, I've been unsuccessful in creating scripts to provide
>>>>> direct access to each control.
>>>>>
>>>>> Using Jaws script utility mode, all controls exhibit the same handle
>>>>> and control ID.  Class throughout is given as
>>>>> HwndWrapper[OneXAgentUI.exe;;7b95d218-e604].  Utility mode does give
>>>>> an unique Object ID, Object Name, and Object Type for each control
>>>>> but I've not been able to use that info to reach the controls. Can
>>>>> anyone suggest an approach?
>>>>>
>>>>> John Robichaud
>>>>>
>>>>>
>>>>>
>>>>> __________???
>>>>>
>>>>> View the list's information and change your settings at
>>>>> http://www.freelists.org/list/jawsscripts
>>>>>
>>>>>
>>>>>
>>>> --- Disclaimer --- The information in this mail is confidential and
>>>> is intended solely for addressee. Access to this mail by anyone else
>>>> is unauthorised. Copying or further distribution beyond the original
>>>> recipient may be unlawful. Any opinion expressed in this mail is that
>>>> of sender and does not necessarily reflect that of State Bank group.
>>>> --- __________???
>>>>
>>>> View the list's information and change your settings at
>>>> http://www.freelists.org/list/jawsscripts
>>>>
>>>
>>>
>>> __________???
>>>
>>> View the list's information and change your settings at
>>> http://www.freelists.org/list/jawsscripts
>>>
>>> __________???
>>>
>>> View the list's information and change your settings at
>>> http://www.freelists.org/list/jawsscripts
>>>
>>
>>
>>
>> __________???
>>
>> View the list's information and change your settings at
>> http://www.freelists.org/list/jawsscripts
>>
>> --
>> Doug Lee, Senior Accessibility Programmer SSB BART Group -
>> Accessibility-on-Demand mailto:doug.lee@xxxxxxxxxxxxxxxx
>> http://www.ssbbartgroup.com "While they were saying among themselves it
>> cannot be done, it was done." --Helen Keller __________???
>>
>> View the list's information and change your settings at
>> http://www.freelists.org/list/jawsscripts
>>
>> __________???
>>
>> View the list's information and change your settings at
>> http://www.freelists.org/list/jawsscripts
>>
>> --
>> Doug Lee, Senior Accessibility Programmer SSB BART Group -
>> Accessibility-on-Demand mailto:doug.lee@xxxxxxxxxxxxxxxx
>> http://www.ssbbartgroup.com "While they were saying among themselves it
>> cannot be done, it was done." --Helen Keller __________o?=
>>
>> View the list's information and change your settings at
>> http://www.freelists.org/list/jawsscripts
>>
>> __________???
>>
>> View the list's information and change your settings at
>> http://www.freelists.org/list/jawsscripts
>>
>
> __________�
>
> View the list's information and change your settings at
> http://www.freelists.org/list/jawsscripts
>
>


-- 
Soronel Haetir
soronel.haetir@xxxxxxxxx
__________�

View the list's information and change your settings at 
http://www.freelists.org/list/jawsscripts

Other related posts: