[jawsscripts] Re: List of Unseen objects

  • From: "Matthew2007" <matthew2007@xxxxxxxxxxx>
  • To: <jawsscripts@xxxxxxxxxxxxx>
  • Date: Wed, 10 Oct 2007 22:20:16 -0700

Jeff,

Very interesting. If I'm correct, you're proposing using "prototypes" of shapes or graphics to give jaws an idea of what to look for, right? In other words, you're telling jaws: "grab any object of any size with an equal circumference and label it so I will know its a circle." Once these primitive prototypes can be generated and seen/recognized by the screen reader, one can then add various features to these prototypes and begin teaching the computer how to identify more and more complex prototypes until you get to the point where the screen reader reasons: "quadruped, bipedal locomotion, long dangling yellow colored hair, slutty walk: Pamela Anderson?"

You might want to look up "prototype-matching theory" A `3 prototype is not a rigid, specific, concrete model; it is a best-guess example of a class of related objects or patterns, which integrates all of the most typical (most frequently observed) features of the form or pattern. That is, a prototype is highly representative of a pattern but is not intended as a precise, identical match to all other patterns for which it is a model.



It is surprising that many researchers investigating perceptual prototypes have found that we seem to be able to form prototypes even when we have never seen an exemplar that exactly matches the prototype; that is, the prototypes we form seem to integrate all of the most typical features of a pattern, even when we have never seen a single instance in which all of the typical features are integrated at one time.



You might also want to look up a researcher named Irving Beiderman who came up with the notion of geons. These geons are a set of primitive shapes which all humans base their knowledge of shapes upon. Irving Biederman is professor of cognitive neuroscience at the University of Southern California. He is best known for his work in high-level vision, and in shape recognition in particular. His theory of geons shows a possible way in which various images of objects can be decomposed into a set of fundamental units. I believe these fundametnal units might then be identified and named by jaws.



Biederman, I. (1987). Recognition-by-components: A theory of human image understanding. Psychological Review, 94, 115-147.

This well-known article provides an account of Biederman's theory of how we recognize objects via basic perceptual components, which Biederman calls "geons."



Matthew

---- Original Message ----- From: "Geoff Chapman" <gch@xxxxxxxxxxxxxxxx>
To: <jawsscripts@xxxxxxxxxxxxx>
Sent: Wednesday, October 10, 2007 8:56 PM
Subject: [jawsscripts] Re: List of Unseen objects


but, also remember, that in my view anywayz, applications are getting more
and more prevalent/like this.
where just invisible arrows graphics etc, i.e. not ones that are displayed
using "standard," graphic routines to the OS, and therefore which are
invisible to jaws,
are being used as interface elements to click on to drive programs.
and that is why hotSpotClicker was invented!  to cope with these
non-scriptable, non-grabbable objects etc. or even to deal with ones that
are grabbable, in a far more straight ahead manner, than knowing how to do
it all via scripting. but, matthew be warned, after all is said and done,
there are just many many apps, that display these things, and don't, "wrap," them, to MSAA, nor anything else that I know of to easily grab and identify
in some back end way, no matter where they may move in the window, which I
know is what you desire. correct me if I am wrong scripters on this?
I'd love to be wrong, but ...

however,  hsc can bring you a lot of joy here, where the, "hotspots,"
totally invisible to jaws, do not move respectively within either their
child windows, or even in the topLevel or application windows, should their
be no useful smaller child windows to use for their relative positioning.

I am seeking to interest HSC developers in developing a more elaborate
Custom BitMap Pattern matching algorithm, whereby, "snapshots," can be taken of the particular graphic/PictureBitmap in Question, with varying degrees of user definable color variation tolerances, to cope with situations where one
needs to be able to perhaps locate a particular highlight color BitMap,
which might be written in alternately shaped BitMapped letters, in a user
definable area/window,
similar to how FindString and FindGraphic work for regular graphics today.
but, as yet I have not been able to kick start them into this. We wish to
snaffle at first anywayz, at least I do, the Back end engine for this, that AutoHotkeys has in it, but provide a far more vip friendly front end to it,
than the way AHK wants users to define the bitMap/custom graphic for
storage/location.
which is to drag it into paint and trim it and lahdiDah visual methods like
those. But it ain't here yet!

It'll be smashingly good though when it is! hsc is very, very excellent and powerful in my view. but not as powerful as we yet need to cope with toally
dynamic movable bitMap shapes like this, that are not exposed to any other
API's.


From: "Trouble" <trouble1@xxxxxxxxxxxxxxx>
To: <jawsscripts@xxxxxxxxxxxxx>
Sent: Wednesday, October 10, 2007 10:12 PM
Subject: [jawsscripts] Re: List of Unseen objects


Also just to add, try turning graphics to say all. A lot of us forget
that we run jaws in labeled graphic. Witch makes it ruff when
searching for graphics when jaws is told not to see them.

At 07:21 AM 10/10/2007, you wrote:
>Have you tried reducing the minimum size for graphics. When what you
>describe happens, it is often because the graphic that you are trying to
>click on is tiny and JAWS has been told to ignore graphics below a
certain
>size.
>
>Regards,
>Jim
>jimpanes@xxxxxxxxx
>jimpanes@xxxxxxxxxxxx
>"Everything is easy when you know how."
>
>----- Original Message -----
>From: "John Greer" <jpgreer17@xxxxxxxxxxx>
>To: <jawsscripts@xxxxxxxxxxxxx>
>Sent: Wednesday, October 10, 2007 6:53 AM
>Subject: [jawsscripts] Re: List of Unseen objects
>
>
>have you tried downloading either bx or jfw technical?
>----- Original Message -----
>From: "Matthew2007" <matthew2007@xxxxxxxxxxx>
>To: <jawsscripts@xxxxxxxxxxxxx>
>Sent: Wednesday, October 10, 2007 3:36 AM
>Subject: [jawsscripts] Re: List of Unseen objects
>
>
> >I thought about that, but from what I remember when reading the
> >documentation, hot spot clicker will only work if you already know the
> >coordinates of the spot where you would like to click. As I described
in my
> >original post, I'm referring to areas on the screen where jaws can't
seem
> >to "see" icons that are actually there, so I need something that can
pick
> >up this jaws slack. With that said, I need a method by which I won't
need a
> >sighted person to help me at all when trying to find objects on the
screen.
> >In fact, if such a method existed, it seems as none of us would need
anyone
> >as much to tell us what is on the screen since we would only have to
invent
> >the wheel once and take this type of mapping and use it for other
> >situations.
> >
> > big thanks,
> >
> > Matthew
> > ---- Original Message -----
> > From: "sean.farrow" <sean.farrow@xxxxxxxxxxxxxxxx>
> > To: <jawsscripts@xxxxxxxxxxxxx>
> > Sent: Tuesday, October 09, 2007 11:41 PM
> > Subject: [jawsscripts] Re: List of Unseen objects
> >
> >
> > Hi:
> > Hotspot clicker will dothe job:
> > www.hotspotclicker.org.
> > Hth
> > Sean.
> >
> > -----Original Message-----
> > From: jawsscripts-bounce@xxxxxxxxxxxxx
> > [mailto:jawsscripts-bounce@xxxxxxxxxxxxx] On Behalf Of Matthew2007
> > Sent: 10 October 2007 04:04
> > To: jawsscripts@xxxxxxxxxxxxx
> > Subject: [jawsscripts] List of Unseen objects
> >
> > HI all,
> >
> > When scripting an application, is there a way to get jaws to attach
some
> > sort of identifying mark to objects, icons, graphics, slider bars, or
> > anything else jaws can't see but is actually on the screen? That is,
> > when arrowing around some applications I have come across various
> > objects that jaws can't seem to identify, yet, when I ask my wife if
the
> > graphic, icon, or object is on the screen, she says "yes." A perfect
> > example is a slider bar I was trying to find on my thumb drive. I was
> > given instructions to resize the portion of the thumb drive to be
> > hidden, but I couldn't find the slider's arrow used to shrink the
folder
> > as I didn't want 50% of a 4 gb thumb drive encrypted. I asked my wife
to
> > place the mouse cursor on the arrow and I moved around and discovered
> > that jaws couldn't read it. Jaws just said: "Blank."
> >
> > In other words, I'm asking if it is at all possible to write some > > sort
> > of script or code that will take each and every graphic, icon, or
object
> > jaws cannot see and mark it with a unique character or string of
> > characters so that jaws can see it in the future, then hit a hotkey > > to
> > place these objects in a list view in order to manually label each
> > object one by one. Basically, rather than having to hunt each item
down
> > all over the screen and label each one separately, I can write a
custom
> > label for each object all at once.
> >
> > Can any of this be done? If at least somewhat possible please give me
a
> > hint as to how to find these invisible objects.
> >
> > Thanks,
> >
> > Matthew
> >
> >
> > __________
> > View the list's information and change your settings at
> > http://www.freelists.org/list/jawsscripts
> >
> > __________
> > View the list's information and change your settings at
> > http://www.freelists.org/list/jawsscripts
> >
> >
> > __________ NOD32 2582 (20071009) Information __________
> >
> > This message was checked by NOD32 antivirus system.
> > http://www.eset.com
> >
> >
> > __________ View the list's information and change your settings at
> > http://www.freelists.org/list/jawsscripts
> >
> >
>
>__________
>View the list's information and change your settings at
>http://www.freelists.org/list/jawsscripts
>
>
>__________
>View the list's information and change your settings at
>http://www.freelists.org/list/jawsscripts

Tim
trouble
"Never offend people with style when you can offend them with substance."
--Sam Brown

Blindeudora list owner.
To subscribe or info: http://www.freelists.org/webpage/blindeudora


__________
View the list's information and change your settings at
http://www.freelists.org/list/jawsscripts

__________
View the list's information and change your settings at
http://www.freelists.org/list/jawsscripts


__________ NOD32 2585 (20071010) Information __________

This message was checked by NOD32 antivirus system.
http://www.eset.com



__________ 
View the list's information and change your settings at http://www.freelists.org/list/jawsscripts

Other related posts: