And yet it is my understanding that webvisum, the Firefox add-on, does
precisely this in order to solve captchas.
Rod
-----Original Message-----
From: Talk
[mailto:[email protected]] On
Behalf
Of Aaron Smith via Talk
Sent: November 6, 2015 12:45 PM
To: [email protected]; Window-Eyes Discussion List
<[email protected]>
Subject: RE: Virtual View User's Guide
Captchas are design to elude OCR, so, probably not.
Thanks,
Aaron
--
Aaron Smith
Web Development * App Development * Product Support Specialist
Ai Squared * 725 Airport North Office Park, Fort Wayne, IN 46825
260-489-3671 * www.aisquared.com
To insure that you receive proper support, please include all past
correspondence (where applicable), and any relevant information
pertinent
to
your situation when submitting a problem report to the Ai Squared
Technical
Support Team.
-----Original Message-----
From: Joe Paton [mailto:[email protected]]
Sent: Friday, November 6, 2015 12:42 PM
To: Aaron Smith <[email protected]>; Window-Eyes Discussion List
<[email protected]>
Subject: Re: Virtual View User's Guide
Thanks Aaron.
One question if I may, will virtual view work with graphic capchas?
Great job, and thanks for taking the trouble.
Joe Paton
On Fri, 6 Nov 2015 16:14:16 +0000
Aaron Smith via Talk <[email protected]> wrote:
Greetings,
The following user's guide will ship with the next version of Virtual
View, but I
wanted to provide it for you here as many of you have been asking for
more
information about what Virtual View is, and how to use it.
Thanks,
Aaron
Virtual View
1 Overview
Virtual View is an app designed to provide a textual representation
of a
program window, dialog box, message box or file using various text
retrieval
methods. The resulting text can be reviewed in the Virtual View window
without disturbing the contents of the screen or file. In some
cases, the
buttons, links and other controls found in the original window that
was
virtualized can be acted on directly from the Virtual View window
using
simple keyboard commands.
This app will come in handy in a variety of situations including:
* Reading image based PDF files
* Reading text presented as an image
* Selecting and copying static text found in dialogs and
program
windows
* Interacting with programs that lack proper keyboard
accessibility
* Needing quick access to the text found in a PowerPoint
presentation
2 Getting Started
The default hotkey, Control-Alt-V, will open the source selection
dialog.
You
may also choose to access Virtual View from the Apps menu in the
Window-
Eyes Control Panel. Virtual View may also be activated by pressing
Alt-Print
Screen. Alt-Print Screen is an operating system hotkey that takes a
snapshot
of the active window. You have the option of letting Virtual View
virtualize
this image when the hotkey is pressed.
3 Selecting a Source
Pressing the Virtual View hotkey, or choosing Virtual View from the
apps
menu, will cause the "Select Window or File to Virtualize" dialog
to be
displayed. You can use this dialog to tell Virtual View what you
want to
virtualize. You may choose from one of three sources:
1. Active Window (A) - Selecting this radio button will cause
the
current
application window to be used as the source.
2. Focused Window (F) - Selecting this radio button will
cause the
current
control in the active application to be used as the source.
3. File (I) - Selecting this radio button will cause Virtual
View
to
prompt for
a file using a standard Windows File Open dialog.
3.1 Supported File Types
Virtual View has the ability to virtualize a large number of file
types.
Exactly
which files can be virtualized depends on the number of available file
"filters"
installed in your operating system. Filters are programmatic
interfaces
for
accessing contents of files. Several filters come pre-installed
with your
operating system. The most common file types include:
* Text
* XML
* HTML
* Zip
Installing Microsoft Office provides you with additional filters
allowing
Virtual
View to virtualize many Office document formats, including:
* Docx
* Xlsx
* Pptx
4 Choosing a Method
After you've selected a source, whether it be a window or a file,
you can
then choose how you want Virtual View to obtain the text from the
source.
The methods available will differ depending on which source type is
selected.
1. Clips (C) - The clips method will use the OSM (Off-Screen
Model)
to
retrieve text from a window.
2. UIA (A) - This UIA method will use the UI Automation
interface
to
retrieve text from a window.
3. OCR (O) - This method uses OCR (optical character
recognition)
to
retrieve text from either a window or a file.
4. Version (V) - This method provides version information for a
window or
file.
Which method you choose depends on a number of factors, and there are
advantages of each.
Clips is the most common method for accessing the text of a window.
They
provide a good way for accessing precise locations of text for easy
manipulation with Virtual View's quick keys (discussed below).
The advantage of using UIA is evident when obtaining text from windows
that do not show up in the OSM. WPF applications, and other Direct2D
programs, are good examples of windows that have rich UIA information
while at the same time are completely void of clips. The UIA method
obtains
text directly from the window rather than from the OSM, often
resulting
in
higher text accuracy.
OCR is a preferred choice when working with graphical interfaces, or
files
containing images. While you don't have the benefit of knowing exactly
where the text is presented on the screen, you do have access to
otherwise
completely inaccessible text.
5 The Virtual View Window
After Virtual View has obtained the text from the selected source,
using
the
chosen method, it will display the resulting text in a read only edit
box.
The
Virtual View dialog contains a menu bar with the following options:
* File (F)
o Open (O) - Control-O - Opens support file types.
o Save (S) - Control-S - Saves current text.
o Exit (X) - Exits Virtual View
* Edit (E)
o Select All (S) - Control-A - Select all of the text.
o Copy All (C) - Copies all of the text to the clipboard.
o Copy Selection (O) - Control-C - Copies the selected text to the
clipboard.
o Append All (A) - Appends all of the text to the clipboard
contents.
o Append Selection (P) - Appends the selected text to the clipboard
contents.
* View (V)
o Clips (C) - Switches to the Clips method of accessing text.
o UIA (U) - Switches to the UIA method of accessing text.
o OCR (O) - Switches to the OCR method of accessing text.
* Help (H)
o Help and Options (H) - Displays options for controlling Virtual
View's
text
recognition characteristics. Refer to Additional Options discussed
below
5.1 Quick Keys
Virtual View provides several "quick" keys that you can use to
interact
with
the text, and have that interaction passed on to the window where the
text
originated. For example, if a button called Close exists in the window
where
you obtained the text from, you can place your cursor on the word
Close,
and press the letter L to activate the Close button. Available
quick keys
are:
* L - Single Left Click
* R - Single Right Click
* D - Double Left Click
* M - Middle Click
* P - Route Mouse
* F - Focus Control
While these quick keys are always available, they are most useful with
Clips,
and become less useful when using the UIA and OCR, as the correlation
between text and originating window is less reliable with those
methods.
6 Additional Options
The Help and Options dialog contains the following options for
controlling
how Virtual View behaves and how it processes images using the OCR
method:
* Include Labeled Graphics (I) - Check box - Default
unchecked -
Checking
this option will cause Virtual View to include labeled graphics when
obtaining
text using the Clips method.
* Include Window Types (N) - Check box - Default unchecked -
Checking
this option will cause Virtual View to include windows types (edit
box,
button, etc.) when obtaining text using the Clips method.
* Always Ask for Window Type (L) - Check box - Default
checked -
This
option controls whether or not you're initially asked for a source and
method
when pressing the Virtual View hotkey.
* Prompt When Alt-Print Screen Is Pressed (P) - Check Box -
Default
checked - This option controls whether or not you're prompted to have
Virtual View virtualize the image that's captured by the operating
system
when the Alt-Print Screen hotkey is pressed.
* Enable Image Processing (E) - Check box - Default
unchecked -
Enables
or disables additional image processing for enhancing the results
of text
recognition when using the OCR method.
* Contrast (C) - Up/Down Control - Default 50 - This
control is
only
enabled when Enable Image Processing is checked, and controls the
contrast
of the image before text processing occurs. A lower number will
produce a
darker image, while a higher number will produce a lighter image.
* Resize Multiplier (R) - Up/Down Control - Default 1 - This
control is only
enabled when Enable Image Processing is checked, and controls the
final
size
of the image before text processing occurs. A larger number will
increase
the
dimensions of the image, but also increases the size of the file, and
could
result in decreased improvement.
* Use Grayscale (U) - Check box - Default unchecked - This
control
is only
enabled when Enable Image Processing is checked, and controls
whether or
not the image is in color or black and white before text processing
occurs.
* Save Image (S) - Check box - Default unchecked - This
control
is
only
enabled when Enable Image Processing is checked, and will save the
last
OCR'd image to the %temp% directory. This is only useful for debugging
purposes.
* Reset Defaults (T)- Button - This control will reset the
options
to the
factory defaults.
* Help - Button - This control will display the default app
help,
which
includes this help text, app version details, and the Hotkey
Manager for
controlling the default Virtual View hotkey.
7 A Note About Elevation
By default, Virtual View can only access windows that are not
elevated,
or
opened as a non-administrative user. You can control this behavior by
checking the Require UAC (R) check box in the initial source selection
dialog.
When checked, Virtual View will become elevated, and will then be
able to
access elevated windows.
8 Troubleshooting
Virtual View's OCR capabilities require operating system components
that
may not be installed by default. If you find that you're consistently
getting
"No text found" after using the OCR method, try re-installing the TIFF
IFilter
by doing the following:
1. Open an admin command prompt.
a. You can do this by opening the start menu, typing cmd,
pressing
Control-Shift-Enter, and (assuming you have the User Account Control
feature enabled) confirming the UAC prompt.
2. In the command prompt window, enter the following:
dism /online /Enable-Feature /FeatureName:TIFFIFilter
3. Press enter, and wait for the command to complete. When it's
finished,
type exit, and press enter.
4. Reboot
Virtual View currently supports Windows 7 and up. There does, however,
seem to be an issue with Windows 8.1 where the OCR capabilities are
not
available, even though they have been enabled. Some users have
reported
success by following the steps outlined in the following Microsoft
Technet
article:
https://technet.microsoft.com/en-us/library/dd744701%28v=ws.10%29.aspx
--
Aaron Smith
Web Development * App Development * Product Support Specialist Ai
Squared * 725 Airport North Office Park, Fort Wayne, IN 46825
260-489-3671 * www.aisquared.com
To insure that you receive proper support, please include all past
correspondence (where applicable), and any relevant information
pertinent
to your situation when submitting a problem report to the Ai Squared
Technical Support Team.
_______________________________________________
Any views or opinions presented in this email are solely those of the
author
and do not necessarily represent those of Ai Squared.
For membership options, visit http://lists.window-
eyes.com/options.cgi/talk-window-eyes.com/joe%40vi-ability.demon.co.uk.
For subscription options, visit
http://lists.window-eyes.com/listinfo.cgi/talk-
window-eyes.com
List archives can be found at
http://lists.window-eyes.com/private.cgi/talk-
window-eyes.com
--
Joe Paton <[email protected]>
_______________________________________________
Any views or opinions presented in this email are solely those of the
author
and do not necessarily represent those of Ai Squared.
For membership options, visit
http://lists.window-eyes.com/options.cgi/talk-window-eyes.com/rod_hutton%40h
otmail.com.
For subscription options, visit
http://lists.window-eyes.com/listinfo.cgi/talk-window-eyes.com
List archives can be found at
http://lists.window-eyes.com/private.cgi/talk-window-eyes.com
_______________________________________________
Any views or opinions presented in this email are solely those of
the author
and do not necessarily represent those of Ai Squared.
For membership options, visit
http://lists.window-eyes.com/options.cgi/talk-window-eyes.com/huber.kevin7%40gmail.com.
For subscription options, visit
http://lists.window-eyes.com/listinfo.cgi/talk-window-eyes.com
List archives can be found at
http://lists.window-eyes.com/private.cgi/talk-window-eyes.com