Onboard and MouseTweaks during GDM

Introduction

People using Ubuntu 7.10 and that need an onscreen keyboard now have a way to start the onscreen keyboard called onboard during their GDM session.

Moreover, if they cannot click with a hardware button, they can also enable dwelling (i. e. a software click) by starting an utility called mousetweaks during their GDM session.

Please, have a look at the following picture to see the onscreen keyboard called onboard and the dwelling application called mousetweaks run alongside the Plain interface of GDM (called gdmlogin):

inline:GDMLoginWithOnboardAndDwelling.png

Remark: I have been told that this is currently not possible with the themed greeter, because it is not able to handle other applications using a gui. Consequently the following will be restricted to the plain greeter.

Remark2: I have filed the following Request For Enhancement bug to make onboard and mousetweaks also available for the themed greeter: https://bugs.launchpad.net/ubuntu/+source/gdm/+bug/130368

Updated versions of onboard and mousetweaks

Onboard

Currently, Ubuntu 7.10 (which is still in its development phase) is still shipping version 0.87 of onboard. However version 0.88 of onboard is needed. The author of onboard was so kind to provide a debian package of version 0.88 for the i386 architecture, that you can use to replace the version shipped currently with Ubuntu 7.10. You can get it by clicking on the following link:

attachment:onboard_0.88_gutsy_i386.deb

The source code of onboard is hosted on Launchpad: https://launchpad.net/onboard

MouseTweaks

Mousetweaks is a new utility whose implementation has begun this summer as a GSoC 2007 project for Ubuntu. It is not part of the repositories of Ubuntu 7.10 yet; but it is planned to become part of it. Here you can download the debian package for the i386 architecture that I built from the current version kindly provided by its author. Please, click on the following link to download the package:

attachment:mousetweaks_0.3.0_gutsy_i386.deb

The source code of mousetweaks will soon be available on Launchpad.

Add new gestures to GDM in order to start onboard and mousetweaks

When the Accessibility features are enabled for the Login Window, the plain greeter steadily monitors the movement of the pointer in the background. When it recognises a gesture that has been defined in the gesture configuration file, it starts the application associated with that gesture:

Add the gesture to start onboard to the gesture configuration file

Open a terminal and type the following to open the gesture configuration file:

sudo gedit /etc/gdm/modules/AccessDwellMouseEvents

The following line defines a new the gesture and associates it to onboard:

RBLT I 10000    /usr/bin/onboard --size 500x190 -x 20 -y 10

Please add it above the following line that is already in the gesture configuration file:

TBLR I 10000    /usr/bin/gok --login --access-method=directselection

Save and close gedit.

Add the gesture to start mousetweaks to the gesture configuration file

Similar to onboard, the following line defines another new gesture and it associates it to mousetweaks. Please add it to the gesture configuration file; right below the line for onboard:

RTLB I 10000    /usr/bin/mousetweaks --enable dwell --show-ctw --ctw-x 550 --ctw-y 10

Remark: As mousetweaks is not installed by default during the Ubuntu installation, you have to install it yourself; for example by using the Synaptic Package Manager. (At the moment of this writing, it is not included in the Ubuntu repository; but once Ubuntu 7.10 has been released, it should be in the Universe repository.)

Enable Assistive Technology and Set Plain Theme

For GDM to monitor the pointer for gestures, you have to configure it to use its plain greeter and enable the accessibility features. The Login Window under the menu System->Administration of the normal gnome session allows you to perform the appropriate configuration.

• First enable Assistive Technology in the Accessibility tab of the Login Window:

inline:LoginWindowAccessibilityTab.png

• Unfortunately, the accessibility features do not work with the default gdm-theme used by Ubuntu. You have to set gdm to use its Plain theme in the Style menu under the Local tab:

inline:LoginWindowLocalTab.png

How to start onboard

During the GDM session, a background process steadily monitors the pointer to detect determined gestures that are associated with specific programs. On the following picture you can see the gesture that the pointer has to perform in order to start of onboard:

inline:gdmlogin-onboard-gesture.png

What matters in the gesture, is:

• what edges of the GDM window are crossed
• the sequence of the crossed edges
• if the first edge is crossed from the outside to the inside, or from the inside to the outside
• no more than 10 seconds must elapse between the crossing of one edge and the crossing of the next edge
• it does not matter if the pointer moves in straight lines (like in the sample above) or in curves; the only thing that matters is the edge crossing

For onboard this means:

• the pointer has to begin by crossing the right edge from the GDM window from the outside to the inside
• then it has to cross the top edge from the inside to the outside
• then it has to cross the left edge from the outside to the inside
• finally it has to cross the bottom edge from the inside to the outside

If no more than 10 seconds did elapse between two consecutive edge crossings, the onscreen keyboard onboard will appear at the top-left of the screen.

How to start mousetweaks

It is also possible to start dwelling with a gesture during the GDM session. (provided the gesture has been defined, that Assistive Technology has been enabled for GDM, and that the Plain theme is used)

Gesture to start mousetweaks for dwelling:

inline:gdmlogin-mousetweaks-gesture.png

For explanations about how to interprete this picture, please have a look at the Starting of onboard above.

CategoryNeedsExpansion