http://www.amtelcom.com/Mosaic/userguide.html
Gesture Mosaic User Guide
Copyright c Mosaic Input Technologies, Inc., April 1995
Printed in U.S.A. All rights reserved.
Based on software version 2.01f. Substantially correct for other versions.
Gesture Mosaic is a fast, accurate way to enter letters and numbers on a Personal Digital Assistant such as the Apple Newton. Characters are written by making a short gesture on the Mosaic, a template based on the figure eight.
A gesture is a stroke drawn with the pen in a curved or straight line. Gestures are made either by connecting two adjacent segments (starting in one segment and ending in another), or by drawing a line within a single segment (starting in one segment and ending in that same segment). The gesture for each character is derived from the shape of that character as it is familiarly known. Specifically it is derived from a block form of the capital letter. Thus when making a gesture, the user is essentially drawing a small portion (an outstanding feature) of the character as it would appear in the mosaic. This makes Gesture Mosaic a easy system to learn and remember.
Another important aspect of the Gesture Mosaic is that it contains recognition routines which can often interpret imperfect gestures. Because the gestures are so short, and the recognition algorithms allow for significant variance, text can be entered into a PDA at a considerable rate. A speed of 30-40 words per minute is not uncommon. Many people who see Gesture Mosaic for the first time, conceptualize it as a shorthand method. Another way to think of it is as a hybrid keyboard/recognition system ("the keyboard of the future") specifically designed for pen input.
The program requires a Newton Connection Kit for a Macintosh computer, or an IBM compatible computer running Microsoft Windows. The memory for Gesture Mosaic and Rapid Fire are as follows:
Keep these memory requirements in mind when selecting the files to install.
The Gesture Mosaic is started the same as most other programs on the Newton. Turn your Newton on and tap on the extras icon at the bottom of the screen. A display of icons will appear listing all the accessible software. The Gesture Mosaic icon; is a small mosaic (digital '8') labeled GM. Start it by tapping its icon with the pen.
Notice that the Gesture Mosaic screen takes up less than 1.5 square inches,
leaving plenty of room to view your writing. The screen is designed to float
above all other screens so it should always be accessible. The screen can be
moved (dragged) by:
You can also shrink (or minimize) the Gesture Mosaic. The Shrink button is located in the upper left hand corner of the Gesture Mosaic screen. When you tap on this, the Gesture Mosaic shrinks down to a small box with an M in the middle.
The minimized Mosaic can be moved by pressing the pen on the gray border, moving the pen to the preferred location, and releasing the pen. To return to regular size, you just tap the pen on the M in the middle of the minimized Mosaic.
The Mosaic is a intuitive entry device, based on simple graphical fundamentals. Many people will learn the Gesture Mosaic just by glancing at the illustrations in this chapter and then going right to the quick reference card or simply by playing the tutorial game, Rapid Fire.
Once you are familiar with the Gesture Mosaic (able to remember the gestures for all the letters), move ahead to the chapter entitled Efficient Entry. To begin using the Gesture Mosaic, work through the alphabet a few times. You will begin to learn the proper gestures. Then, over time, you will be able to immediately associate a letter with its corresponding gesture. Another great way to learn the Gesture Mosaic basics is to play the tutorial game, Rapid Fire.
Letters are created on the Mosaic template, the large figure that resembles an 8. To write a letter, you make what is called a Gesture, which is a short line drawn on the Mosaic template. The gesture will be drawn to connect two segments, or drawn within a single segment.
Tap on the screen to position the cursor. Then try out the following gestures.
Note how the gestures are drawn: some with a curve, some as a straight line. For maximum accuracy, draw a curved gesture when the help diagram shows a curve, and a straight line when the help diagram shows a straight line.
The gesture is derived from the letter it creates. This makes it easier to remember the gesture for each letter. The following shows how the gestures correspond to three letters: N, B, and E. Notice how the gestures are a small segment of the letter they correspond to.
In the next illustration, the gesture is superimposed on the mosaic template. It is important to notice which segment the gesture begins in. It is also important which segment the gesture ends in. The following illustration shows the gestures being drawn in with the arrow showing the end point of the line. Notice the B is drawn with a curved line, and the E (or any other horizontal gesture) is drawn within a single segment.
Notice the thin lines that connect the various segments on the mosaic. These are called Gesture Guides and indicate the path of every Gesture. You can draw a gesture simply by tracing the gesture guide in the proper direction. The previous illustrations show the gestures drawn perfectly. However, gestures can be drawn less than perfectly and still register the correct letter. At some point accuracy will be affected, so try to stay close to the perfect gesture.
Number are entered in the same manner that letters are entered. The only difference is that the Number Lock button must be pressed first for numeric entry. The Number Lock button is highlighted when on.
You should practice going through the numbers 0-9 until you are familiar with the corresponding Gestures.
If necessary, tap on the screen to position the cursor. Tap on the Number Lock button. Then try out the following gestures.
The shortcut for creating a space also works when the Number Lock is on:
The purpose of the Instant Punctuation box is to provide a fast way to create common punctuation marks. Numerous punctuation marks are accessed by drawing a line or tapping on the box. Start the line in the middle of the box and draw it in the appropriate direction. Continue the line until it extends beyond the border of the box.
End of Sentence Period - Produces a period, two spaces, and a shift to capitalize the next letter. The second letter is automatically back to lower case.
Other punctuation marks and useful symbols are entered by an on screen keypad. The keypad appears when the Punctuation Keypad button (pictured below) is tapped.
A symbol is entered by tapping in the square the symbol appears in. Cancel without entering a symbol by tapping the empty box in the lower right. The keypad is closed automatically after a symbol is chosen. The Punctuation Keypad is organized to put related symbols together. The following diagram shows how symbols are grouped, making them easier to find.
Space, Delete, Return, Shift, Caps Lock
The movements of the cursor are controlled from this button. These functions are accomplished by drawing a line on the button. Start in the middle of the box. Draw in the appropriate direction and end outside the box.
You can also place the cursor anywhere in existing text by tapping the position where you want it to appear.
The shift function capitalizes only one letter. After you draw the upward line, the Cursor Movement box will be highlighted.
The next letter will be capitalized and the Cursor Movement box will return to normal appearance. The next letter you create will appear in the lower case.
The Caps Lock draws capital letters continually. It is like the Caps Lock key on a computer keyboard. Set the Caps Lock by drawing two consecutive lines upward from the center of the Cursor Movement box. The Cursor Movement box is highlighted. A white circle in the upper left corner of the Cursor Movement box indicates the Caps Lock is set.
To disengage the Caps Lock, draw another line upward from the center of the Cursor Movement box.
Entry will return to lower case.
The Information button displays help for writing letters and numbers. It also closes Gesture Mosaic and displays information about Gesture Mosaic's developer, MIT (Mosaic Input Technologies).
Tap the information button. The Information menu is displayed.
For help writing letters, go to the Information menu and select ABC's Help.
The Help Alphabet is displayed.
The Help Alphabet shows you how to draw the gesture for each letter. Tap a letter and observe the gesture that is displayed on the mosaic. Trace the gesture as indicated by the arrow on the mosaic. When the Help Alphabet is displayed, it blocks access to the standard Space and Delete functions. Instead for:
For help writing numbers, at the Information menu, tap123's Help.
The Help Integers are displayed.
The Help Integers show you how to draw the gesture for each number. Tap a number and observe the gesture that is displayed on the mosaic. Trace the gesture as indicated by the arrow on the mosaic. When the Help Integers are displayed, it blocks access to the standard Space and Delete functions. Instead for:
Often you can leave Gesture Mosaic minimized when you are not using it. But you can also close the program.
Tap the information button.
The Information menu is displayed.
To close Gesture Mosaic, tap Close GM. Gesture Mosaic is cleared from the screen.
This section includes hints and tips for learning and using Gesture Mosaic quickly and efficiently.
At first, picture and say the letters individually in your mind as you draw gestures. This will help you think of the shape of the letter and relate it to the corresponding gesture. Soon you will no longer need to think of the shape of the letter. The letter will call up the gesture automatically in your mind. When you become proficient, move on to words and sentences. Soon you will begin to think at the word level in groups of gestures, rather than letter by letter.
For example, an A is written by drawing an upward line connecting the two leftmost vertical segments of the mosaic. But the following illustration shows variations that will also produce an A:
Generating a letter is accompanied by a higher-pitched clicking sound. Generating a number is accompanied by a lower-pitched sound similar to typing on an electric typewriter.
Rapid Fire is started the same as most other programs on the Newton. Turn your Newton on. Locate the Extras Drawer icon. When you press on the Extras Drawer icon, you will get a display of icons listing all the accessible software. The Rapid Fire icon is a small mosaic labeled Rapid Fire. Start it by tapping its icon with the pen.
Rapid Fire is displayed.
The text field can be edited by pressing the delete button or by pressing the Clear button. When you correctly enter a word, the text field is automatically cleared. This allows you to continue and enter the next word without interruption. If a word that you are working on scores a hit (makes it through your entire shield, the text field has to be reset manually. Do this by tapping the Clear button before entering the next word. Scoring is based on the length of the word, how quickly the word is entered, and the current level. There is also a bonus given at the end of the game based on how much of the shield remains.
This section describes some situations that could occur and some suggestions for dealing with them.
This typically means that the Newton has run out of memory (RAM). It may be accompanied by the following message: The application does not have enough memory right now...Restarting Newton may fix the problem. If this warning is displayed, click the appropriate button to restart your Newton. Otherwise do a soft restart by pressing the Reset button under the battery cover on the back. Be sure to do a soft restart.
Typically this means that Gesture Mosaic is covered by another program. Gesture Mosaic is designed to be the topmost program running to maintain access to the mosaic. But other programs may also claim the top position. The solution is to close other programs until Gesture Mosaic reappears.
If you need to open the Newton's built in keyboard, first minimize or close Gesture Mosaic.
To find out more about Mosaic Input Technologies, contact brian@amtelcom.com, or call 608/838-4194.
Copyright © 1995 American-Tele-Systems Inc.