Warning: fopen(/var/www/web438/html/multi-touch/engine/cache/system/cron.php): failed to open stream: Operation not permitted in /var/www/web438/html/multi-touch/engine/modules/functions.php on line 280
Warning: fwrite() expects parameter 1 to be resource, boolean given in /var/www/web438/html/multi-touch/engine/modules/functions.php on line 281
Warning: fclose() expects parameter 1 to be resource, boolean given in /var/www/web438/html/multi-touch/engine/modules/functions.php on line 282
Multi-touch solution for spherical display. Globus (Erdkugel) is the multi-touch domed (sphere) screen.
Multi-touch terrestrial sphere (Globe/Globus/Глобус) is an unusual and highly innovative spherical interactive information system with multitouch functionality on the sphere.
Automatic marine route planning saved your time and many for oil. This application is based on Multitouch Earth technology.
Multitouch Eearth is a multitouch software, which is based on standard EARTH technologies has following additional functionality: - automatic marine route planning; - captain route; - history route; - AIS data base presentation; - 3D projection of vessel interior; - integration with vessel infrastructure.
It can be run on the Globe - mult-itouch interactive spherical monitor.
The Virtual Entrance application is a multitouch software which is a 3D simulated mega yacht(or hotel) interior with components of interactive motion through several vessel's (or hotel's) compartments: bridge, media room, cinema, bar and restaurant.
Video data from real navigation systems is grabbed via VGA-to-Ethernet converters and screened on sufficient bridge's displays.
Quick zoom in on chosen display and video display is in full screen mode visualization.
There is a possibility of choosing for bottle in bar or course in restaurant with sending order to waiter via wide range of communication facilities, go through enormous nubmbers of CD/DVD records with possibility providing request to real multimedia system for playing album or track.
Our team
Our team provides system integration and solves technical and organizational problems of our clients. We cover all aspects of planning, design, development, deployment, and maintenance of user, enterprise, and turnkey solutions.
Our services include:
• Project and Technical Management • Research and Development • Collection of Technical Requirements • Hardware and Software Design, Development, Testing and Quality Control • Expert Evaluation and Consultation • Technical Control and Monitoring of Projects • Support and Maintenance
When it becomes necessary to subcontract a part of a project, we have members of our group and a number of certified partners to involve.
Group History
1989 Creation: Unification of Integral AG and Jucht AG, Tallinn, Estonia
Integral - Mathematical modeling of relations in network. Jucht - School of managers. The development of business games and business trainings.
1998 WisoSoftCom GmbH, Munich, Germany joined the group
Wisosoft - Software development for the web-agents.
1999 Software Khain Ltd., Herzliya, Israel joined the group
Software Khain - Software development ofsolutionsforscanningstructuralinformationfrom the Internet.
2002 WisoSoft-Austria GmbH, Vienna, Austria was created and joined the group
2011 Dislang Ltd., Daugavpils, Latvia joined the group Dislang - Development 3D graphics and animation, virtual and augmented realities, design and creating of user interfaces,
HMI, interfacing and connecting to real equipment.
2011 River Software Technologies SAS, Bagota, Colombia
River Software Technologies - design and development air and VoIp software technologies.
Projects history
1989
-
1993
Development of business games and mathematical model of market behavior
1993
-
1995
Development of a CRM system
1993
-
Development of various electronic systems: controllers, sonars, terminals, and other components
1995
-
2002
Development of Handbooks with Integrated Testing systems
1996
-
1998
Development of a Credit Strategy Optimization system
1999
-
2003
Internet Data Mining system development
2001
-
2002
Change Tracker development
2002
-
2004
Purchase Tracking System development
2002
-
2006
Development of a secure VoIP and Online Meeting system
2004
-
2006
Development of a Data Warehousing system
2005
-
Development of Cash Flow Management system
2007
-
2008
Development of a Content and Knowledge Automation system
2009
-
2010
Development of an Entertainment and Room Service system for hotels and ships
2009
-
2010
Development of a multi-Touch spherical device which look like Globe.
2009
-
2010
Development of a semi-spherical multi-touch user input and presentation device
2009
-
Development of a Multi-Touch mapping and navigation system Multitouch Earth
2010
-
Development of a Projected Capacitance Touch (PCT) controller of large screens (over 60”)
2010
-
Development of Marine Route Navigation system
Impressum
Multitouch Solution
Skabiosenplatz 2
80995 Munich
Germany
IdNr. 96 870 513 483
St.Nr: 114/151/40232
Tel. +49 176 4824 3510
Email: admin [at] multi-touch-solution [dot] com
Haftungsausschluss
1. Inhalt des Informationsangebotes
Ich kann keinerlei Gewähr für die Aktualität, Korrektheit, Vollständigkeit oder Qualität der bereitgestellten Informationen übernehmen. Haftungsansprüche gegen mich, die sich auf Schäden materieller oder ideeller Art beziehen, welche durch die Nutzung oder Nichtnutzung der dargebotenen Informationen bzw. durch die Nutzung fehlerhafter und unvollständiger Informationen verursacht wurden sind grundsätzlich ausgeschlossen, sofern kein nachweislich vorsätzliches oder grob fahrlässiges Verschulden vorliegt. Ich behalte mir ausdrücklich vor, Teile der Seiten oder das gesamte Angebot ohne gesonderte Ankündigung zu verändern, zu ergänzen, zu löschen oder die Veröffentlichung zeitweise oder endgültig einzustellen.
2. Urheberrecht
Ich nutze nur von mir selbst erstellte oder lizenzfreie Texte (z.B. Gesetzestexte). Das Copyright für veröffentlichte, von mir selbst erstellte Texte bleibt allein bei mir. Eine Vervielfältigung oder Verwendung solcher Texte in anderen elektronischen oder gedruckten Publikationen ist ohne meine ausdrückliche Zustimmung nicht gestattet.
3. Externe Links
Trotz sorgfältiger inhaltlicher Kontrolle übernehme ich keine Haftung für die Inhalte externer Links. Für den Inhalt der verlinkten Seiten sind ausschließlich deren Betreiber veranwortlich.
4. Rechtswirksamkeit dieses Haftungsausschlusses
Dieser Haftungsausschluss ist als Teil des Internetangebotes zu betrachten. Sofern Teile oder einzelne Formulierungen dieses Textes der geltenden Rechtslage nicht, nicht mehr oder nicht vollständig entsprechen sollten, bleiben die übrigen Teile des Dokumentes in ihrem Inhalt und ihrer Gültigkeit davon unberührt.
Haftungsausschluss
1. Inhalt des Informationsangebotes Ich kann keinerlei Gewähr für die Aktualität, Korrektheit, Vollständigkeit oder Qualität der bereitgestellten Informationen übernehmen. Haftungsansprüche gegen mich, die sich auf Schäden materieller oder ideeller Art beziehen, welche durch die Nutzung oder Nichtnutzung der dargebotenen Informationen bzw. durch die Nutzung fehlerhafter und unvollständiger Informationen verursacht wurden sind grundsätzlich ausgeschlossen, sofern kein nachweislich vorsätzliches oder grob fahrlässiges Verschulden vorliegt. Ich behalte mir ausdrücklich vor, Teile der Seiten oder das gesamte Angebot ohne gesonderte Ankündigung zu verändern, zu ergänzen, zu löschen oder die Veröffentlichung zeitweise oder endgültig einzustellen.
2. Urheberrecht Ich nutze nur von mir selbst erstellte oder lizenzfreie Texte (z.B. Gesetzestexte). Das Copyright für veröffentlichte, von mir selbst erstellte Texte bleibt allein bei mir. Eine Vervielfältigung oder Verwendung solcher Texte in anderen elektronischen oder gedruckten Publikationen ist ohne meine ausdrückliche Zustimmung nicht gestattet.
3. Externe Links Trotz sorgfältiger inhaltlicher Kontrolle übernehme ich keine Haftung für die Inhalte externer Links. Für den Inhalt der verlinkten Seiten sind ausschließlich deren Betreiber veranwortlich.
4. Rechtswirksamkeit dieses Haftungsausschlusses Dieser Haftungsausschluss ist als Teil des Internetangebotes zu betrachten. Sofern Teile oder einzelne Formulierungen dieses Textes der geltenden Rechtslage nicht, nicht mehr oder nicht vollständig entsprechen sollten, bleiben die übrigen Teile des Dokumentes in ihrem Inhalt und ihrer Gültigkeit davon unberührt.
Hardware: Overview
Multi-touch terrestrial sphere (Globe/Globus/Глобус) is an unusual and highly innovative spherical information system which sets new standards for graphical user interfaces. It is a high-resolution rear-projection device with a multi-touch surface. The lens is a spherical sector measuring 100 cm with a centre height of 30 cm, which means a spherical sector of 114 cm in diameter. A diagram of the display and a picture of an already installed lens are shown on the right.
The main application Multitouch Earth fit to on large Multitouch Domed Monitor.
Hardware and Hardware Drivers
The large multi-touch display hardware was custom-made for the terrestrial sphere (Globe/Globus/Глобус) and its installation has a specific set of restrictions that must be observed (installation depth, exposure to light etc). Due to its spherical shape, the display requires a low-level driver and appropriate de-skewing and stitching algorithms to be used for presentation.
Operation System
The terrestrial sphere (Globe/Globus/Глобус) requires device to be integrated with an established software platform able to fully support Multi-Touch in order to provide applications with a suitable abstraction level for interpretation of the user gestures. The drivers described above are to be compatible with this software platform. Windows 7 is one such suitable platform, as it provides acceptable APIs and has Multi-Touch capabilities, as well as control elements adapted especially for writing unique multi-touch-enabled applications. In addition, established standard applications should be able to run on these platforms or be suitable for adaptation by the manufacturer. However, these system capabilities cannot be accessed easily as operation using non-certified hardware is not supported.
Interactive Globe
Lens geometry
Hardware: Frame for Multitouch spherical surface
The following design space was available for installation of the entire system:
Height:
196,2 cm
Width:
153,4 cm
Depth:
25 cm
Interactive terrestrial sphere: end state
It was not possible to enlarge this design space, as cupboards are located on either side of the installation.
Furthermore, the rear wall of the room cannot be used for mounting, as a ventilation shaft is located there.
Easy access to projector and other devices within the housing is ensured.
The entire installation is delivered as a cabinet, ready for installation.
Dust protection
The cabinet is constructed so that no ambient dust and dirt can get inside of the cabinet.
This construction is self-supporting.
Air conditioning
The cooling system is realized using a cold water supply to the cabinet. Cooling should be carried out using a TCW air conditioning unit located in the cabinet.
The following values are taken into account during planning:
Cold water replacement (Technical cold water TCW):
• Supply temperature 6° C
• Return temperature 12° C
Cooling units were included with up to 400 l / h flow volume in the design independent of the thermal load on the projector(s).
In addition to the water connections, a condensate removal was provided by the customer, to which the cabinet must be connected.
Inside cabinet: plan
Terrestrial sphere inside empty: realise
Inside cabinet:
development state
Inside cabinet:
end state
Vibration:
The system can be use on a ship, car or plain and is, therefore, prone to experience external vibrations. The cabinet is, therefore, constructed so that the entire function is decoupled from wall hull vibrations and other impacts in order to prevent the displacement of projector and multi-touch sensors.
The oscillation amplitudes at the set-up location are:
• under 11 Hertz: 97mm/sec²
• over 11 Hertz: 5.5mm/sec²
Hardware: Displaying part for Multitouch sperical surface
Bright high-resolution back projection system for the domed screen of multitouch interactive terrestrial sphere (Globe/Globus/Глобус).
Existing technologies were adapted for this device to achieve exceptionally low construction depth.
A pixel-accurate and globally homogenous image appears on the lens surface; the individual images from the projector are implemented with a total resolution of minimum 1050x1050 pixels.
Projector and Frame:
development state
Domed screen with Multitouch Earth:
end state
• The domed screen surface possesses visual features in order to allow comfortable operation; this means that the operation supports both a visual and a sensory experience.
• It is to ensure an even image, independent of where viewers are positioned.
• 100 Cm High contrast domed screen
• Due to the large construction, is ensure sufficient warp resistance of the domed screen (spherical surface).
Domed screen
• The aim was to achieve the best possible presentation of the contents, e.g. films and pictures, for which a resolution of minimum 1050 x1050 pixels is realized.
• Furthermore, changing light conditions does not make projection conditions any more difficult. The contrast of projection material is adjustable accordingly.
• This special material can be sawn, drilled, milled and edge-machined. These properties make it the ideal material for designing eye-catching items, attention-grabbing displays, effective signs and dynamic, colorful tradeshow booths and store fixtures.
NB!!! The forming temperature is between 150 and 160°C.
Plate with domed screen
• The images are displayed on the interactive terrestrial sphere (Globe/Globus/Глобус) using a special developed projector with frame, additional optical part, and a mechanical part for calibration.
• A seamless, de-skewed projection is created to present the contents across the entire surface of the concave lens.
Projector with special optic part
• The display system was optimized specially for the dome-shaped screen geometry
• Different mappings are available and controllable via an API. The mapping variants are illustrated in the following Fig.:
Mapping on the globus display
Hardware: Sensor part for Multitouch sperical surface
During the research stage of the development of the hemispherical surface of large diameter our team studied existing multi-touch technologies. The comparison table was set up to simplify the decision. This table compares all known multi-touch technologies based on the following criteria: • Multi-touch • Surface Size • Curvature (sphere) of the surface • Transmittance / optics of surface • All-in installation • Sensitivity to ambient lighting conditions • Sensitivity to vibration
The first group of the reviewed technologies failed to solve problems on a spherical surface (e.g.: SAW - Surface Acoustic Wave and infrared-frame, resistive and surface capacitive solutions).
The second group consists of technologies that do not allow a solution that preserves the transparency of the screen, such as: "in cell"-resistive and "in cell"-infrared.
The third group includes technologies that require installation of additional equipment into the room (e.g.: video cameras, reflectors, gloves, pins or sensors).
Capacitive multi-touch solution
A separate explanation is in order to explain the reasons for rejecting approach taken by Microsoft in designing their Kinect device. Kinect uses near-infrared transmitter to create a pattern of near-infrared dots. The distortion of this pattern and measurement of time it takes to reflect each ray from the objects in space allows creating a precise depth map of the space in front of the camera. The changes to the map are updated 30 times per second and allow precise movement detection, face recognition, and feature extraction. It is important here to specify what “precise” means in the preceding description. Kinect is able to “see” object 1.2-3.5 meters from the camera, with limited perception in the range of 0.7 to 6 meters. The view is 57º horizontally and 43º vertically. The depth map is accurate to about 1cm. These measurements clearly show that the motion and gesture detection using Kinect simply would not work on a surface of a spherical screen as the precision is not high enough and the view of the camera is too narrow for a half-sphere screen.
Multi-touch solution based on with Microsoft Kinect
Thus, there remained only two approaches:
1. Projective Infrared – with the sources and detectors of infrared radiation located inside of the spherical screen surface.
This solution has several disadvantages: • Sensitivity to vibration. • Sensitivity to direct sunlight, which negatively affects the quality and functionality of the system.
This, for example, prevents using this approach in the open space that is not protected from direct and reflected sunlight in the room. • Sensitivity to reflected sunlight. • Sensitivity to changes in lighting of the room (e.g.: turning the light on or off). • Failures with screen surface contamination.
Infrared multitouch
2. Projective-capacitive (PCT) - the sensors are laid on the inner side of the surface in a form of a grid of electrodes (and possibly just wires).
The coordinates of a point are calculated by measuring changes in capacitance caused by the finger touching the surface.
To implement this approach, one first needs to find a way or to develop a technology that enables laying of the conductors (wires) inside a spherical surface.
When “bubbling” (inflation) is used to create a spherical surface out of a flat one - all the wires tear because of the tension. Gluing wires to the inner surface of the sphere is impossible, because the wire would separate from the surface due to tension, as the straight-line distance between two points within a sphere is smaller than the length of the chord. Attempts to use foil are doomed too for the same reasons that it is impossible to wrap a football in a headscarf without folds. The next problem is the lack of multi-touch solutions (in the sense of the controller) on a large surface area. There are solutions for single-touch or solutions for surfaces that do not exceed 21" (e.g.: N-Trig).
Projective capasitive solution
Grid with gluing wires
Since the capacitive solution was not developed in the scheduled project time frame, the infrared solution was implemented.
Infrared solution installed on the GLOBE
The essence of this solution is that multiple sources of infrared light are installed behind the screen surface, i.e. inside the cabinet. These sources are purposefully designed to cover the inner surface of the screen and user’s fingers reflect this radiation into the interior. Infrared cameras (similar to night vision devices) can be used as the sensors (receivers). One cannot use a single camera due to its range of view, but two cameras cover (i.e. see) the entire inner surface of GLOBE (our screen). Because the depth of the cabinet was limited to 25 cm, in our case it was not enough to use a simple short-focus camera. As in the case with the projector, special optics had to be used to solve the problem. Since more than one camera was used, it was necessary to develop a software program that would stitch (combine) images generated by each camera into one. Additionally, a calibration program was needed to map coordinates of the stitched camera image to the coordinates of the image visible on the screen.
One of the main software components is the TRACKER, which keeps track of the coordinates of the points of contact within the surface, and, most importantly, determines whether each touch is a new one or a part of an unbroken line.
Finally, a component was used to transfer multi-touch coordinates and gesture types to the operating system (Windows 7).
Infrared solution for the GLOBE
Capacitive multi-touch screens for hemispherical display
Shortcomings of infrared solutions were known from the start and it was, therefore, decided to find a suitable projective-capacitive solution.
Finding such a solution required solving two problems simultaneously: 1. Develop technology for bonding of copper (or other) very thin wires inside of the hemisphere.
We further call this sub-problem "PCT-screen." 2. Develop technology that allows receiving information about changes in the capacitive characteristics at the points of the finger contact, taking into account the extremely large screen (about 2 meters).
We further call this sub-problem "PCT-controller".
Multitouch PCT Solution: Prototype from first System integrator
At this stage of the study, a young startup was found, which attempted to tackle these problems. They had successfully developed a prototype - a hemisphere of about 40 cm in diameter. The results were more than convincing!
But, that was where the success was over.
PCT multitouch prototype
Attempts to obtain a stable signal and calculate the coordinates of the touch on a flat-screen (1.40m x 1.40m with 7 mm increment between the wires) culminated in a failure. The screen acted as an antenna and the noise was so great, that the signal at the site of contact could not be determined. Attempts to resolve the problem by doubling the pitch from 7 mm to 14 mm between the wires failed. In parallel, the Portuguese attempted to create a robot that was able to lay the wires down and glue them to the inner surface of the hemisphere. And it appeared promising at first. A few rows of copper wire were laid down and glued in place. Further advances in this direction were not forthcoming.
Surface with gluing wires: bad quality
In all likelihood, the following problems remained unresolved: 1. Making sure the rows were parallel to each other. 2. It was not possible to lay all 128 rows of wire down and glue them in time before the glue began to harden.
The glue had to be sprayed again.
Fresh glue dissolved the hardened glue and the wires already glued on peeled. 3. For the same reason it was not possible to lay the perpendicular rows of wire down, as they dissolved the glue of the lower layers. 4. Glue could not be applied evenly, so there were visible stains.
Thus, the screen lost some of its picture resolution.
Surface with gluing wires: bad quality
As soon as the problems became obvious, a renewed search for a firm that could solve the problem had to be started. And such a company was found in Estonia - the country which gave Skype to mankind.
Estonian solutions for Capacitive multitouch sperical screen
To begin, a search for a suitable adhesive was undertaken. In addition to the optical properties, special attention was focused on making sure the next layer of glue does not dissolve the previous one. Once the glue has been selected, the baton passed to the Mechanical Engineers. They created a semi-automatic system (not all processes were automatable) for laying and gluing thin wire. This equipment is sufficiently generic to be able to lay the wire down and glue it to hemispheres of up to 3 meters in diameter!
Robot for laying and gluing thin wire
At this time the following problems had been resolved: 1. Absolutely parallel rows. Minimal step: 1 mm.
Thus, depending on need, parallel conductors can be attached at one or more millimeters. 2. Ensuring continuity and straightness of pasted conductors. Continuity and straightness of pasted conductor was made possible by an innovative device for feeding the wire and for providing sufficient time for the bonding process,
allowing the surface to "grab" the wire and, thus, to assure that it does not come off, despite the force of the tension. 3. Avoiding mechanical damages during laying the wire down and bonding.
When excessive force for clamping the wire to the surface is applied when gluing the first layer or the second perpendicular one,
there is a risk of damage of the surface of the sphere and the previously deposited conductors.
This problem was solved by careful selection of the clipping material and its geometry.
Domed surface: backside with wires and electronic
Domed surface: backside with wires
Estonian solutions for Capacitive multitouch: controller
A grid consisting of 128 lines of vertical resolution and of 128 lines of horizontal resolution was implemented to obtain a satisfactory resolution, taking into account the screen size (1 m in diameter). This corresponded to a step around 7.8 millimeters. It was clear from the beginning that the classical projective capacitive (PCT) approach was not suitable, because the screen was too large. Therefore, the Estonian company founded by former members of the Estonian Academy of Sciences and scientists from Tallinn Technical University used a different approach. A 128x128 grid on the inner surface of the hemisphere produced 16,384 cells. Thus, the problem was reduced to determining the presence or absence of contact in each of the cells. This was done by measuring the changes in the signal of each cell. Modern literature calls this approach digital capacitive.
Professionals would understand that a reference signal had to be properly selected and special digital processing algorithms had to be applied to filter the noise from the signal to accurately detect touch.
Projective capacitive digital multi-touch solution
Multitouch software: Navigation hierarchies of applications
The concept of navigation for the whole application is based on the zoom-in and zoom-out gestures for multi-touch surfaces. Such gestures are generally available on all multi-touch devices and are the most familiar to users.
The concept of the “main menu” can be completely replaced by the zooming gestures, enabling the user to move from one level of hierarchy to another just by changing the scale of presentation.
The universe presented to the user contains two types of objects – normal objects and “magic” or portal objects that contain an entire new world within. Depending on the object, the globe’s zooming operation can produce two different kinds of results:
• A normal object supports normal zooming (i.e.: zooming out from an island on the map or zooming in to increase scale of an image on the monitor on the bridge) • Zooming into a portal object zooms into a new space (i.e.: zooming into the bridge door lets the user enter the bridge and see the devices on the captain’s desk)
The portals and their interactions with users make hierarchy more intuitive and obvious. The concept makes the navigation system similar to such devices as iPhone and iPad, rather than the standard computer applications.
The top level of the hierarchy is represented by the Multitouch Earth application, presenting the map of the Earth and allowing user to navigate the oceans and seas. The objects on the map are placed based on their geographical coordinates.
The GPS coordinates of the ship place the ship on its correct position on the map along its route.
The map is a “normal object”. Zooming gestures have obvious effect. Zoom in will lower user’s view of the Earth surface. Zoom out will move user further away from the surface.
The only “magic” object on the map is the image of the ship. It is a picture about 3 cm long, which makes zooming into it consistently simple and allows user to enter into a new “space” – the interior of the ship.
