3D Sensing Hologram Installation J4 2.0

22nd jul, 2009

The New Digital Device Developed by d'strict
Harmonious Marriage of 3D Camera-based Gesture Sensing, Hologram Display, and Flat-screen Display Technologies

The 2.0 version of the J4, whose commercial feasibility was confirmed following its installation in the Cheongdam boutique of Louis Quartorze, is now fully developed. Moving on a step further from the J4 1.0, for which the user had to wear a ring to control and manipulate the hologram contents, the J4 2.0 uses sophisticated 3-D sensing technology that senses a person’s hand gestures. In other words, it enables the user to control the display contents with simple hand shapes and gestures, thereby eliminating the need for a separate input tool. Various interaction possibilities, such as moving the contents in all directions with hand movements and selecting, stopping, dragging or rotating the images with gestures like “rock, paper, scissors,” have been incorporated into the new version. It goes without saying that different combinations of one or two-hand gestures and movements can be used to create scores of command triggers. The hologram display and flat-screen display installed on the top and bottom of the new model create a colorful visual effect.

Hand gestures alone can move the contents between the hologram display at the top and the flat-screen display (LED or LCD) on the bottom. VR Navigation can also be activated and run on the flat display. Furthermore, an entertainment program that allows the user to experience a racing game merely with hand movements akin to those of a driver can be provided.

The J4 can be used in many different ways in any place that requires experience-based information transfer, including exhibition venues, museums, and retail stores, taking the user’s experience and interaction beyond the bounds of one-sided information traffic. System efficiency and public interest have been enhanced, facilitating more proactive participation and communication. This innovative digital solution packed with possibilities has great commercial potential and offers a broad scope of application.

In J4 2.0, "Rock" is used to grasp, drag, and rotate an object, "Scissors" is used to generate a new movement, and "Paper" is used to select or stop the object. As such, various gestures are programmed as different commands suitable for individual gestures that can induce further interactions.

Hand gestures and movements application for use on basic objects

Free movement of objects between the hologram and flat-screen displays is enabled with hand gestures and movements

VR Navigation application examples of looking up location or other information about a certain place with hand gestures

Entertainment program allowing the user to experience a racing game with simple hand movements akin to those of a driver

From SWING H to J4 2.0

The J4 2.0 originated from the SWING H, the first-generation fruit of d’strict’s R&D efforts. The SWING H, which is the 1.0 version of the J4, enables the user to manually control hologram contents by wearing a special IR ring. Its commercial feasibility was confirmed following its introduction at the Seoul Design Festival and its installation at the Cheongdam boutique of Louis Quartorze. An R&D project aimed at upgrading this technology commenced in February 2009.

The J4 was born after considerable hard work by experts from the four fields of planning, designing, development, and hardware building in pursuit of a new digital experience: the Hardware Team focused on determining the form and exterior design of the hologram display device; the Sensing Team focused on developing 3-D camera-based gesture sensing technology to make a simple and natural input possible; and the Interface Team focused on the development of contents and interface suitable for gesture sensing. All decisions were made by integrating the different opinions of all the team members.

In addition, a user test was conducted on 80 persons in order to determine the ergonomically optimal height and size of the device. An in-depth study on hand-based sensing technology was carried out by drawing a distinction between J4 1.0 users and users of other devices. Hand- gesture sensing technology is still in its initial phase of development, so it follows that the ideas of the R&D team and the challenges faced by its members easily extend beyond most people’s imagination.

Nevertheless, the flat-screen display was added to make up for the shortcomings of the information transfer function of the J4 1.0, and other gesture-based functions enabling contents movement between the two displays, interaction, and user engagement were developed. The J4 2.0 offers a new and improved digital experience in comparison to the J4 1.0, whose commercial feasibility had already been confirmed. Nevertheless, d’strict’s dedicated efforts to develop contents and expand the range of applications will continue as it strives to attract and benefit the greater public.