Our research goal is to facilitate the sharing of stories with digital photographs. Some map websites now collect stories associated with peoples' relationships to places. Users map collections of places and include their intangible emotional associations with each location along with photographs, videos, etc. Though this framework of mapping stories is important, it is not sufficiently expressive to communicate stories in a narrative fashion. For example, when the number of the mapped collections of places is particularly large, it is neither easy for viewers to interpret the map nor is it easy for the creator to express a story as a series of events in the real world. This is because each narrative, in the form of a sequence of textual narratives, a sequence of photographs, a movie, or audio is mapped to just one point. As a result, it is up to the viewer to decide which points on the map must be read, and in what order. The conventional framework is fairly suitable for mapping and expressing fragments or snapshots of a whole story and not for conveying the whole story as a narrative using the entire map as the setting. We therefore propose a new framework, Spatial Slideshow, for mapping personal photo collections and representing them as stories such as route guidances, sightseeing guidances, historical topics, fieldwork records, personal diaries, and so on. It is a fusion of personal photo mapping and photo storytelling. Each story is conveyed through a sequence of mapped photographs, presented as a synchronized animation of a map and an enhanced photo slideshow. The main technical novelty of this paper is a method for creating three-dimensional animations of photographs that induce the visual effect of motion from photo to photo. We believe that the proposed framework may have considerable significance in facilitating the grassroots development of spatial content driven by visual communication concerning real-world locations or events.

For mobile visual communications, the development of more robust and efficient video traffic control and transmission techniques remains one of the most important issues. Foveated video originates from visual entropy reduction by removing undetectable high visual frequencies that occur at a distance from the fixation point. In this paper, compression gain is defined and measured to quantify the enhanced performance when the visual throughput of the regions of interest (ROI) is increased over a capacity-limited channel.

For point-to-point mobile visual communications, layered video has been utilized to adapt to time-varying channel capacity over noisy environments. From the perspective of the HVS (Human Visual System), it is necessary to minimize the loss of visual quality by specifically maintaining the throughput of visually important regions, objects and so on. Utilizing the prioritized bitstreams generated according to each layer, the throughput can be improved for given channel statistics. In this paper, we define the transmission gain and measure the improved performance when the throughput of ROI (Regions Of Interest) is increased relative to visually unimportant regions over a capacity limited mobile channel.

This paper presents an overview of research activities in Japan in the field of very low bit-rate video coding. Related research based on the concept of "intelligent image coding" started in the mid-1980's. Although this concept originated from the consideration of a new type of image coding, it can also be applied to other interesting applications such as human interface and psychology. On the other hand, since the beginning of the 1990's, research on the improvement of waveform coding has been actively performed to realize very low bit-rate video coding. Key techniques employed here are improvement of motion compensation and adoption of region segmentation. In addition to the above, we propose new concepts of image coding, which have the potential to open up new aspects of image coding, e.g., ideas of interactive image coding, integrated 3-D visual communication and coding of multimedia information considering mutual relationship amongst various media.

We believe that virtual world communication will subsume BBS and visual communication. Accordingly, we proposed the networked virtual world "Interspace" for visual communication. If we are to achieve education and training in this world, techniques to receive and transmit information without any special training are necessary. The traditional "easy" ways of transmitting information are talking and drawing. In Interspace, users can already talk each other. In this paper we focus on drawing. In daily life we communicate through drawings in various situations. At this time it is important to recognize who is drawing and where the participants are watching. It is difficult to realize these functions using conventional media, but it is possible to realize them in virtual space. In virtual space, the system can clearly represent who is drawing and where participants are watching; expressing topics in virtual space frees us from many physical restrictions. In this paper we discuss the process of drawing when many participants share topics in virtual space; the necessary conditions for our system are considered. We design a system that offers functions to make drawing sheets, to display the view fields of participants, and to share visual fields. Furthermore, we propose the mode of InterSheet called "InterMirror" which shows mirror images of partners and their drawings. We make a prototype and evaluate it. The results indicate the synergistic effect of drawing with voice and the usefulness of drawing for communication in virtual space.

The concept of a new visual communication environment is proposed. The proposed system is a shared and interactive multi-user virtual space that consists of a CG-based virtual space structure and video-based objects. Human interface design issues are discussed from the view point of creating a new reality for enhanced communication.

Realizing an effective channel connection scheme and a useful human-machine interface is important for popularizing the audio-visual communication services that should become significant in the near future. This paper describes a terminal design that is applicable to various audio-visual communication services. First, future audio-visual services are classified into three types: Videophone, Tele-monitoring and Video On Demand(VOD). The requirements for these services are discussed in detail. Second, a channel connection scheme is specified taking into consideration for the requirements and characteristics of various networks such as N-ISDN and LANs. Terminals based on these specifications are developed as prototypes and demonstrated to confirm the validity of these specifications.

The many-user networked virtual world system InterSpace" is described. This system's main purpose is to enhance the user's communication activities. In InterSpace, the real world information is embedded in the shared virtual world as a combination of video and CG images. Users can ovserve and access this information by simply looking and approaching embedded images. The concept of InterSpace and a prototype system of this service are introduced.

Recently, studies aiming at the next generation of visual communication services which support better human communication have been carried out intensively in Japan. The principal motive of these studies is to develop new services which are not restricted to a conventional communication framework based on the transmission of waveform signals. This paper focuses on three important key words in these studies; "intelligent," "real," and "distributed and collaborative," and describes recent research activities. The first key word "intelligent" relates to intelligent image coding. As a particular example, model-based coding of moving facial images is discussed in detail. In this method, shape change and motion of the human face is described by a small number of parameters. This feature leads to the development of new applications such as very low bit-rate transmission of moving facial images, analysis and synthesis of facial expression, human interfaces, and so on. The second key word "real" relates to communication with realistic sensations and virtual space teleconferencing. Among various component technologies, real-time reproduction of 3-D human images and a cooperative work environment with virtual space are discussed in detail. The last key word "distributed and collaborative" relates to collaborative work in a distributed work environment. The importance of visual media in collaborative work, a concept of CSCW, and requirements for realizing a distributed collaborative environment are discussed. Then, four examples of CSCW systems are briefly outlined.

Proposed here is an internal representation and mapping method for multimedia information in which retrieval is based on the impression documents desired to make. A user interface design for a system using this method is also proposed. The proposed internal representation and mapping method represents each desired document impression as an axis in a semantic space. Documents are represented as points in the space. Queries are represented as subspaces. The proposed user interface design employs a method of visual presentation of the semantic space. Pictorial examples are given to illustrate the range of impressions represented by the axes. The relations between the axes are represented by dispersion diagrams for the documents stored in the document base. With this method, the user can intuitively decide the appropriate subspace for his needs and can specify it directly. For evaluation purposes, a prototype system has been developed. An image retrieval experiment shows that the proposed internal representation and mapping method and the user interface design provide effective tools for information retrieval.