Sony recently announced that it has developed a real-time live streaming technology with fully object-based stereo surround sound. In addition, Sony has expanded the application of “360 Live Sound,” a music experience that immerses users in a three-dimensional sound field.
Sony said that while live streaming is favored for its convenience and lack of location and mobility restrictions, it has been a challenge to achieve a live experience. Sony has upgraded its self-developed 360 stereo surround sound technology to enable real-time transmission of 3D sound and video based on “360 Live Sound”, allowing users to experience the realism of a live performance or concert without being there at the same time.
360 Live Sound
According to the introduction, “360 Live Sound” improves the creative environment and develops a real-time encoder to provide artists and sound engineers with live effects and sound quality. To create a spatial music experience, the sound engineer first assigns location information to each sound source, such as vocals, guitars and drums, and arranges them in a spherical space. Sony has developed a new “360 Live Sound” creation tool for real-time delivery to enhance the sound engineer’s creative environment. With this tool, sound engineers can freely and instantly arrange sound sources and create sounds with three-dimensional effects as expected.
In addition to this, in order to send the music to the server and deliver it to the user, the audio data needs to go through a compression process, including location information, but it also requires a certain amount of processing time to maintain high sound quality. So Sony developed its own sound processing algorithm to achieve the presence effect, which is crucial for live broadcast. In addition, with “360 Live Sound”, an object-based spatial audio technology, the amount of information (bit rate) given to each sound source (object) can be automatically optimized without compromising listening quality. It compresses the audio data in a short period of time to achieve a real-time live broadcast in sync with the video.
Sony and the U.S. software company Streamsoft Inc. jointly developed the “360 Reality Audio Live” (360 Reality Audio Live) App, dedicated to bringing users a superior experience of real-time transmission. After using this App with headphones, users can enjoy a new live entertainment experience.
▲ Simulation of “360 Live Sound” scenario
The App supports Android and iOS smartphones and tablets, and is compatible with any type of headphones. If you use Sony or Audio-Technia’s “360 Live Sound” certified headphones, you can also optimize your experience by adjusting the personal features in the dedicated app.
In addition, the App is equipped with a live chat feature, making real-time communication between artist and audience, and audience and audience a reality, allowing online audiences to experience it in real time as well.
