Samsung’s Audio Eraser: Revolutionizing Sound Control
Imagine capturing a street performance, only to have car horns drown out the music, or filming a vlog in a bustling café where the ambient noise overshadows conversations. The introduction of Audio Eraser in the Galaxy S25 series provides a solution to these audio dilemmas, aiding users in creating more immersive videos.
This innovative feature focuses on reducing unwanted background noise while enhancing the desired audio, allowing for a richer auditory experience. Samsung Research and Mobile eXperience (MX) Business teamed up to bring this technology to life, based on their understanding of user needs.
Samsung Newsroom recently sat down with audio technology experts from the AI Solution Team at Samsung Research to delve into the development of the Audio Eraser.
Source Detection: Next-Gen Audio Technology
The Audio Eraser enables users to quickly adjust sound levels in a video by isolating and enhancing specific audio types. This feature can process videos recorded by the user or those shared by others, making it versatile and user-friendly.
Similar to the Object Eraser introduced in the Galaxy S21, Audio Eraser aims to enhance multimedia experiences, providing seamless integration of sound control.
Development and Challenges of Sound Technology
Audio Eraser categorizes audio into six distinct types: voices, music, wind, nature sounds, crowd noise, and ambient noise. Through sound source detection technology, the feature swiftly identifies and separates these sounds in a video.
To ensure effective sound separation, the research team compiled extensive training data through real-world recordings and simulations. Challenges included accurately capturing wind sounds, which required outdoor recordings during high winds. Hejung Yang from Samsung Research explained, ‘Wind was particularly challenging to work with. We enhanced our dataset by recording actual wind sounds outdoors during suitable conditions.’
The effective functioning of the sound separation model stemmed from thorough analysis and experimentation by developers, with Jiwon Kim noting that ‘each developer compared and analyzed over 1,000 audio samples weekly to refine the model.’
User-Centric Listening Experience
By operating on-device, Audio Eraser enhances user experience through real-time editing while ensuring privacy. Hosang Sung emphasized the importance of developing AI models for on-device processing, ensuring optimal performance with low power consumption. ‘We invested significant effort in creating an AI solution that operates efficiently without excess energy use,’ said Sung.
Samsung Research remains committed to advancing audio technology, with Hoonyoung Cho, Vice President of the AI Solution Team, declaring, ‘We strive to develop innovative solutions that enhance mobile usability, focusing on personalized listening experiences.’
Collaboration for Consumer Solutions
This advancement represents the culmination of extensive collaboration between Samsung Research and MX Business to deliver a seamless user experience when editing audio and video simultaneously. The focus on maintaining smooth playback while processing lengthy videos presented unique challenges.
Samsung’s Galaxy Buds3 series exemplifies this interdisciplinary approach, successfully integrating hardware and software to enhance Active Noise Cancellation (ANC) technology, with Kyoungbo Min stating, ‘We crafted algorithms adaptable to various hardware conditions to improve user experiences.’
The advancements in sound source separation signal a promising future for Samsung as they prepare to explore new applications in audio technology.
Enhancements to Audio Eraser reflect Samsung’s continuous evolution in AI technologies, promising enhanced features for the consumer market.
