삼성전자는 '갤럭시 S24 시리즈'에서 온디바이스 AI와 클라우드 AI를 기반으로 실시간 통역 등 새로운 AI 기능을 선보였다.
S24·S24+ Stylish and thin one-mass design
AI translation and summary functions to increase work productivity
Real-time camera shooting and editing based on generative AI
Samsung Electronics introduced new AI functions such as real-time interpretation based on on-device AI and cloud AI in the 'Galaxy S24 series'.
Samsung Electronics held the 'Galaxy Unpacked 2024' event at the SAP Center in San Jose, USA on the 17th (local time), and held a 'Galaxy S24 Series' press conference at the Samsung Electronics press room in Jung-gu on the 18th.
■ Thin and light S24, S24+, and S24 Ultra with similar design to the previous model
▲Samsung Electronics Galaxy S24 series
The design of the Galaxy S24 series seems similar but has changed. First of all, the S24 is the lightest at 167g, and the S24 and S24+ have a one-mess design with thin bezels. The S24 and S24+ have a more refined feel than their predecessors, but the Ultra is not a one-piece. The S24 and S24+ are upgraded versions with aluminum sides, and feature the smallest bezels.
The S24 Ultra weighs 232g, similar in size and weight to its predecessor, but is slightly thinner due to the flat display. The front display is newly made of Corning® Gorilla® Armor, titanium materials. Samsung Electronics explained that it does not reflect light by up to 75% compared to regular glass, enhancing the luxurious black feeling, and that the scratch resistance has been improved by four times.
The colors are pastel tones that don't stand out, so there shouldn't be any difficulty in choosing one. On this day, Samsung Electronics also introduced a dedicated case.
■ How useful is an on-device AI interpreter?
▲Demonstration of on-device AI-based real-time interpretation function
Samsung Electronics is the first Google Cloud partner to be equipped with Gemini Pro, a multimodal AI based on Vertex AI. Additionally, Google DeepMind's text-to-image conversion and AI image creation tool 'Imagen2' is installed.
At the event, Samsung Electronics directly handled the Galaxy S24 series models and demonstrated AI functions such as real-time interpretation during calls, real-time translation of messages, circle to search, note assist, voice recording and translation, and camera and gallery editing. Most of the functions are on-device AI and work offline, but search utilizes cloud AI.
The Galaxy S24 series is the first to feature the on-device AI-based 'Live Translate' function. The on-device AI can be used without going through the cloud (server) and does not require downloading a separate app.
The demonstrator on this day demonstrated making a reservation at an American restaurant in English. When you press the real-time interpretation button on the call screen, a message appears first indicating that call translation will begin. If you speak in Korean, it will be translated into English, and the other person’s English sentences will be translated into Korean immediately. The delay between the translation languages took about 3 seconds, but the accuracy was high. A total of 13 translation languages are supported, and the interpretation function can be used offline with the interpretation app.
Samsung Electronics has also enabled real-time message translation by integrating on-device AI into the keyboard itself. Texts sent and received in Spanish were automatically recognized and translated, and when I send them, they are also converted from Korean to Spanish. This is possible for both sent and received messages. The generative AI recommends five tones, changing the tone of voice from a friend-like tone to a polite tone, and it is also possible to insert hashtags for SNS. All typos and spellings are automatically corrected and translated, and both functions are possible at the same time.
In addition, the Samsung Galaxy S24 series can provide AI document functions that Naver introduced with the Clova Note app without the Internet. First, by pressing the text conversion button of the recorded meeting minutes file in the recording app, the speaker is distinguished and a translation and dictation (script) is provided. It also summarizes the meeting contents. In particular, a translation function is provided here to provide convenience. Samsung Notes summarizes and provides notes in various formats such as titles and bullets. Foreign language text on the Internet can also be translated immediately by pressing the translation button on the AI button.
These features are not new features that did not exist before. However, they are significant in that they provide useful features in an optimized and integrated manner, thereby improving work productivity without the need for the Internet or separate apps.
■ Circle to Search, Search Anything
▲Demonstration of Circle to Search function
The 'Circle to Search' feature, completed in collaboration with Google, is based on cloud AI. When searching is needed while surfing the web, using SNS, or using YouTube, users can simply draw a circle on any screen to summon the browser and provide the best answer rather than a list, and search as if they were talking to the generative AI. Since all conversations are remembered, they can continue asking questions like a chatbot.
When you run any image on the website, you can open the browser by long-pressing the home button at the bottom to run the search function. If you draw a circle or square shape on the part of the image you are curious about, the generative AI will search for it.
Ultimately, it supports all searches on the screen. If you are curious about something while walking down the street, you can search by pressing the home button while the camera is on without taking a picture of an object.
■ Enhanced camera experience, feel vivid
The Galaxy S24 series' camera also features improved generative AI. In particular, the 'quad tele system' shows the same image quality up to 10x in plain zoom. The S24 Ultra has a 200 million pixel wide-angle, 12 million pixel ultra-wide-angle, 10 million pixel telephoto (3.5x zoom) quad rear camera, and a 12 million pixel front camera. In fact, when I accessed the camera app and pinch-zoomed to enlarge the photo, there was less breakage. The 100x zoom range is similar to the previous model. The nitography function was also applied up to 5x zoom.
The demonstration showcased editing features using generative AI. First of all, photos could be tilted without the usual cropping of corners. People could be moved by circling them, just like Photoshop’s lasso tool. The space where the image disappears is filled by the generative AI, not based on up, down, left, and right, so that the image can be completed more naturally. Editing is now possible with simple Photoshop functions. The edited image can be compared with the original and saved. The AI logo watermark is displayed at the bottom left.
The 'Instant Slow-mo' feature, which was also introduced, adds a slow-motion function to videos. When you long-press on a certain section of the screen while playing a saved video, the slow-motion effect is applied and played. This works not only for recorded videos but also for shared videos.
Meanwhile, the current Galaxy S24 and S24 Plus are equipped with Samsung Electronics' Exynos 2400, and the Galaxy S24 Ultra is equipped with Qualcomm's 'Snapdragon® 8 Gen 3 Mobile Platform for Galaxy' AP. A Samsung Electronics official said, "Despite the difference in AP, AI performance will be the same for all models," but there was no clear answer as to how much the functions will be improved compared to the Exynos 2200 AP, which showed lower performance than the Snapdragon 8 2nd generation in Geekbench.
Samsung Electronics also explained that it optimized the heat dissipation system with a 'Vapor Chamber' that is up to 1.9 times larger than the Ultra standard to address the overheating issue in the Exynos 2200.
As such, it remains to be seen how accurate the AI in the Galaxy S24 series will be in terms of search functions while providing useful translation and camera functions. On this day, the official said that it is difficult to comment on the AI recognition rate. In addition, the AI installed in the Galaxy S24 series has completed learning and no additional learning is performed. If AI performance is to be upgraded, it must be updated through Samsung One UI, it said.
Currently, the S24 is running One UI 6.1, which includes AI features. A Samsung Electronics official said, “These AI features can be expanded to the previous series as well,” but did not reveal detailed plans. However, since the AI features are hardware-based, it is expected that the previous generation may not provide such features.