Product Introduction ,Barrier-Free Mobile Platform: SYNCHro ,Product Overview ,By downloading barrier-free contents from smart phones(application), visual and hearing impaired people ,and foreigners will be provided with subtitles and foreign language subtitles(texts or audio). The fundamental ,of the technology is to extract time code by analyzing sound of original contents(movie, broadcast, etc.) ,coming from MIC using sound recognition system. ,Step1. When a movie is played in theater or TV, ,Step2. Subtitles are synchronized through SYNCHro mobile application. ,Step3. Audio description for the visually impaired, subtitle for the hearing impaired, and multi-lingual subtitle for foreigners are provided. ,Product Supply ,C la s s i f i c a t io n ,D e s c r ip t i o n ,Portal ,‧ Add to the portal type barrier-free list run by developer ,‧ For each mobile OS(IOS, Android) ,SYNCHro Mobile Application ,CP ,‧ Provide library type barrier-free application of client ,company's brand ‧ For each mobile OS(IOS, Android) ,Movie ,‧ Provide barrier-free application for each movie ,‧ For each mobile OS(IOS, Android) ,Contents for subtitles ,Subtitles for visually or ,hearing impaired ,people ,‧ Provide audio descriptions for the visually impaired ,‧ Provide subtitles for the hearing impaired ,Multi-lingual Subtitles ,‧ Provide multi-lingual subtitles for foreigners ,Option ,Capsyong ,recognition technology ‧ Application binary for PC ,‧ A screen-project type subtitle player based on sound ,Purpose of Introduction ,A. To provide equal environment of movie-watching regardless of any physical and language ,difference. ,B. To establish infrastructure for the disabled through the improvement of movie -watching ,environment as the first step. ,C. For multilingual barrier-free service of Korean movies. ,Expected Effect ,A. ,(Movie screenings for the visually and hearing impaired) Provide both the visu ally and hearing ,impaired and the non-disabled with barrier-free environment where they can reduce culture gap ,and share the same feelings. ,B. ,(Movie screenings for foreigners) W ith native language subtitles provided by smart phones with ,SYNCHro, it will be possible to overcome the current difficulty of securing multi -language screening ,media and theater. Thus, multicultural families, foreign workers, and international students will ,have more access to cultural activities. ,C. ,(Movie screenings regardless of media) Films have different platforms such theaters, IPTV, Cables, ,online, mobile, and TV, and the frame rates of each platform differs. The barrier -free platform that ,we are introducing can provide equal service of high quality by synchronizing subtitles(audio ,description, subtitles, multi-lingual subtitles) with time code of original movie using sound ,recognition system. ,Functional Description ,Main Function ,A. (User) Barrier-Free Mobile Application ,Classification ,Details ,Overview ,Technology Application ,Implementation Details ,Mobile application that provides barrier-free subtitles ,(audio description, subtitles, multilingual) ,Application of digital fingerprinting SDK for signal analyzation and synchronization ,of subtitles ,- Movie list exposure(new, popular, index, search, etc.) ,- ,- ,Synchronization of audio description and subtitles(including multilingual ,subtitles) ,Recognition through QR Code, NFC Tag, Beacon ,- Mirroring of smart glasses and smart phones(Subtitles played through smart ,glasses) ,PETA sync: Real time DNA matching with movies(First and the only ,development in the world ,Save and bookmark function of movie list ,Silent mode and lock screen control of smart phones ,Option between Audio description and text subtitles ,UI and contents language options(Korea, English, Japanese, Chinese) ,- ,- ,- ,- ,- ,B. (Administrator) Barrier-Free Contents Management System ,Classification ,Details ,Overview ,Technology Application ,Implementation Details ,Cloud based contents management system for saving, processing, scheduling, ,and mobile delivery of subtitle contents(subtitles, audio description). ,- ,Transmission of barrier-free contents file from NOC to storage ,- Management of contents transmission from NOC and the number of ,screenings ,- ,- ,- ,- ,- ,Development of cloud based digital signage NOC platform ,Customization to NOC platform for distribution of multilingual subtitle contents ,Provide interface for mapping of movie contents and multi -lingual subtitle ,contents ,Provide distribution management system for screening schedule of registered ,contents ,Provide management environment of multilingual subtitles for foreigners ,along with the subtitles for the disabled ,C. (Based Technology) Digital Finger Printing Sound Recognition Technology ,Research Area ,Application Technology ,Noise ,Filtering ,▪ Single Chanel Based Noise Elimination Technology ,- ,Spectral subtraction based noise elimination technology ,- W iener filter based noise elimination technology ,※ MCRA(Minima Controlled Recursive Averaging) noise estimation based ,technology for noise elimination ,▪ Multiple Chanel Based Noise Elimination Technology ,Noise Filtering ,- ,- ,Acoustic beam forming based noise elimination technology ,Post-filter based noise elimination technology ,※ Possible to deal with none-stationary noise with the estimation of noise ,component using the delay between MIC signals ,▪ Incomplete Match Between Query Object and Target Object and Similarity ,Search Technique ,High Dimensional ,Fuzzy Database ,Search ,Module ,- Dissimilarity measure technique through hamming distance ,▪ Indexing(Inverted File) Technique ,- Generation technique of additional fingerprint index with n toggle beat ,▪ Inverted Index Search Technique and Data Base Search Techniques ,Through Similarity Comparison ,- ,- ,Application of multiple match principle, offset match principle, premature ,termination principle ,Judging technique of search band through hamming distance ,Multiple Hashing ,Based Search ,Module ,▪ Multiple Hashing Algorithm(MLH) Technology ,- ,Extraction and search technology of Sub Fingerprint ,- Calculation of discrete cosine transform(DCT) ,▪ PRH algorithm based bit error rate analysis technology ,▪ Real Time Audio Fingerprint Extraction Technology ,- ,Frame creation, Fast Fourier Transform(FFT), center of gravity ,calculation, DNA creation, mute handling technique ,▪ Sequential Method of Database Search Technology ,Real Time DNA ,- ,The existing methods of indexing and clustering are judged to be ,Extraction ,inefficient ,▪ Server Construction Technology for concurrent processing of Multiple ,Channels(more thant 10 channels) ,▪ Processing Technology for Online Based Realtime Broadcasting Video ,Streaming (RTMP, RTSP, etc.) ,▪ Infrastructure and Sub Project Construction Technology for Disputed ,Computing ,- Combination of HDFS and MapReduce(Master-Slave) and High-level of ,Big Data ,- HDFS: Meta-information management technology through distributed file ,abstraction Processing Technology ,Search System ,system ,- MapReduce: Program modeling technology for data ,processing(Map&Reduce) ,- HBASE: Column-based database handling technology implemented on ,HDFS ,Mobile Application ,A. (SYNCHro Portal) Barrier-Free Mobile Application ,B. (SYNCHro CP) Barrier-Free Mobile Application ,C. (SYNCHro Movie) Barrier-Free Mobile Application ,Product Competitiveness ,Drawbacks of Existing Barrier-Free Movie Service ,Hardware based closed-type subtitle service ,Focused only on movie screenings for the sight and hearing impaired, not for multilingual subtitle ,service for foreigners ,Copy rights issue with modification of the original film(DCP) ,Financial issues regarding supplying hardware in the early stages ,- ,- ,- ,- ,- ,"Captiview" for the hearing impaired and "Fidelio" for the visually impaired ,Presentation of Alternative ,⌜Barrier-free movie subtitle mobile platform: SYNCHro⌟is the first barrier-free service based on a mobile ,device in South Korea that resolves physical handicap and language barrier of on movi e contents ,consumption by using sound recognition technology. In theaters, users(foreigners, the disabled) will be ,provided with subtitles(texts) and audio descriptions(sound) that are synchronized with the time code ,extracted by analyzing audio signals coming from smart phones. In other words, subtitles and audio ,description service through smart devices creates barrier -free environment that the visually and hearing ,impaired and foreigners can watch movie together in the same place, at the same time. ,Proposing a business... ,A barrier-free movie means a movie with subtitles and audio descriptions, so that disabled and non -,disabled people can enjoy together. For visually and hearing impaired people, watching movie is not easy. ,The beauty of the sequence and sound, which is the core of a movie, is another barrier for them. However, ,barrier-free movie helps the visually impaired to "see" through the sound(audio descriptions), and let the ,hearing impaired to "listen" using the visual image(subtitles). We can watch movies with our heart, not only ,with eyes. Chihoko Ibana, the president of "City Lights(Japanese barrier -free voluntary association)", said ,that "There is something special in a theater. People in a theater share something, and it moves their heart." ,This means a lot. ,Barrier-free movies should be approached with the very basic question, "How a film meets its audience and ,communicate with them?". For physical disabilities such as visual or hearing impairment, there will be more ,obstructions then the threshold or stairs of theater. The real barrier is the sympathy that non -disabled people ,have for them. Now is the time to change our mind and the environment for the good of all as Selwyn ,Goldsmith established 'Universal Design' when she wrote . In the work ,of improving the movie-watching environment for the disabled, the approach must be comprehensive and ,include screening infrastructures, contents(subtitles, audio descriptions), barrier -free movie screening ,equipment of theaters, etc. ,The current barrier-free movie screening has copyright and financial problems by adding subtitles and ,mixing sound for audio description. It also has the issue of reverse discrimination against the disabled, since ,existing screening system requires separated theater for them and the meaning of ,⌜Barrier-free movie subtitle mobile platform: SYNCHro⌟ is the first service in South Korea to help ,provide visually and hearing impaired people with subtitle contents. Anyone can downlo ad barrier-free ,contents from smart phones, then SYNCHro analyzes the sound of original contents(movies, broadcasts, ,etc.), extract the time code, and synchronize it with subtitles(texts, audio descriptions) for the disabled and ,foreigners. Through this technology, we will be able to overcome the limitation of current barrier -free movie ,system and to create supplementary industry such as subtitle production and technology industry related to. ,The day that the disabled and non-disabled can share the joy and impression of a movie will come soon. ,
