January 09, 2024
KIPO Announced its World’s First Hyperscale AI Language Model Exclusively for Patents
Korean Intellectual Property Office (KIPO) and LG AI Research held a special event at the Government Complex Daejeon on Thursday, December 21st, 2023, celebrating their successful collaboration through a groundbreaking initiative in the field of applying artificial intelligence (AI) technology into patent administration. The creation of the world's first ever hyperscale AI language model specialized in patents, which was unveiled for the first time at the event, was the valuable result of the six-month dedicated efforts.
KIPO's partnership with LG AI Research to produce hyperscale AI language model specialized in patents
In July 2023, KIPO signed a memorandum of understanding with LG AI Research to cooperate with one another in developing an AI-based technological solution to be deployed to enhance the Office's work efficiency. For starters, both sides had worked on making a patent-specific AI language model with 8.8 billion parameters, based on LG's super-large multimodal AI, EXAONE. The project team trained it with seven different kinds of patent-related data (1.78 TB)* held by KIPO, and kept improving its performance by undertaking a two-step process of pre-training and fine-tuning.
*Korean/English patent gazettes, office actions, machine translations, CPC classification, machine reading comprehension, customer services cases
After months of putting in much resources and efforts, the developed model demonstrated superior performance across the evaluation fields that included sentence summarization and automatic translation, indicating promising prospects for further advancement after sectional refinement.
In the pipeline: Development of an AI tool that will assist with KIPO's examination services
Leveraging the successful development experiences and the new language model with high capabilities, KIPO is set to move on to the second phase of its ambitious plan for innovating its examination services including prior art search and classification, with new technologies. Representatives from both sides attending the event shared their views and plans on upcoming cooperation in this regard.
"We are very much pleased to have worked with LG AI Research, one of the leading research institutes in the field of AI technology and have produced such a valuable outcome together," said Commissioner of KIPO LEE Insil. "We will keep brining in innovative technologies into our key missions and functions in patent operations, to be the leading office in advancing patent systems."
In his remarks, Chief of LG AI Research BAE Kyunghoon expressed his expectation on its "EXAONE that was trained with a vast amount of patent literatures to contribute to raising KIPO's work efficiency and productivity to a higher level, facilitating further growth of our nation's AI-related industries." "Going forward, LG AI Research will remain committed to cooperating with KIPO in building and using an expert AI that would serve as an example for the world," added Chief Bae.