Technology peripherals
AI
The eighth event of the Zhejiang University Postdoctoral Academic Salon: NetEase Fuxi discusses new areas of intelligence
The eighth event of the Zhejiang University Postdoctoral Academic Salon: NetEase Fuxi discusses new areas of intelligence
On June 5, the eighth session of the Zhejiang University Postdoctoral Academic Salon concluded successfully at the Yuquan Campus of Zhejiang University. This event is a joint academic salon organized by the Zhejiang University Postdoctoral Association and NetEase Fuxi Laboratory. The four keynote speakers, Ph.D. Fan Changjie, Ding Yu, Li Lincheng, and Zhao Zeng, are all from NetEase Fuxi Laboratory. The theme of this salon is the work results of NetEase Fuxi Laboratory in the field of artificial intelligence. Fan Changjie shared the research results on agent-oriented programming, Ding Yu introduced related research on digital virtual humans, Li Lincheng explained the progress in visual computing, and Zhao Zeng focused on sharing the results of AIGC system construction. Through this salon, participants had an in-depth understanding of the innovative achievements of NetEase Fuxi Lab in the field of artificial intelligence and had in-depth exchanges and discussions. This salon event provides a valuable academic exchange platform for Zhejiang University postdoctoral fellows and promotes the development of academic cooperation and innovative research.
In the sharing, Fan Changjie, head of NetEase Fuxi, said that as the aging of the nation deepens and the demographic dividend disappears, labor shortages and high labor costs will continue to plague all walks of life. . Therefore, letting artificial intelligence (AI) and robots handle repetitive, high-risk tasks and improve human value has become an inevitable trend in the development of intelligent society in today's society. As the top artificial intelligence laboratory in China, NetEase Fuxi is committed to exploring a path with human-machine collaboration as the core to solve the practical problems faced by enterprises such as high AI threshold, long research and development cycle, and difficulty in application implementation.
The Aura Robot Platform is a new programming paradigm based on this background and designed around ideas such as AOP. Its core value is to provide a unified interface for connecting machines (or AI) and humans. Standardize interfaces and services. At present, many businesses of NetEase Fuxi have been connected to this theoretical method. Take the construction of key infrastructure projects in Southwest China as an example: On the one hand, the platform allows traditional excavators to achieve intelligent production through human-machine collaboration. On the other hand, through online distribution of crowdsourcing tasks, traditional excavator masters no longer engage in repetitive, boring and dangerous tasks. sex work. In addition to mining robot application scenarios, the platform has also been implemented in game character face-making, image and text recognition detection, smart parks, art crowdsourcing and other scenarios, verifying the strong implementation, sustainability and replicability of the human-machine collaboration platform. sex.
In this exchange, Dr. Ding Yu from NetEase’s Fuxi digital virtual human department introduced the latest progress of Fuxi’s cutting-edge research and practical applications in the virtual human expression field. Regarding the three aspects of AI expression synthesis, capture and binding, he shared the in-depth exploration and practice of Fuxi team and demonstrated the practical effects of applying these technologies in many NetEase games. Among them, the application of Fuxi AOP programming paradigm provides an effective solution for modeling the algorithm process of AI expression capture and binding. This work has been successfully applied to many NetEase games, such as "Ni Shui Han", "Tian Yu", "Meet Ni Shui Han" and "Ni Shui Han (Mobile Game)". The above work is dedicated to realizing the automatic generation and cross-character reuse of 3D expression parameters. In addition, Fuxi has published more than 20 top conference and journal papers in the field of expressions, and took the lead in proposing 135 classification standards for expressions, further promoting industry progress. Not only that, Fuxi has won the championship and runner-up of the Expression Perception Challenge (ABAW) for three consecutive times in the top conferences in the field of image vision (ICCV2021, CVPR2022-2023), winning a total of six championships and two runner-ups.
Dr. Li Lincheng, who works in the visual computing direction of NetEase Fuxi, mainly shared the intelligent exploration of 3D character and scene creation for games and Metaverse applications. The previous manual modeling process required a heavy workload and was difficult to meet the diverse, personalized, and customized needs of users. In this regard, Dr. Li introduced in detail NetEase Fuxi’s research work on 3D character and scene intelligent creation (3D AIGC). Through an intelligent creation solution based on 3D skeletons and meshes, users only need to input images or text to create real three-dimensional characters, replicate digital twins of real 3D scenes, and even generate ideal 3D scenes, fully satisfying personalization and Customize needs and optimize user experience. The application of these results provides unlimited possibilities for the construction of the digital world and data representation, and injects new vitality into the industry.
At the end of the exchange, NetEase Fuxi artificial intelligence expert Dr. Zhao Zeng shared the content about "NetEase Fuxi AIGC System Construction and Practice". He pointed out that generative artificial intelligence technology continues to mature, driven by natural language, and continues to refresh the public's understanding of its generative effects on text, images, audio and video, and 3D content. However, when generative artificial intelligence technology enters industrial scenarios from the research field, it still faces multiple challenges, including issues in multiple dimensions such as controllability, adaptability, and cost. By solving these challenges, generative artificial intelligence technology can be better applied in actual scenarios.
NetEase Fuxi's self-developed graphic and text model-Danqing
NetEase Fuxi began to build generative artificial intelligence technology in 2018, and received approval from the Zhejiang Provincial Department of Science and Technology Support key R&D projects. The scale of self-developed models has grown from the earliest 100 million parameters to 100 billion parameters. The model field has expanded from text to graphics, music, behavioral sequences and other modalities, and it has accumulated rich experience in pre-training model training and engineering optimization. Relevant technologies have also been applied in business scenarios such as word games, intelligent NPCs, text-assisted creation, music-assisted creation, art design, and Internet search recommendations within NetEase Group, and have achieved significant business results.
NetEase Fuxi, as the top institution in China specializing in the research and application of AI in games and pan-entertainment, will continue to develop in reinforcement learning, image actions, virtual humans, natural language, user portraits, large-scale Continue to explore areas such as pre-training models, and combine the crowdsourcing capabilities of intelligent robots to introduce "human" decision-making and data closed loops to further enhance the capabilities of intelligent agents.
The above is the detailed content of The eighth event of the Zhejiang University Postdoctoral Academic Salon: NetEase Fuxi discusses new areas of intelligence. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
Undress AI Tool
Undress images for free
Clothoff.io
AI clothes remover
Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Hot Topics
Bytedance Cutting launches SVIP super membership: 499 yuan for continuous annual subscription, providing a variety of AI functions
Jun 28, 2024 am 03:51 AM
This site reported on June 27 that Jianying is a video editing software developed by FaceMeng Technology, a subsidiary of ByteDance. It relies on the Douyin platform and basically produces short video content for users of the platform. It is compatible with iOS, Android, and Windows. , MacOS and other operating systems. Jianying officially announced the upgrade of its membership system and launched a new SVIP, which includes a variety of AI black technologies, such as intelligent translation, intelligent highlighting, intelligent packaging, digital human synthesis, etc. In terms of price, the monthly fee for clipping SVIP is 79 yuan, the annual fee is 599 yuan (note on this site: equivalent to 49.9 yuan per month), the continuous monthly subscription is 59 yuan per month, and the continuous annual subscription is 499 yuan per year (equivalent to 41.6 yuan per month) . In addition, the cut official also stated that in order to improve the user experience, those who have subscribed to the original VIP
Context-augmented AI coding assistant using Rag and Sem-Rag
Jun 10, 2024 am 11:08 AM
Improve developer productivity, efficiency, and accuracy by incorporating retrieval-enhanced generation and semantic memory into AI coding assistants. Translated from EnhancingAICodingAssistantswithContextUsingRAGandSEM-RAG, author JanakiramMSV. While basic AI programming assistants are naturally helpful, they often fail to provide the most relevant and correct code suggestions because they rely on a general understanding of the software language and the most common patterns of writing software. The code generated by these coding assistants is suitable for solving the problems they are responsible for solving, but often does not conform to the coding standards, conventions and styles of the individual teams. This often results in suggestions that need to be modified or refined in order for the code to be accepted into the application
Seven Cool GenAI & LLM Technical Interview Questions
Jun 07, 2024 am 10:06 AM
To learn more about AIGC, please visit: 51CTOAI.x Community https://www.51cto.com/aigc/Translator|Jingyan Reviewer|Chonglou is different from the traditional question bank that can be seen everywhere on the Internet. These questions It requires thinking outside the box. Large Language Models (LLMs) are increasingly important in the fields of data science, generative artificial intelligence (GenAI), and artificial intelligence. These complex algorithms enhance human skills and drive efficiency and innovation in many industries, becoming the key for companies to remain competitive. LLM has a wide range of applications. It can be used in fields such as natural language processing, text generation, speech recognition and recommendation systems. By learning from large amounts of data, LLM is able to generate text
Can fine-tuning really allow LLM to learn new things: introducing new knowledge may make the model produce more hallucinations
Jun 11, 2024 pm 03:57 PM
Large Language Models (LLMs) are trained on huge text databases, where they acquire large amounts of real-world knowledge. This knowledge is embedded into their parameters and can then be used when needed. The knowledge of these models is "reified" at the end of training. At the end of pre-training, the model actually stops learning. Align or fine-tune the model to learn how to leverage this knowledge and respond more naturally to user questions. But sometimes model knowledge is not enough, and although the model can access external content through RAG, it is considered beneficial to adapt the model to new domains through fine-tuning. This fine-tuning is performed using input from human annotators or other LLM creations, where the model encounters additional real-world knowledge and integrates it
Five schools of machine learning you don't know about
Jun 05, 2024 pm 08:51 PM
Machine learning is an important branch of artificial intelligence that gives computers the ability to learn from data and improve their capabilities without being explicitly programmed. Machine learning has a wide range of applications in various fields, from image recognition and natural language processing to recommendation systems and fraud detection, and it is changing the way we live. There are many different methods and theories in the field of machine learning, among which the five most influential methods are called the "Five Schools of Machine Learning". The five major schools are the symbolic school, the connectionist school, the evolutionary school, the Bayesian school and the analogy school. 1. Symbolism, also known as symbolism, emphasizes the use of symbols for logical reasoning and expression of knowledge. This school of thought believes that learning is a process of reverse deduction, through existing
To provide a new scientific and complex question answering benchmark and evaluation system for large models, UNSW, Argonne, University of Chicago and other institutions jointly launched the SciQAG framework
Jul 25, 2024 am 06:42 AM
Editor |ScienceAI Question Answering (QA) data set plays a vital role in promoting natural language processing (NLP) research. High-quality QA data sets can not only be used to fine-tune models, but also effectively evaluate the capabilities of large language models (LLM), especially the ability to understand and reason about scientific knowledge. Although there are currently many scientific QA data sets covering medicine, chemistry, biology and other fields, these data sets still have some shortcomings. First, the data form is relatively simple, most of which are multiple-choice questions. They are easy to evaluate, but limit the model's answer selection range and cannot fully test the model's ability to answer scientific questions. In contrast, open-ended Q&A
SOTA performance, Xiamen multi-modal protein-ligand affinity prediction AI method, combines molecular surface information for the first time
Jul 17, 2024 pm 06:37 PM
Editor | KX In the field of drug research and development, accurately and effectively predicting the binding affinity of proteins and ligands is crucial for drug screening and optimization. However, current studies do not take into account the important role of molecular surface information in protein-ligand interactions. Based on this, researchers from Xiamen University proposed a novel multi-modal feature extraction (MFE) framework, which for the first time combines information on protein surface, 3D structure and sequence, and uses a cross-attention mechanism to compare different modalities. feature alignment. Experimental results demonstrate that this method achieves state-of-the-art performance in predicting protein-ligand binding affinities. Furthermore, ablation studies demonstrate the effectiveness and necessity of protein surface information and multimodal feature alignment within this framework. Related research begins with "S
SK Hynix will display new AI-related products on August 6: 12-layer HBM3E, 321-high NAND, etc.
Aug 01, 2024 pm 09:40 PM
According to news from this site on August 1, SK Hynix released a blog post today (August 1), announcing that it will attend the Global Semiconductor Memory Summit FMS2024 to be held in Santa Clara, California, USA from August 6 to 8, showcasing many new technologies. generation product. Introduction to the Future Memory and Storage Summit (FutureMemoryandStorage), formerly the Flash Memory Summit (FlashMemorySummit) mainly for NAND suppliers, in the context of increasing attention to artificial intelligence technology, this year was renamed the Future Memory and Storage Summit (FutureMemoryandStorage) to invite DRAM and storage vendors and many more players. New product SK hynix launched last year
