Click on " Study Algorithm " above, and choose to add " star " or " top "
Heavy dry goods, delivered as soon as possible
Fengse comes from the qubit of the concave temple | public account QbitAI
What can undergraduate students do in scientific research ?
The latest paper included in CVPR 2022 provides a new idea to solve the classification problem of long-tailed distribution data in deep learning , and finally realizes the new SOTA.
The article has a total of 5 authors, including doctoral students and senior researchers from A*STAR in Singapore...
And in the first place is an undergraduate student from Tianjin University , Li .
The amazing thing is that this is not the first top conference paper of this "newborn calf". Before that, he also won a top conference in the field of data mining (WWW 2022), which is also a work.
Undergraduates engaged in scientific research, has the momentum already been so strong?
If you enter the lab in your junior year, you will have 2 top conferences in your senior year.
Li is from the Department of Intelligence and Computing , Tianjin University, and is a senior this year .
This CVPR article mainly uses a new ensembling learning strategy to solve the problem of long-tail classification.
We all know that the long-tailed distribution is a very common application of deep learning for the classification of these data.
Its difficulty is mainly that the sample size is extremely unbalanced , especially if the tail sample size is too small , it is difficult to obtain effective training results.
Currently, ensemble learning-based methods show great potential, achieving SOTA performance.
But this approach has two limitations:
One is that predictions in failure-sensitive applications are usually unreliable, which has a great impact on tail data, which is very error-prone;
The second is that it allocates a uniform number of resources (experts) to all samples, which results in redundant and high computational costs for simple samples.
Therefore, Li et al. proposed to realize automatic perception of tail category samples by introducing uncertainty ensemble.
On this basis, it is proposed to dynamically allocate more model resources (experts) for tail category samples than head samples to take into account both performance and efficiency.
Finally, the obtained model realizes automatic detection and training adjustment of tail category samples, and becomes a general model for solving long-tail classification problems.
Comprehensive experiments on a series of tasks such as classification, tail detection, outlier detection, and fault prediction demonstrate that the performance of the model successfully beats existing SOTA methods .
In June of this year, Li is about to graduate with an undergraduate degree and will directly enter Purdue University as a doctoral student under the tutelage of Professor Zhang.
Professor Zhang has just graduated from Cornell University with a Ph.D. in Statistics and is an Assistant Professor at Purdue University. Her research interests are machine learning and the construction of probabilistic models in data science.
When he was a junior, he entered the machine learning and data mining laboratory of the faculty with his excellent academic performance .
Under the leadership of Zhang Changqing (Ph.D. supervisor of Tianjin University), Li won the bid for two top papers after just one and a half years of study .
It can be said that the afterlife is terrifying.
More and more undergraduates are starting to send top clubs
However, when it comes to undergraduates engaging in scientific research, in fact, everyone should pay attention. Many schools are becoming more and more open and attaching importance to this matter:
In the junior year or lower , some places will be opened for potential students to enter the laboratory and engage in scientific research with graduate students and doctoral students.
For example, Tsinghua's "Spark Class" recruits sophomore students, Peking University also encourages students to start scientific research projects from their sophomore year, and schools such as the University of Science and Technology of China will also give special scholarships to undergraduates who have made corresponding achievements .
Under such circumstances, there are already many students like Li who have published the top conference during their undergraduate years, which can be said to be full of halo.
For example , Gao Tianyu, a Tsinghua Special Award winner and a 2016 undergraduate who we are familiar with , has four top conferences in his four years of college: two AAAI, two EMNLP, and a live broadcast dedicated to imparting his own scientific research experience .
For example , Mao Xiao, an MIT undergraduate student , won the bid for FOCS 2021, the top computer theory conference in his senior year, and won the Best Student Paper Award.
Another example is Liu Hong, an undergraduate student of the Department of Electronics of Tsinghua University, who has 3 papers and a top conference; Wu Kewen, an undergraduate student of Peking University, not only presented the top conference (ACM Annual Conference of Computing Theory STOC), but also won the best paper award; and Wang Tan, an undergraduate student of the University of Electronic Science and Technology of China, also has 1 essay, 1 essay, CVPR 2020, Zhejiang University undergraduate students, 1 essay, 1 essay, ICML 2019...
There are many similar examples.
It can be said that undergraduates are getting more and more powerful in scientific research, what do you think?
Paper address:
https://arxiv.org/abs/2111.09030
Reference link:
http://cic.tju.edu.cn/info/1040/3704.htm
-End- _ _
Click to see the paper constantly!