AIdea

0 / 0

participants / team

Topic provider

Competition Guidance Unit: Department of Information and Technology Education, Ministry of Education

Introduction

According to global statistics, there are approximately 2.2 billion badminton players worldwide and more than 3 million in Taiwan. This single sport is ranked second in terms of national popularity. In recent years, badminton players have achieved outstanding performances in international competitions, gradually increasing the public attention.

In terms of badminton skills and tactics analysis, our team has proposed a match shuttlecock recording format and developed a computer vision assisted quick shuttlecock labeling program to initiate the research of badminton big data. Although many computer-assisted techniques have been used, manual shuttlecock labeling still requires manpower and time, especially for technical data identification, which requires badminton experts to perform. Through this competition, we hope to invite machine learning, image processing, and sports science expertise to develop an automatic shuttlecock labeling model with a high recognition rate, making the massive badminton information collection possible, and thus popularizing the research and application of badminton tactics analysis.

Contacts：jason880102.cs10@nycu.edu.tw
Facebook： 2023 AI CUP：教電腦、看羽球

Participants

Registration is open to all students (e.g. high school students, college students, graduate students, etc.) and members of the general public.
The competition is divided into student and public groups. The student group requires all team members to be students; if any member of the team is not a student, the team will be classified as the public group. Only student group teams will be included in the overall competition ranking.

Prize

Award		Prize Money
Champion	1 team	90,000 TWD
Runner-up	1 team	60,000 TWD
Third place	1 team	40,000 TWD
Best Paper Award	1 team	10,000 TWD
Honorable Mention	10 teams	5,000 TWD

All members of the student team must be current students at the time of registration, and relevant certificates must be attached when the awards are presented.
The prize will be distributed by remittance in NT dollars, and the winning team should pay relevant income tax in accordance with the tax laws of the Republic of China.
The winning team must submit the original code and final report that can reproduce the model before the specified deadline to verify the results.
The instructor/mentor cannot register as a contestant with the student team; they can only assist the contestants as an instructor. If the competition team has an instructor/mentor, please fill in the relevant fields in the registration system and fill in the information of the instructor/mentor (including name, school/company name, department/title, e-mail address) in the final report. The host will contact the instructor/mentor to fill in the proof of guidance according to the e-mail address information. The instructor/mentor is an optional item; if there is none, it can be left blank.
The top 13 student teams will receive a certificate of honor from the Ministry of Education of ROC. The personal information of the winning team members will be based on the information filled in the final report and will be used as the information for the production and distribution of the awards. The Best Paper Award will be based on the uploaded report and program code as the scoring criteria. The Best Paper Award can be awarded multiple times with other awards.
Teams whose rankings are in the top 25% and exceed the baseline (including the public group) will be awarded an electronic certificate of honor from the Ministry of Education Artificial Intelligence Competition Project Office after review by the judges. This award will not be repeated with the previous award.
Any member of the winning team of the student teams who have won top three ranking three times or above of the "Ministry of Education's National College Artificial Intelligence Competition ( AI CUP ) " organized by the "Ministry of Education's Artificial Intelligence Competition and Labeling Data Collection Project Office", will not be restricted from continuing to participate in the competition. The award is cumulative from the fall competition of 2022. If future competitions meet the above conditions, the team will only receive a certificate of honor from the Ministry of Education and no prize money. The prize money will be transferred to the second-place team, and the two teams will be tied for the same place.
The number of awards will be adjusted according to the number of entries and scores. Entries that do not meet the standards will be selected for deficiency or lack of entry by the selection judges.
Winning teams must submit a complete implementation program and design documents to the host within the designated deadline after the competition is over. If necessary, the host may require the contestants to help set up the environment to reproduce. The contestants cannot refuse, otherwise they will be considered as not passing the review.
The winning teams must designate at least one representative to attend the subsequent award activities according to the notification of the host. If there are no teammates to help, family and friends can be invited to attend the award ceremony and make presentations.
The top three award-winning teams must agree to open source code, and those who do not agree to open source can only be classified as excellent entries at the review stage at best.

Activity time

Date	Event
2023/03/01 ( Wed )	Registration opens
2023/03/15 ( Wed )	Training and test data sets open for download
2023/03/22 ( Wed )	Open for result upload and public leaderboard scores announcement
2023/05/02 ( Tue ) 11:59:59 am	Registration closes
2023/05/09 ( Tue ) 11:59:59 am	Private test data set open for download and public + private answer uploading, but only public leaderboard scores will be announced
2023/05/16 ( Tue ) 23:59:59 pm	Closure of result uploading
2023/05/17 ( Wed ) 17:00:00 pm	Private leaderboard scores announcement and start uploading reports and codes
2023/05/24 ( Wed ) 23:59:59 pm	Report and program code uploading deadline
2023/06/09 ( Fri )	Final results announcement
2023/07 ( Tentative )	Award ceremony and prize money distribution, all arranged by the Project Office

Evaluation Criteria

Score a single video clip as one question and score each separately, with a total score of 1 point per question. First, compare the number of shots in the score video, with each row of the CSV file considered as one shot: if the predicted number of shots is different from the true value, the question will be scored as zero; if the number of shots is the same, 0.1 points will be awarded and proceed to the next stage to compare the content of the columns, with the highest score for columns content being 0.9 points.
If the number of shots is correct, compare each shot in sequence, each shot scored according to the total score of the columns, then the average of each shot's score is the score for column content. First check the HitFrame column: if the prediction error is greater than 2 frames compared to the true value, the shot will get 0 points and proceed to the next shot for scoring; if the prediction error is not more than 2 frames, 0.1 points will be given and continue to compare other columns in the same shot.

Hitter : 0.1 points if correct, 0 points otherwise.
BallHeight : 0.1 points if correct, 0 points otherwise.
BallLocation : If the prediction error less than 6 pixels (Euclidean distance) considered correct, 0.1 points, otherwise 0 points.

$$ \sqrt{(x_{gt}-x_{pred})^2+(y_{gt}-y_{pred})^2}<6 $$

HitterLocation : If the prediction error less than 10 pixels ( Euclidean distance ) , considered correct, 0.05 points, otherwise 0 points.

$$ \sqrt{(x_{gt}-x_{pred})^2+(y_{gt}-y_{pred})^2}<10 $$

DefenderLocation : If the prediction error is less than 10 pixels ( Euclidean distance ) , it is scored 0.05 points, otherwise 0 points.

$$ \sqrt{(x_{gt}-x_{pred})^2+(y_{gt}-y_{pred})^2}<10 $$

BackHand : 0.05 points if correct, 0 points otherwise .
AroundHead : 0.05 points for correctness, 0 points otherwise .
BallType : 0.2 points for correct, 0 points otherwise.
Winner : 0.1 points if correct, 0 points otherwise . (Note : If it is not the last shot but filled in, it will be considered incorrect.)

Assuming that there are $R$ number of score video in the data set, and the $i$th video have $S_i$ shots, the full code of the formula below is the relevant field data of the $j$th shot:

$$ \frac1R\sum_{i=1}^R1_{S_i=S_i^{pred}}(0.1+AvgShotScore) $$

in which the formula for Average Shot Score is:

$$ AvgShotScore=\frac1{S_i}\sum_{j=1}^{S_i}1_{\vert HitFrame_j-HitFrame_j^{pred}\vert\leq2}(0.1+ShotScore) $$

$$ \begin{array}{lcl}ShotScore&=&0.1\times1_{Hitter_j=Hitter_j^{pred}}\\&&+0.1\times1_{BallHeight_j=BallHeight_j^{pred}}\\&&+0.1\times1_{\left\|BallLocation_j-BallLocation_j^{pred}\right\|<6}\\&&+0.05\times1_{\left\|HitterLocation_j-HitterLocation_j^{pred}\right\|<10}\\&&+0.05\times1_{\left\|DefenderLocation_j-DefenderLocation_j^{pred}\right\|<10}\\&&+0.05\times1_{BackHand_j=BackHand_j^{pred}}\\&&+0.05\times1_{AroundHead_j=AroundHead_j^{pred}}\\&&+0.2\times1_{BallType_j=BallType_j^{pred}}\\&&+0.1\times1_{Winner_j=Winner_j^{pred}}\end{array} $$

Rules

Test dataset predictions are uploaded up to five times a day, with the scores obtained from the last upload ranking. When submitting the private answer, the answer (public + private) must be submitted together with the public test dataset prediction result.
Teams are not allowed to register multiple accounts to participate in the same competition, otherwise they will lose the qualification of the competition. Individual members of the team can submit results with their own personal accounts, which will also be regarded as multiple accounts participation.
Team Competition Mode:
1. Teams enroll according to the competition group, with a maximum of 5 members.
2. Each team selects a captain, and all rights and obligations (including notifications sent by the organizer and the distribution of awards, etc.) shall be notified and accepted by the captain.
3. After forming a team, new members cannot be added.
4. Once you join a team, you cannot change teams .

Any member of the winning team of the student teams who have won top three ranking three times or above of the "Ministry of Education's National College Artificial Intelligence Competition ( AI CUP ) " organized by the "Ministry of Education's Artificial Intelligence Competition and Labeling Data Collection Project Office", will not be restricted from continuing to participate in the competition. The award is cumulative from the fall competition of 2022. If future competitions meet the above conditions, the team will only receive a certificate of honor from the Ministry of Education and no prize money. The prize money will be transferred to the second-place team, and the two teams will be tied for the same place.
Teams can use additional resources such as additional images and packages to improve the model training results, but they cannot manually annotate the test dataset (Test Data) in an artificial manner. If additional resources are used, the source explanation should be provided in the written report submitted.
The data, technology and code used in the participating works belong to the participating teams. Any third party claiming infringement of intellectual property rights or other violations shall be dealt with by the participating teams themselves; if there is any infringement The intellectual property rights of others, if verified by the organizer, will cancel the competition and award qualifications, and the participating teams should bear the relevant legal responsibilities themselves.
To ensure the fairness of the competition, the organizers will require the award-winning teams to submit the final report, including but not limited to (1) members, (2) model algorithms explanation, (3) original code and explanation, (4) additional resources. The submitted code should be successfully executed in Google Colaboratory to verify the results. In case of fraud, plagiarism or cheating, the organizer may cancel the contestant's eligibility and reclaim the prize. The contestant shall bear the legal responsibility.
The intellectual property rights of the competition results belong to the contestant's team. The related matters of copyright authorization, patent application, technology transfer and rights distribution should be handled in accordance with the relevant laws and regulations.
The award-winning team shall pay relevant income tax in accordance with the tax laws of the Republic of China.
The organizer reserves the right to adjust the data set during the competition if necessary.
In the event of any of the following circumstances, the organizer may disqualify the contestant or receive the award without informing the contestant:
1. There has been specific evidence that the team has any plagiarism, cheating, or fraud.
2. There has been specific evidence that the team he belongs to has infringed on the intellectual property rights of others.
3. There has been specific evidence that the team he belongs to has attacked the Leaderboard system.
4. There have been concrete evidences that the teams to which they belong affect other participating teams and lead to unfair cases .

Teams that violate the rules of this competition will be disqualified. If awards have been given, the awards will be revoked, and the prize money and certificates will be retrieved.
The recipients of the Ministry of Education’s prize money must be students with Taiwan citizenship who are enrolled in school at the time of registration. The prize must also be awarded to the entire team, and relevant proof must be presented when the prize is given. If there are teams composed of social people in this competition, they can receive an electronic certificate from the Office of the Artificial Intelligence Competition Project of the Ministry of Education.
The instructor/mentor cannot register as a contestant with the student team; they can only assist the contestants as an instructor. If the competition team has an instructor/mentor, please fill in the relevant fields in the registration system and fill in the information of the instructor/mentor (including name, school/company name, department/title, e-mail address) in the final report. The host will contact the instructor/mentor to fill in the proof of guidance according to the e-mail address information. The instructor/mentor is an optional item; if there is none, it can be left blank.
The award-winning supervisor/professional can only receive a certificate from the Ministry of Education, but not a bonus from the Ministry of Education, and the supervisor/professional filled in the student's final report shall prevail .
All other matters not specified herein shall be mutually discussed and agreed upon by the parties in accordance with the existing circumstances.
All entrants shall be deemed to have read and fully agreed to all the regulations of this event.
The organizer reserves the right to the final interpretation of this event in case of any dispute.