NO PURCHASE NECESSARY TO ENTER OR WIN. VOID WHERE PROHIBITED. CONTEST IS OPEN TO RESIDENTS OF THE 50 UNITED STATES, THE DISTRICT OF COLUMBIA AND WORLDWIDE, EXCEPT FOR ITALY, BRAZIL, QUEBEC, CRIMEA, CUBA, IRAN, SYRIA, NORTH KOREA, and SUDAN (Current list of countries under export sanctions) ENTRY IN THIS CONTEST CONSTITUTES YOUR ACCEPTANCE OF THESE OFFICIAL RULES.
The EfficientQA contest (the “Contest”) is a skill contest where participants must develop a system for computational open-domain question answering. Contestants will submit systems that can predict answers for english language questions, and the accuracy of these answers will be judged. The code that you develop will be evaluated by judges, who will choose the winner(s) in accordance with these Official Rules. The prize(s) will be awarded to participant(s) with the highest score for the judging criteria. See below for the complete details.
1. BINDING AGREEMENT: In order to enter the Contest, you must agree to these Official Rules (“Rules”). Therefore, please read these Rules prior to entry to ensure you understand and agree. You agree that submission of an entry in the Contest constitutes agreement to these Rules. You may not submit an entry to the Contest and are not eligible to receive the prizes described in these Rules unless you agree to these Rules. These Rules form a binding legal agreement between you and Google with respect to the Contest.
2. ELIGIBILITY: To be eligible to enter the Contest, you must be: (1) above the age of majority in the country, state, province or jurisdiction of residence (or at least twenty years old in Taiwan) at the time of entry; (2) not a resident of Italy, Brazil, Quebec, Crimea, Cuba, Iran, Syria, North Korea, or Sudan); (3) not a person or entity under U.S. export controls or sanctions; and (4) have access to the Internet as of 2020/09/28. Contest is void in Italy, Brazil, Quebec, Crimea, Cuba, Iran, Syria, North Korea, Sudan), and where prohibited by law. Employees, interns, contractors, and official office-holders of Google, Princeton University, the University of Washington, the University of Maryland, and their parent companies, subsidiaries, affiliates, and their respective directors, officers, employees, advertising and promotion agencies, representatives, and agents (“Contest Entities”), and members of the Contest Entities’ and their immediate families (parents, siblings, children, spouses, and life partners of each, regardless of where they live) and members of the households (whether related or not) of such employees, officers and directors are ineligible to participate in this Contest. Sponsor reserves the right to verify eligibility and to adjudicate on any dispute at any time.
If you are entering as part of a company or on behalf of your employer, these rules are binding on you, individually, and/or your employer. If you are acting within the scope of your employment, as an employee, contractor, or agent of another party, you warrant that such party has full knowledge of your actions and has consented thereto, including your potential receipt of a prize. You further warrant that your actions do not violate your employer’s or company’s policies and procedures.
3. SPONSOR: The Contest is sponsored by Google Inc. (“Google” or “Sponsor”), a Delaware corporation with principal place of business at 1600 Amphitheater Parkway, Mountain View, CA, 94043, USA.
4. CONTEST PERIOD: The Contest begins at 12:00:00 A.M. (UTC) Zone in the United States on 2020/10/09 and ends at 11:59:59 P.M. UTC on 2020/11/14 (“Contest Period”). ENTRANTS ARE RESPONSIBLE FOR DETERMINING THE CORRESPONDING TIME ZONE IN THEIR RESPECTIVE JURISDICTIONS.
5. HOW TO ENTER: NO PURCHASE NECESSARY TO ENTER OR WIN. To enter the Contest, visit the Contest website located at https://ai.research.google.com/NaturalQuestions/efficientqa (“Contest Site”) during the Contest Period and follow the instructions for developing an system that returns correct english language answers to english language questions. The accuracy of the answers will be judged by reference to an existing set of answer labels, and by human judges. (“Code”). The Code must be submitted in a Docker container and run using the submission system at https://ai.research.google.com/NaturalQuestions/efficientqa (hereinafter, “Requirements”). Written parts of entries must be in English to be eligible. The Code must, at a minimum, must support English language use.
LIMIT ONE (1) ENTRY PER PERSON PER TRACK. Subsequent entries will be disqualified. All entries must be received by 11:59 p.m. (UTC) on 2020/11/14. Entries are void if they are in whole or part illegible, incomplete, damaged, altered, counterfeit, obtained through fraud, or late. All entries will be deemed made by the authorized account holder of the email address submitted at the time of entry, and the potential winner may be required to show proof of being the authorized account holder for that email address. The "authorized account holder" is the natural person assigned to an email address by an Internet service provider, online service provider, or other organization responsible for assigning email address for the domain.
During the Contest Period, the Sponsor, its agents and/or the Judges (defined below) will be evaluating each Code to ensure that it meets the Requirements. The Sponsor reserves the right, in its sole discretion, to disqualify any entrant who submits a Code that does not meet the Requirements.
6. JUDGING: Each entry will be judged automatically, and checked by a panel of experts who are employees of Sponsor and/or Princeton University, the University of Washington, the University of Maryland (“Judges”). On or about 2020/11/14, each Code will be evaluated based on the following criteria:
All submissions will be assigned an "automatic accuracy score" by comparing their predictions to a static set of references labels. All submissions will be assigned a "system size", as measured programmatically by the submission system. Judges reserve the right to disqualify systems that report incorrect system sizes, by overriding standard Unix programs, or through any other means.
Judges will evaluate and attribute a score to each Code made up of scores based upon the above-listed criteria. The entry that receives the highest overall score in each track will be selected as the potential winner(s). In the event of a tie, the Code that received the higher score from the Judges in the category of system size will be selected as one of the potential winner(s). In the event a potential winner is disqualified for any reason, the Code that received the next highest total score will be chosen as the potential winner
On or about 2020/11/14,, the potential winner(s) will be selected and notified by telephone and/or email, at Sponsor’s discretion. If a potential winner does not respond to the notification attempt within 7 days from the first notification attempt, then such potential winner will be disqualified and an alternate potential winner will be selected from among all eligible entries received based on the judging criteria described herein. With respect to notification by telephone, such notification will be deemed given when the potential winner engages in a live conversation with Sponsor or when a message is left on the potential winner’s voicemail service or answering machine by the Sponsor, whichever occurs first. Except where prohibited by law, each potential winner may be required to sign and return a Declaration of Eligibility and Liability and Publicity Release and provide any additional information that may be required by Sponsor. If required, potential winners must return all such required documents within 7 days following attempted notification or such potential winner will be deemed to have forfeited the prize and another potential winner will be selected based on the judging criteria described herein. In the event the potential winner is a minor, his or her parent or legal guardian must sign the documents and return them as described herein. All notification requirements, as well as other requirements within these Rules, will be strictly enforced.
In the event that no entries are received, no prize will be awarded. Determinations of judges are final and binding.
7. PRIZES: There are three prize tracks, with each track having one prize of Google Cloud credits with an approximate retail value (“ARV”) of $3000. The contestant with the winning entry in each prize track will receive the prize for the prize track. Each contestant is limited to winning at most one prize. In the event that one contestant has the top performing submission in multiple prize tracks, this "multiple track winner" will win the single prize for the single track with the maximum relative gap between the top two submissions. The other prize(s) will be awarded to the second placed submissions on the other leaderboards. For the size constrained tracks, relative gap is defined as the difference in accuracy, divided by the accuracy of the top scoring system. For the accuracy constrained track, relative gap is defined as the difference in size, divided by the size of the smallest system.
The remaining prize credits will be divided between the next best performing submission in each track won by the multiple track winner.
The most accurate system will be chosen on the basis of the automatic accuracy score. Final accuracy score and system size are defined in Section 6.
The most accurate system will be chosen on the basis of the automatic accuracy score. Final accuracy score and system size are defined in Section 6.
The smallest system will be chosen on the basis of system size. System size and automatic accuracy are defined in Section 6.
Odds of winning any prize depends on the number of eligible entries received during the Contest Period and the skill of the entrants. The prize(s) will be awarded within approximately 6 weeks of receipt by Sponsor of final prize acceptance documents. No transfer, substitution or cash equivalent for prize(s) is allowed, except at Sponsor’s sole discretion. Sponsor reserves the right to substitute a prize, in whole or in part, of equal or greater monetary value if a prize cannot be awarded, in whole or in part, as described for any reason. Value is subject to market conditions, which can fluctuate and any difference between actual market value and ARV will not be awarded. The prize(s) may be subject to restrictions and/or licenses and may require additional hardware, software, service, or maintenance to use. The winner shall bear all responsibility for use of the prize(s) in compliance with any conditions imposed by such manufacturer(s), and any additional costs associated with its use, service, or maintenance. Contest Entities have not made and Contest Entities are not responsible in any manner for any warranties, representations, or guarantees, express or implied, in fact or law, relating to the prize(s), regarding the use, value or enjoyment of the prize(s), including, without limitation, its quality, mechanical condition, merchantability, or fitness for a particular purpose, with the exception of any standard manufacturer's warranty that may apply to the prize(s) or any components thereto.
9. TAXES: PAYMENTS TO POTENTIAL WINNERS ARE SUBJECT TO THE EXPRESS REQUIREMENT THAT THEY SUBMIT TO GOOGLE ALL DOCUMENTATION REQUESTED BY GOOGLE TO PERMIT IT TO COMPLY WITH ALL APPLICABLE STATE, FEDERAL, LOCAL AND FOREIGN (INCLUDING PROVINCIAL) TAX REPORTING AND WITHHOLDING REQUIREMENTS. ALL PRIZES WILL BE NET OF ANY TAXES GOOGLE IS REQUIRED BY LAW TO WITHHOLD. ALL TAXES IMPOSED ON PRIZES ARE THE SOLE RESPONSIBILITY OF THE WINNERS. In order to receive a prize, potential winners must submit the tax documentation requested by Google or otherwise required by applicable law, to Google or the relevant tax authority, all as determined by applicable law, including, where relevant, the law of the potential winner’s country of residence. The potential winner is responsible for ensuring that (s)he complies with all the applicable tax laws and filing requirements. If a potential winner fails to provide such documentation or comply with such laws, the prize may be forfeited and Google may, in its sole discretion, select an alternative potential winner.
10. GENERAL CONDITIONS: All federal, state, provincial and local laws and regulations apply. Google reserves the right to disqualify any entrant from the Contest if, in Google’s sole discretion, it reasonably believes that the entrant has attempted to undermine the legitimate operation of the Contest by cheating, deception, or other unfair playing practices or annoys, abuses, threatens or harasses any other entrants, Google, or the Judges.
11. INTELLECTUAL PROPERTY RIGHTS: By submitting a Code in this Contest, the entrant warrants and represents that (s)he owns all of the intellectual and industrial property rights in and to the Code. Further, the entrant agrees that if any portion of the Code should be deemed to be owned by the entrant that (s)he will, as a condition of entry, grant Google a perpetual, irrevocable, worldwide, royalty-free, and non-exclusive license to use, reproduce, publicly perform, publicly display and create a derivative work from, any entry or Code that Participant submits solely for the purposes of allowing Google to test and evaluate the Code for purposes of the Contest and to advertise, display, demonstrate, or otherwise promote the EfficientQA contest. Participant specifically agrees that Google shall have the right to use, reproduce, publicly perform, and publicly display the Code in connection with the advertising and promotion of the Contest], via communication to the public or other groups, including, but not limited to the right to make screenshots, animations and video clips available for promotional purposes.
12. PRIVACY: Participant acknowledges and agrees that Google may collect, store, share and otherwise use personally identifiable information provided during the registration process and the contest, including, but not limited to, name, mailing address, phone number, and email address. Google will use this information in accordance with its Privacy Policy (http://www.google.com/policies/privacy/), including for administering the contest and verifying Participant’s identity, postal address and telephone number in the event an entry qualifies for a prize.
Participant’s information may also be transferred to countries outside the country of Participant's residence, including the United States. Such other countries may not have privacy laws and regulations similar to those of the country of Participant's residence.
Participant acknowledges and agrees that Participant’s data may be shared with co-sponsor. The use of the data by co-sponsor is subject to co-sponsor's privacy policy.
If a participant does not provide the mandatory data required at registration, Google reserves the right to disqualify the entry.
Participant has the right to request access, review, rectification or deletion of any personal data held by Google in connection with the Contest by writing to Google at this email address nqopen@google.com.
13. PUBLICITY: By accepting a prize, entrant agrees to Sponsor and its agencies use of his or her name and/or likeness and Code for advertising and promotional purposes without additional compensation, unless prohibited by law.
14. WARRANTY, INDEMNITY AND RELEASE: Entrants warrant that their Codes are their own original work and, as such, they are the sole and exclusive owner and rights holder of the submitted Code and that they have the right to submit the Code in the Contest and grant all required licenses. Each entrant agrees not to submit any Code that (1) infringes any third party proprietary rights, intellectual property rights, industrial property rights, personal or moral rights or any other rights, including without limitation, copyright, trademark, patent, trade secret, privacy, publicity or confidentiality obligations; or (2) otherwise violates the applicable state or federal law.
To the maximum extent permitted by law, each entrant indemnifies and agrees to keep indemnified Contest Entities at all times from and against any liability, claims, demands, losses, damages, costs and expenses resulting from any act, default or omission of the entrant and/or a breach of any warranty set forth herein. To the maximum extent permitted by law, each entrant agrees to defend, indemnify and hold harmless the Contest Entities from and against any and all claims, actions, suits or proceedings, as well as any and all losses, liabilities, damages, costs and expenses (including reasonable attorneys fees) arising out of or accruing from (a) any Code or other material uploaded or otherwise provided by the entrant that infringes any copyright, trademark, trade secret, trade dress, patent or other intellectual property right of any person or defames any person or violates their rights of publicity or privacy, (b) any misrepresentation made by the entrant in connection with the Contest; (c) any non-compliance by the entrant with these Rules; (d) claims brought by persons or entities other than the parties to these Rules arising from or related to the entrant’s involvement with the Contest; and (e) acceptance, possession, misuse or use of any prize or participation in any Contest-related activity or participation in this Contest.
Entrant releases Google from any liability associated with: (a) any malfunction or other problem with the Contest Site; (b) any error in the collection, processing, or retention of entry information; or (c) any typographical or other error in the printing, offering or announcement of any prize or winners.
15. ELIMINATION: Any false information provided within the context of the Contest by any entrant concerning identity, mailing address, telephone number, email address, ownership of right or non-compliance with these Rules or the like may result in the immediate elimination of the entrant from the Contest.
16. INTERNET: Contest Entities are not responsible for any malfunction of the entire Contest Site or any late, lost, damaged, misdirected, incomplete, illegible, undeliverable, or destroyed Codes or entry materials due to system errors, failed, incomplete or garbled computer or other telecommunication transmission malfunctions, hardware or software failures of any kind, lost or unavailable network connections, typographical or system/human errors and failures, technical malfunction(s) of any telephone network or lines, cable connections, satellite transmissions, servers or providers, or computer equipment, traffic congestion on the Internet or at the Contest Site, or any combination thereof, including other telecommunication, cable, digital or satellite malfunctions which may limit an entrant’s ability to participate.
17. RIGHT TO CANCEL, MODIFY OR DISQUALIFY: If for any reason the Contest is not capable of running as planned, including infection by computer virus, bugs, tampering, unauthorized intervention, fraud, technical failures, or any other causes which corrupt or affect the administration, security, fairness, integrity, or proper conduct of the Contest, Google reserves the right at its sole discretion to cancel, terminate, modify or suspend the Contest. Google further reserves the right to disqualify any entrant who tampers with the submission process or any other part of the Contest or Contest Site. Any attempt by an entrant to deliberately damage any web site, including the Contest Site, or undermine the legitimate operation of the Contest is a violation of criminal and civil laws and should such an attempt be made, Google reserves the right to seek damages from any such entrant to the fullest extent of the applicable law.
18. NOT AN OFFER OR CONTRACT OF EMPLOYMENT: Under no circumstances shall the submission of an Code into the Contest, the awarding of a prize, or anything in these Rules be construed as an offer or contract of employment with either Google, or the Contest Entities. You acknowledge that you have submitted your Code voluntarily and not in confidence or in trust. You acknowledge that no confidential, fiduciary, agency or other relationship or implied-in-fact contract now exists between you and Google or the Contest Entities and that no such relationship is established by your submission of an Code under these Rules.
Language team, Research(Residents of Vermont need not supply postage).