Your Activity Dashboard provides updated information about your submission activity. Each submission is identified by its title followed by a numerical Response ID. The Review Team uses this Response ID to identify a submission in any message sent to a Researcher. Include this Response ID in any message you will send to our Team regarding a specific submission.
The details provided in the Activity Dashboard are updated once a submission is reviewed.
A submission is marked with one of the following based on the status of the review:
- Submitted – The submission has not been reviewed yet. This is the initial status of all submissions.
- Accepted – The submission is relevant to the Study and is given a corresponding rank.
- Pending – The Review Team has placed the submission on hold, pending additional review. In some instances, the Review Team may contact the Researcher for more information about the submission.
- Declined – The submission does not meet the requirements of the Study.
Additional details may be provided based on the status of the submission:
For Accepted submissions:
- New – The Researcher is the first to submit the particular document.
- Duplicate – Another Researcher was the first to submit the same document. A duplicate submission is unlikely to win the Reward.
For Declined submissions:
- Known – The document is cited in the patent or the list of known prior art.
- Past Date Range – The document does not meet the date requirement.
- Not Relevant – The document does not match the Research Requirements.
An Accepted submission is provided a rank based on how well it matches the Research Requirements. Submissions are ranked 2, 3, 4m or 5 (Rank 5 being highest).
- A Rank 2 submission only provides background information.
- A Rank 3 submission satisfies at least one priority element.
- A Rank 4 submission satisfies more than one priority element and/or the point of novelty criterion.
- A Rank 5 submission most, if not all the priority elements.
Submissions with ranks 3, 4, and 5 are in-scope. These submissions are eligible for the Reward.
While a higher rank increases your chance of winning a Study, please note that an in-scope submission does not guarantee a Reward. Your chance of winning a Study depends on the quality of your submission(s) relative to the submissions of the other Study participants. The Reward structure for the Study may also limit the number of Researchers and/or submissions that may earn Rewards.
Please note that some Studies may follow a different ranking system. For example, the ranks of submissions to Claims Mapping Studies are discussed in this page.
The highlights for Accepted submissions are evaluated as Acceptable, Unacceptable, or Incomplete as defined in our policy on submission highlights.
Your Scorecard provides a variety of stats about your submissions. Among the most important is your in-scope percentage. Your in-scope percentage is an indicator of your performance in our Studies. It is calculated based on the ranks given to your submissions. Your in-scope percentage determines your eligibility for Rewards and your submission limit.
In calculating your in-scope percentage, we consider the most recent 50 reviewed submissions (i.e. “Accepted” or “Declined” status) that are not duplicates (i.e. marked as “New” in the Details column). Please note that we exclude any submissions to Studies where you accepted an invite in order to participate (i.e. CrowdSearch Mini, ExpertSearch, and FlashSearch).
To calculate your in-scope percentage, divide the number of in-scope submissions by 50. (If you have fewer than 50 submissions, use the number of submissions that meet the criteria described above.)