-
Notifications
You must be signed in to change notification settings - Fork 119
Open
Description
Hello! I have a few questions about LongBench leaderboard:
- Evaluation Process: What is the specific format for model submission and evaluation on your leaderboard? For example, do you require providing an API endpoint, downloading and deploying the model yourselves, or accepting result files from our local evaluations?
- Inclusion Process: Once the evaluation is complete, what is the procedure for including the model on the leaderboard? Is ranking automatic based on results, or does it require review by your team? If the results do not meet certain expectations, are there mechanisms for re-evaluation or delayed inclusion?
- Contact Info: Which method is the most convenient way for me to contact with you guys?
Thanks for your reply!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels