This model has already been submitted but is not showing up.

#47
by Whliuyu - opened

After renaming both the organization and model (and successfully submitting the _total.jsonl file), the system indicated results would appear within a few hours. However, it's been two days with no update. Could you help investigate what might be causing this delay? Specifically:

  1. Does the system require additional time for renamed submissions?
  2. Is there any hidden validation step we might have missed?
  3. Could there be an issue with our modified organization/model name format?"
    Thanks!

What is the name/org that you submitted, and did you submit to val or test?

I submitted to the test set. The Agent name is thgo and the organization (org) is ThingoTech.

Having a similar issue. Submitted to the test set and haven't seen an update. Organization is h2o

@clefourrier Hitting same thing. Tried submiting twice, once with login but not signed-in with SSO and the other signed in also with SSO. Not working. Want to submit open-weight result.

No posts seem to occur after March 25.

@clefourrier I'm experiencing the same issue where my submission to the validation set (val) isn't showing up. I submitted my results, but there have been no updates since March 25. Not working. Could you please look into this?

Hi all!
Could you please share the agent names, orgs, and if you submitted to test or val? If you could also send me at .. your submission files it would help.

sent via email

Hi all!

Thanks a lot to those who sent me the relevant info by email! It seems I fixed the main issue using the h2o submission file - could the others orgs try to resubmit and tell me what happens?

Since the leaderboard takes about 2h to be updated, the easiest is to check if this repository gets updated with your submission, it should happen within 2 minutes if you got no error message.

Whliuyu changed discussion status to closed
Whliuyu changed discussion status to open

@clefourrier Could you please help me delete the GAIA score of ThingoTech? We hope to try again after the optimization is completed in a while.

Hi! We don't remove submissions from the leaderboard, except in cases of spam or accidental duplications (= several authors accidentally posted to the leaderboard the exact same model)

clefourrier changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment