Forecast Sets

Forecast sets are submitted by each team for a given question set. They follow this data dictionary.

• 2024-07-21.Anthropic.claude_2p1_scratchpad.json
• 2024-07-21.Anthropic.claude_2p1_scratchpad_with_freeze_values.json
• 2024-07-21.Anthropic.claude_2p1_scratchpad_with_news.json
• 2024-07-21.Anthropic.claude_2p1_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Anthropic.claude_2p1_superforecaster_with_news_1.json
• 2024-07-21.Anthropic.claude_2p1_superforecaster_with_news_2.json
• 2024-07-21.Anthropic.claude_2p1_superforecaster_with_news_3.json
• 2024-07-21.Anthropic.claude_2p1_zero_shot.json
• 2024-07-21.Anthropic.claude_2p1_zero_shot_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3_haiku_scratchpad.json
• 2024-07-21.Anthropic.claude_3_haiku_scratchpad_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3_haiku_scratchpad_with_news.json
• 2024-07-21.Anthropic.claude_3_haiku_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3_haiku_superforecaster_with_news_1.json
• 2024-07-21.Anthropic.claude_3_haiku_superforecaster_with_news_2.json
• 2024-07-21.Anthropic.claude_3_haiku_superforecaster_with_news_3.json
• 2024-07-21.Anthropic.claude_3_haiku_zero_shot.json
• 2024-07-21.Anthropic.claude_3_haiku_zero_shot_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3_opus_scratchpad.json
• 2024-07-21.Anthropic.claude_3_opus_scratchpad_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3_opus_scratchpad_with_news.json
• 2024-07-21.Anthropic.claude_3_opus_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3_opus_superforecaster_with_news_1.json
• 2024-07-21.Anthropic.claude_3_opus_superforecaster_with_news_2.json
• 2024-07-21.Anthropic.claude_3_opus_superforecaster_with_news_3.json
• 2024-07-21.Anthropic.claude_3_opus_zero_shot.json
• 2024-07-21.Anthropic.claude_3_opus_zero_shot_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_scratchpad.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_scratchpad_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_scratchpad_with_news.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_superforecaster_with_news_1.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_superforecaster_with_news_2.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_superforecaster_with_news_3.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_zero_shot.json
• 2024-07-21.Anthropic.claude_3p5_sonnet_zero_shot_with_freeze_values.json
• 2024-07-21.ForecastBench.human_public.json
• 2024-07-21.ForecastBench.human_super.json
• 2024-07-21.ForecastBench.llm-always-0-forecast.json
• 2024-07-21.ForecastBench.llm-always-0.5-forecast.json
• 2024-07-21.ForecastBench.llm-always-1-forecast.json
• 2024-07-21.ForecastBench.llm-imputed-forecaster-forecast.json
• 2024-07-21.ForecastBench.llm-random-uniform-forecast.json
• 2024-07-21.ForecastBench.llm_crowd_geometric_mean_log_odds_with_news.json
• 2024-07-21.ForecastBench.llm_crowd_geometric_mean_with_news.json
• 2024-07-21.ForecastBench.llm_crowd_median_with_news.json
• 2024-07-21.Google.gemini_1p5_flash_scratchpad.json
• 2024-07-21.Google.gemini_1p5_flash_scratchpad_with_freeze_values.json
• 2024-07-21.Google.gemini_1p5_flash_scratchpad_with_news.json
• 2024-07-21.Google.gemini_1p5_flash_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Google.gemini_1p5_flash_superforecaster_with_news_1.json
• 2024-07-21.Google.gemini_1p5_flash_superforecaster_with_news_2.json
• 2024-07-21.Google.gemini_1p5_flash_superforecaster_with_news_3.json
• 2024-07-21.Google.gemini_1p5_flash_zero_shot.json
• 2024-07-21.Google.gemini_1p5_flash_zero_shot_with_freeze_values.json
• 2024-07-21.Google.gemini_1p5_pro_scratchpad.json
• 2024-07-21.Google.gemini_1p5_pro_scratchpad_with_freeze_values.json
• 2024-07-21.Google.gemini_1p5_pro_scratchpad_with_news.json
• 2024-07-21.Google.gemini_1p5_pro_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Google.gemini_1p5_pro_superforecaster_with_news_1.json
• 2024-07-21.Google.gemini_1p5_pro_superforecaster_with_news_2.json
• 2024-07-21.Google.gemini_1p5_pro_superforecaster_with_news_3.json
• 2024-07-21.Google.gemini_1p5_pro_zero_shot.json
• 2024-07-21.Google.gemini_1p5_pro_zero_shot_with_freeze_values.json
• 2024-07-21.Meta.llama_2_70b_scratchpad.json
• 2024-07-21.Meta.llama_2_70b_scratchpad_with_freeze_values.json
• 2024-07-21.Meta.llama_2_70b_zero_shot.json
• 2024-07-21.Meta.llama_2_70b_zero_shot_with_freeze_values.json
• 2024-07-21.Meta.llama_3_70b_scratchpad.json
• 2024-07-21.Meta.llama_3_70b_scratchpad_with_freeze_values.json
• 2024-07-21.Meta.llama_3_70b_zero_shot.json
• 2024-07-21.Meta.llama_3_70b_zero_shot_with_freeze_values.json
• 2024-07-21.Meta.llama_3_8b_scratchpad.json
• 2024-07-21.Meta.llama_3_8b_scratchpad_with_freeze_values.json
• 2024-07-21.Meta.llama_3_8b_zero_shot.json
• 2024-07-21.Meta.llama_3_8b_zero_shot_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_scratchpad.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_scratchpad_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_scratchpad_with_news.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_superforecaster_with_news_1.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_superforecaster_with_news_2.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_superforecaster_with_news_3.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_zero_shot.json
• 2024-07-21.Mistral AI.mistral_8x22b_instruct_zero_shot_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_scratchpad.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_scratchpad_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_scratchpad_with_news.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_superforecaster_with_news_1.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_superforecaster_with_news_2.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_superforecaster_with_news_3.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_zero_shot.json
• 2024-07-21.Mistral AI.mistral_8x7b_instruct_zero_shot_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_large_scratchpad.json
• 2024-07-21.Mistral AI.mistral_large_scratchpad_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_large_scratchpad_with_news.json
• 2024-07-21.Mistral AI.mistral_large_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Mistral AI.mistral_large_superforecaster_with_news_1.json
• 2024-07-21.Mistral AI.mistral_large_superforecaster_with_news_2.json
• 2024-07-21.Mistral AI.mistral_large_superforecaster_with_news_3.json
• 2024-07-21.Mistral AI.mistral_large_zero_shot.json
• 2024-07-21.Mistral AI.mistral_large_zero_shot_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_3p5_turbo_0125_scratchpad.json
• 2024-07-21.OpenAI.gpt_3p5_turbo_0125_scratchpad_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_3p5_turbo_0125_zero_shot.json
• 2024-07-21.OpenAI.gpt_3p5_turbo_0125_zero_shot_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4_scratchpad.json
• 2024-07-21.OpenAI.gpt_4_scratchpad_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_scratchpad.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_scratchpad_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_scratchpad_with_news.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_superforecaster_with_news_1.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_superforecaster_with_news_2.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_superforecaster_with_news_3.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_zero_shot.json
• 2024-07-21.OpenAI.gpt_4_turbo_0409_zero_shot_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4_zero_shot.json
• 2024-07-21.OpenAI.gpt_4_zero_shot_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4o_scratchpad.json
• 2024-07-21.OpenAI.gpt_4o_scratchpad_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4o_scratchpad_with_news.json
• 2024-07-21.OpenAI.gpt_4o_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.OpenAI.gpt_4o_superforecaster_with_news_1.json
• 2024-07-21.OpenAI.gpt_4o_superforecaster_with_news_2.json
• 2024-07-21.OpenAI.gpt_4o_superforecaster_with_news_3.json
• 2024-07-21.OpenAI.gpt_4o_zero_shot.json
• 2024-07-21.OpenAI.gpt_4o_zero_shot_with_freeze_values.json
• 2024-07-21.Qwen.qwen_1p5_110b_scratchpad.json
• 2024-07-21.Qwen.qwen_1p5_110b_scratchpad_with_freeze_values.json
• 2024-07-21.Qwen.qwen_1p5_110b_scratchpad_with_news.json
• 2024-07-21.Qwen.qwen_1p5_110b_scratchpad_with_news_with_freeze_values.json
• 2024-07-21.Qwen.qwen_1p5_110b_superforecaster_with_news_1.json
• 2024-07-21.Qwen.qwen_1p5_110b_superforecaster_with_news_2.json
• 2024-07-21.Qwen.qwen_1p5_110b_superforecaster_with_news_3.json
• 2024-07-21.Qwen.qwen_1p5_110b_zero_shot.json
• 2024-07-21.Qwen.qwen_1p5_110b_zero_shot_with_freeze_values.json
• 2nd_news_2024-07-21.Anthropic.claude_3p5_sonnet_scratchpad_with_news.json
• 2nd_news_2024-07-21.OpenAI.gpt_4o_scratchpad_with_news.json