I’m trying something this NFL season that I think could be an interesting test of AI decision-making over time. I’ve played fantasy football for about 30 years. This season I’m giving AI complete control of one team: draft, roster construction, waivers, trades, injuries and weekly lineup decisions. The part I’m interested in isn’t whether an AI can recommend a good player. We already know models can analyze statistics and rankings. I’m interested in what happens after Week 1. Can it maintain context across an entire season? Can it change its opinion when new information arrives? Will it recognize when its original assumptions were wrong? Will it hold onto a player because of its previous evaluation when the evidence says it shouldn’t? Fantasy football creates a surprisingly useful environment for this because decisions have measurable outcomes, but they’re made with incomplete information. I’m planning to preserve each decision and the reasoning behind it so I can evaluate the decision based on what was known at the time, rather than just whether the outcome happened to be good. I’m particularly interested in tracking consistency, adaptation to new information, and whether previous decisions create bias in later ones. I’ll share the results once there’s enough data to be meaningful. I’m curious whether anyone here has run a similar long-duration test where an AI has to maintain state and repeatedly make decisions as the underlying information changes. submitted by /u/Prestigious-Dig2263
Originally posted by u/Prestigious-Dig2263 on r/ArtificialInteligence