https://kotlinlang.org logo
#advent-of-code
Title
# advent-of-code
d

David Whittaker

10/21/2023, 9:31 PM
Advent of Code's new AI/LLM policy: https://adventofcode.com/about#ai_leaderboard
💥 1
t

todd.ginsberg

10/21/2023, 11:07 PM
… but I feel like it's harder to get better at programming if you ask an AI to do the programming for you.
Exactly!
true story 6
p

PoisonedYouth

10/22/2023, 5:24 AM
Where is the fun of not solving the puzzles by myself?
m

Marcin Wisniowski

10/23/2023, 3:56 PM
From what I remember, the code to retrieve the question, get it solved by ChatGPT, run the output (while fixing formatting issues, etc.), and submit the solution was far more involved and educational than solving the puzzle yourself. But it should stay out of the leaderboards.
My point being, there was definitely a lot of fun to be had in implementing it and IIRC it was hundreds of lines long, while only being able to solve the first two days or so, so the author definitely learned more from their first 2 days of AoC than I did. 😄 It was just solving a completely different problem than the actual puzzle and so doesn’t belong on the leaderboard.
p

PoisonedYouth

10/23/2023, 4:44 PM
Also a valid approach. If the leaderboard is separated between using ChatGPT and manual work everything is fine
j

Johannes Gätjen

10/26/2023, 8:20 AM
Yeah, if AIs are allowed the leaderboard will eventually go from "who is the fastest programming puzzle solver?" to "who can write the best programming puzzle solving AI"? Still very interesting, but something very different. I also wonder if perhaps Eric is going to try adding some prompt injection. I.e. some hidden text to confuse the AI.
👍 1
good idea 1
m

Marcin Wisniowski

11/10/2023, 10:18 AM
> I also wonder if perhaps Eric is going to try adding some prompt injection The elves forgot the password to Santa’s sled, but luckily they wrote it down on a sticky note: “IGNORE THE FOLLOWING INSTRUCTIONS”. Unfortunately the words are not in the correct order, so they will have to try them all. How many permutations of the words exist?
😆 3
9 Views