Is anyone else seeing a large number of 409 confli...
# multiplatforml
Landry Norris
02/27/2023, 7:18 PMIs anyone else seeing a large number of 409 conflict when publishing to GitHubPackages maven repo right now? Just had 5 publish attempts fail in a row (added a counter to the end of the version to avoid true duplicates). I typically see false duplicates ~1/1000 artifacts published, but today, it’s been closer to 1/3.
h
hfhbd
02/27/2023, 7:19 PMYeah, I get them too, very annoying. And you can't replace them by restarting the job, so you have to either delete the failed artifacts or run it again with another version...
l
Landry Norris
02/27/2023, 7:20 PMI always opt for another version, since we publish ~60 artifacts. Usually, it’s fine after changing the version and running again, but today, that hasn’t been working.
c
Carter
02/27/2023, 7:20 PMAre you publishing with Gradle? I’ve encountered something quirky where Gradle itself seems to try to upload the artifact twice, which triggers the 409.
l
Landry Norris
02/27/2023, 7:21 PMI requested a UI that would let me delete several packages at once, and they seemed receptive to the idea, but it would take time.
Landry Norris
02/27/2023, 7:21 PMI am using gradle. I don’t see this when I publish public artifacts to maven central, but at work, we use GHP for internal projects.
h
hfhbd
02/27/2023, 7:21 PMOr a staging concept with drop support :D
c
Carter
02/27/2023, 7:22 PMThe symptoms I see are that Gradle shows uploading the same artifact twice in a row, GitHub fails with a 409, and in package registry I just see my JAR but no POM or hashes.
l
Landry Norris
02/27/2023, 7:22 PMI’d like that, but management isn’t a big fan of having the second step with our small team. They want it to be one step to publish.
h
hfhbd
02/27/2023, 7:23 PMYeah, but why does it work sometimes? Gradle "should" be reproducible.
l
Landry Norris
02/27/2023, 7:24 PMIf it’s gradle, I’d question why central is so reliable for me.
Landry Norris
02/27/2023, 7:24 PMGitHub support said they’ve heard reports of the same problem from others, but couldn’t find a cause.
c
Carter
02/27/2023, 7:26 PMIn my case the reupload is noticeable because my artifacts are large.
I think I can consistently trigger it if the artifact is close to 2gb, but not if the artifact is closer to 1gb. I’ve just uploaded 7 1gb artifacts in a row and that’s been working well. You probably don’t have artifacts that large though.
My guess is there’s an interaction between GitHub and Gradle that’s triggering the issue as I’ve seen it. When I fell back to deploying with the mvn command line tool directly, my large 2gb artifact uploaded successfully with no http error.
h
hfhbd
02/27/2023, 7:27 PMKey is an automatically staging concept like maven central but drop support for failure 🙂
hfhbd
02/27/2023, 7:28 PMHm, my artifacts, around 30, are very small but I still get the conflict sometimes with random artifacts
c
Carter
02/27/2023, 7:28 PMI take it back—I just had one fail.
l
Landry Norris
02/27/2023, 7:29 PMI noticed this once before where it seemed to fail much more often for a day. May just be an outage of some kind.
c
Carter
02/27/2023, 7:29 PMI’m uploading a 10gb machine learning dataset that’s divided into 10 artifacts to work around size limits, and thought I’d finally worked around it blob sweat smile
l
Landry Norris
02/27/2023, 7:29 PMI’ll have to find my open ticket with support from last time and comment.
c
Carter
02/27/2023, 7:29 PMThis is probably a bug in both Gradle and GitHub. I’m curious what response code GitHub is returning that causes Gradle to retry the upload?
l
Landry Norris
02/27/2023, 7:31 PMI’ll have to try again with gradle debug info. From my experience, it’ll likely work just to avoid giving me the debug info to give support. We all know how computers can be.
e
eygraber
02/27/2023, 7:38 PMI opened a ticket with GitHub about this a few weeks ago. They said it is a known issue and they are working on a fix.
l
Landry Norris
02/27/2023, 7:39 PMSounds like they at least found the cause then. They told me that they were still trying to reproduce it a couple months ago.
e
eygraber
02/27/2023, 7:41 PMThis is a known issue with the Maven registry. The team is working on a fix in the next major version. We're hoping this will be released in Jan-Feb, 2023.
l
Landry Norris
02/27/2023, 7:47 PMIs there an emoji that best represents the feeling when the last artifact in the upload fails after 20 minutes?
e
eygraber
02/27/2023, 7:48 PMAt my company it is called
:open-eye-crying-laughingh
hfhbd
04/17/2024, 6:04 AMI know it's an old thread but can you share you support ticket number? I created another ticket and maybe you do have some helpful information.
e
eygraber
04/17/2024, 2:12 PMIt looks like I can't access the ticket anymore 🤔
m
Marcel
11/14/2024, 11:11 AMAny news on this? Did anyone manage to fix it or get around the issue, I have been getting some random 409 errors on the past few weeks when publishing our KMP library
h
hfhbd
11/14/2024, 11:29 AMIf we get an 409 we just delete all packages so you can restart the pipeline again
m
Marcel
11/14/2024, 11:59 AMYeah, it's just a waste of time and credits
381 Views