https://kotlinlang.org logo
#gradle
Title
# gradle
h

Humphrey

06/04/2023, 12:00 PM
Hi I’m using version catalog and convention plugin for a multi module project. This project is importing several dependencies. I would like to specify one or two dependencies to be the latest version automatically. And not the release version but the snapshot. How do I achieve that?
a

Adam S

06/04/2023, 12:41 PM
Gradle supports writing dynamic versions https://docs.gradle.org/current/userguide/single_versions.html so you can use
some-group-id:the-artifact:+
to always get the latest version Just be aware that’s such dynamic versions are pretty risky, and will lead to hard-to-track issues because the version can change basically at random. You can limit some of the damage by using a prefix, something like
1.0.+
, or a range
(1.0, 2.0)
You can use dependency locking to protect against ‘random’ changes too https://docs.gradle.org/current/userguide/dependency_locking.html Using a plugin that automatically updates the versions will be even more reliable https://github.com/ben-manes/gradle-versions-plugin
j

Javier

06/04/2023, 12:54 PM
you have this too • A latest-status version: e.g. latest.integration, latest.release https://docs.gradle.org/current/userguide/single_versions.html
main problem is a release is higher than a snapshot so your use case can be a problem if you are publishing 1.0.0 and 1.0.0-snapshot
so you are forced to publish a snapshot with a higher value, for example 1.0.1-snapshot
• The strings rc, snapshot, final, ga, release and sp are considered higher than any other string part (sorted in this order): 1.0-zeta < 1.0-rc < 1.0-snapshot < 1.0-final < 1.0-ga < 1.0-release < 1.0-sp < 1.0.
h

Humphrey

06/04/2023, 1:48 PM
We were using already the
group-I’d:artifact-id:+
but this is pulling only the latest release version. Not the snapshot from Nexus. And for some reason it’s getting the version 0.1298.0 from nexus but I can see version 0.1303.0 in nexus of that dependency. The former was created like 1 month ago, and the latter like few days ago. I have changed that project to use version catalog and upgraded to latest gradle after 0.1298.0 release. Maybe I’ve missed something in the publishing part that it’s not taking the latest version anymore? 1) What is gradle looking for when searching the remote repository for a dependency? 2) in the past it was only getting the latest release, so maybe I should try using the
latest.integration
as version? I’ll try tomorrow the 2nd step see if that does any difference.
Ive have tried that ben-manes plugin, together with the toml plugin, but that messes up my entire layout and screwup some lines for me in my toml file. (Is doing some ordering and removing dependencies it thinks that are not being used).
v

Vampire

06/04/2023, 2:59 PM
+
should be equivalent to
latest.integration
. It should give you the very latest version, whether snapshot or not. As your
+
is not even getting you your latest release version it seems there is something different broken or unexpected. Maybe you do have dependency locking in place?
h

Humphrey

06/04/2023, 3:13 PM
We used to have lock files but that we also removed.
It was getting the latest release version but never the snapshot. And after the 0.1298.0 might be because upgraded the project to convention plugins and version catalog. And gradle 8.1.1. Maybe I’m missing some setting in the publish configuration? I will compare tomorrow the Pom.xml of the two versions tomorrow. I think that’s what being used right?
j

Javier

06/04/2023, 4:19 PM
is the snapshot repository added?
h

Humphrey

06/04/2023, 4:19 PM
Yes
v

Vampire

06/04/2023, 4:31 PM
Neither convention plugins nor version catalog per-se should cause that was long as they are doing the same things as before. For determining the available versions to pick from, it probably looks into
maven-metadata.xml
which lists versions. Check what it contains for you.
h

Humphrey

06/04/2023, 4:32 PM
Thanks will take a look at that file in nexus right?
v

Vampire

06/04/2023, 4:34 PM
Yes
h

Humphrey

06/05/2023, 7:26 AM
Looking in nexus and indeed newer versions don't exists after 0.1289.0, need to fix that one first.. the latest release version is being pulled from nexus with
latest.integration
The issue was that we did have a publishing with maven repositories for nexus defined but we didn't have publications. The project was made in java but now we upgraded to use kotlin with java source code. We don't specify the java plugin and I guess that is why we need to add the `mavenJava(MavenPublication)`:
Copy code
publishing {
    publications {
        mavenJava(MavenPublication) {
            from components.java

            artifact sourceJar {
                classifier "sources"
            }
        }
    }
}
v

Vampire

06/05/2023, 9:38 AM
You should always need to define the publication if you want to publish, whether you use the Java plugin or not. Regarding the source jar, better do not add the artifact manually. Better add the source jar to the Java component instead, or simply use
withSourcesJar()
which also adds it automatically.
h

Humphrey

06/05/2023, 9:42 AM
Thanks for the info about the withSourceJar(), that it automatically will publish the sources. I did add it and removed that extra definition sourceJar.
I was reading this documentation (section 66.2.1) and there they say that this mavenJava in the publication is added by the Java Plugin. In the old gradle build file we were using, we were probably applying the java plugin and that's why we didn't define that extra publications part.
v

Vampire

06/05/2023, 10:21 AM
To start with, you should probably not use a copy of the documentation some page provides that documents Gradle 2.1 which was released in 2014! The current documentation is at https://docs.gradle.org/current/userguide/publishing_maven.html, or use the one matching the Gradle version you use, that hopefully is not 2.1. Besides that, even the docs you refer do not state what you say. It says that the
java
plugin adds the
java
component which you can then publish using the shown snippet which adds the
mavenJava
publication and configures it to publish the component which is added by the
java
plugin.
If you did not define a publication explicitly previously, it is more likely that you applied some plugin that defined the publication on your behalf.
h

Humphrey

06/05/2023, 11:56 AM
We are using gradle 8.1.1 at this moment.
v

Vampire

06/05/2023, 12:38 PM
Good for you :-)
h

Humphrey

06/05/2023, 1:00 PM
Yes and migrating from gralde groovy to kotlin DSL
I'm back to the old situation, have a snapshot version 0.1306.0-branchname-SNAPSHOT in nexus but it is only getting the latest release version from nexus 0.1298.0, as version I'm using the
latest.integration
in the version.ref that is pointing to my version of the jar. (i've checked and
+
is doing the same thing. The repositories are configured as follows:
Copy code
val releasesRepoUrl = "<https://our-internal-nexus:8443/repository/....releases/>"
val snapshotsRepoUrl = "<https://our-internal-nexus:8443/repository/....snapshots/>"

repositories {
    mavenLocal()
    maven("<https://our-internal-nexus:8443/repository/public/>")
    maven(releasesRepoUrl)
    maven(snapshotsRepoUrl)
}
I think it should be able to find the snapshot in the snapshot repository.
Only when I define the complete snapshot-name (
0.1306.0-branchname-SNAPSHOT
) it seems to use the one snapshot version.
But the snapshot name will be different each time, the
version
will increase and the
branch name
will change.
v

Vampire

06/05/2023, 3:05 PM
Works fine here. Published
0.1298.0
Copy code
...:+ -> 0.1298.0
Then published
0.1306.0-branchname-SNAPSHOT
Copy code
...:+ -> 0.1306.0-branchname-SNAPSHOT
Can you show an MCVE?
h

Humphrey

06/05/2023, 3:09 PM
Can I do that MCVE without a nexus? Don't want to mess around this client company nexus, or share their code.
v

Vampire

06/05/2023, 3:10 PM
Whatever reproduces your problem.
h

Humphrey

06/05/2023, 3:10 PM
publish to Maven Local will do?
v

Vampire

06/05/2023, 3:10 PM
Whatever reproduces your problem.
🙂
I did try with maven local and it worked fine for me.
Btw. one sidenote, your question is off-topic here. 😉 The whole slack and thus also this channel is about using Kotlin. This channel is for using Kotlin in Gradle build scripts, not for general Gradle topics as you can see in the channel topic. 😉
a

Adam S

06/05/2023, 3:13 PM
v

Vampire

06/05/2023, 3:16 PM
As he also tried with
+
vs.
latest.integration
I assumed that should not be the problem, but yeah, try running with
--refresh-dependencies
to be sure. 🙂
h

Humphrey

06/05/2023, 3:17 PM
I have added this in my root build.gradle.kts file:
Copy code
configurations {
    all {
        resolutionStrategy {
            cacheChangingModulesFor(1, TimeUnit.MINUTES)
            cacheDynamicVersionsFor(1, TimeUnit.MINUTES)
            eachDependency {
                if (group == "our-group" && listOf("artifact-1", "artifact-2").contains(name)) {
                    useVersion("latest.snapshot")
                }
            }
        }
    }
}
yes also tried with
--refresh-dependencies
no luck
I know it should be 0 seconds but I think 1 minute should also do as the other jar file is uploaded like 10 minutes before the other projects requires it.
v

Vampire

06/05/2023, 3:19 PM
I don't think
latest.snapshot
is a thing unless you have custom stability values defined.
latest.integration
or
+
h

Humphrey

06/05/2023, 3:19 PM
Oh will try with latest integration then.
v

Vampire

06/05/2023, 3:19 PM
Which you said you did further up 😉
h

Humphrey

06/05/2023, 3:22 PM
Yes I did refresh dependencies, tried witl latest.integration and with +. Now also resloution strategy with and without that (for the caching dynamic verison) still getting the
0.1298.0
.
v

Vampire

06/05/2023, 3:22 PM
Well, we are probably back at please provide an MCVE 🙂
h

Humphrey

06/05/2023, 3:23 PM
I'll try to make a MCVE tomorrow.
a

Adam S

06/05/2023, 3:24 PM
you could try using dependencyInsight to investigate more https://docs.gradle.org/current/userguide/viewing_debugging_dependencies.html#dependency_insights if you add
--debug
in there it will give a lot more information, so search through it and see if there’s anything relevant
h

Humphrey

06/06/2023, 9:15 AM
I've tried a MCVE but that just seems to work with
group:artifact:+
seem to give me always the latest version (or snapshot). I've tried with publishing to maven local. I figured out something. Looks like that somehow only the release repository is being looked for, and not the snapshot see
maven-metadata.xml
below: In nexus my release repository looks like this (i've omitted the long list of versions):
Copy code
<metadata>
	<groupId>my-group</groupId>
	<artifactId>my-artifact</artifactId>
	<versioning>
		<latest>0.1298.0</latest>
		<release>0.1298.0</release>
		<versions>
			<version>0.1280.0</version>
			<version>0.1281.0</version>
			<version>0.1282.0</version>
			<version>0.1283.0</version>
			<version>0.1284.0</version>
			<version>0.1289.0</version>
			<version>0.1290.0</version>
			<version>0.1294.0</version>
			<version>0.1295.0</version>
			<version>0.1296.0</version>
			<version>0.1298.0</version>
		</versions>
		<lastUpdated>20230516101139</lastUpdated>
	</versioning>
</metadata>
and the snapshot:
Copy code
<metadata>
	<groupId>my-group</groupId>
	<artifactId>my-artifact</artifactId>
	<versioning>
		<latest>0.1306.0-PR-13-SNAPSHOT</latest>
		<versions>
			<version>0.1306.0-bugfix-publish-SNAPSHOT</version>
			<version>0.1306.0-PR-13-SNAPSHOT</version>
		</versions>
		<lastUpdated>20230606051712</lastUpdated>
	</versioning>
</metadata>
How do I configure gradle to look for both? I've now this in my configuration, maybe does the order matter? Should I put the snapshot first?
Copy code
repositories {
    mavenLocal()
    maven("<https://my-nexus:8443/repository/public/>")
    maven(releasesRepoUrl)
    maven(snapshotsRepoUrl)
}
a

Adam S

06/06/2023, 9:16 AM
do you have any
init.gradle
(or
init.gradle.kts
) scripts that might be adding / restricting repository contents?
h

Humphrey

06/06/2023, 9:18 AM
Nope, i've just removed all old buid.gradle (groovy) and added build.gradle.kts instead.
a

Adam S

06/06/2023, 9:18 AM
what’s the output of this?
Copy code
./gradlew -q dependencyInsight --dependency my-group:my-artifact --configuration compileClassspath
(you might have to play around with the configuration)
h

Humphrey

06/06/2023, 9:21 AM
You had a typo but after i get this error:
Copy code
configuration 'compileClasspath' not found in configuration container.
a

Adam S

06/06/2023, 9:22 AM
yeah it’s a pain that Gradle requires you know the exact configuration name - try a different name until you find one that works
h

Humphrey

06/06/2023, 9:23 AM
Oh sorry yest this only have testImplementation.. I need to do testCompileClasspath
hmm same error.
a

Adam S

06/06/2023, 9:24 AM
do you have multiple subprojects? Try
Copy code
./gradlew -q :my-subproject:dependencyInsight
h

Humphrey

06/06/2023, 9:25 AM
Yes it's a multi module project..
this is the complete list.
Copy code
FAILURE: Build failed with an exception.

* What went wrong:
configuration 'testCompileClasspath' not found in configuration container.
  Variant apiElements:
    | Attribute Name                     | Provided | Requested    |
    |------------------------------------|----------|--------------|
    | org.gradle.status                  | release  |              |
    | org.gradle.category                | library  | library      |
    | org.gradle.dependency.bundling     | external | external     |
    | org.gradle.jvm.version             | 11       | 11           |
    | org.gradle.libraryelements         | jar      | classes      |
    | org.gradle.usage                   | java-api | java-api     |
    | org.gradle.jvm.environment         |          | standard-jvm |
    | org.jetbrains.kotlin.platform.type |          | jvm          |

my-group:my-artifact:latest.integration -> 0.1298.0
\--- testCompileClasspath

A web-based, searchable dependency report is available by adding the --scan option.
Maybe I should add the info about releases and snapshot to the repositories?
Copy code
repositories {
    maven {
        url = uri("<https://repo.mycompany.com/releases>")
        mavenContent {
            releasesOnly()
        }
    }
    maven {
        url = uri("<https://repo.mycompany.com/snapshots>")
        mavenContent {
            snapshotsOnly()
        }
    }
}
a

Adam S

06/06/2023, 9:37 AM
that certainly wouldn’t hurt! You could even do
includeGroup()
too
h

Humphrey

06/06/2023, 10:02 AM
That didn't help. Thanks for helping anyways.
a

Adam S

06/06/2023, 10:04 AM
can you take a look in your company’s Nexus repo and see if the Gradle Module Metadata files are present too? Not just the POMs
h

Humphrey

06/06/2023, 10:15 AM
We do have • file-sources.jar (md5/sha1/sha256/sha512) • file.jar (md5/sha1/sha256/sha512) • file.module (md5/sha1/sha256/sha512) • file.pom (md5/sha1/sha256/sha512) As well for the snapshot repository as for the release repository.
a

Adam S

06/06/2023, 10:15 AM
that looks normal… so I’m out of ideas!
h

Humphrey

06/06/2023, 10:16 AM
Me too. Thanks anyways.
a

Adam S

06/06/2023, 10:18 AM
my last suggestion is to run the
dependencyInsight
with the
--debug
flag and try digging through the logs to see if there’s any hints
v

Vampire

06/06/2023, 10:48 AM
https://docs.gradle.org/current/userguide/dependency_management_for_java_projects.html
A project can have multiple repositories. Gradle will look for a dependency in each repository in the order they are specified, stopping at the first repository that contains the requested module.
If you specify the snapshot version explicitly, it will not be found in the first repository and thus taken from the second. But if you use a dynamic version, it finds a version in the first respository and does not look in the second. If you swap the order, you will always get the snapshot version, even if there is a newer release version.
To get what you want, define a group repository in your Nexus that delegates to the release and the snapshot repository, then use that group repository in your build. Then you get the behavior you intend.
h

Humphrey

06/06/2023, 10:59 AM
I'll contact someone who knows more about Nexus, think it's more of a nexus issue than gradle.
v

Vampire

06/06/2023, 11:11 AM
We also have a Nexus, you (or rather someone with Nexus configuration access) need to do exactly what I said. :-)
95 Views