When I am on a multi-module project, I should add the build variant to all the modules ?

it creates a lot unnecessary tasks

create build variants only if you realy-realy need it and only for modules where you need it, you pay with configuration time for it and with double compilation of all your code when switch between variants

We now disable even default build variant “debug” for library modules, use only release and disabled unused combination of flavor and build types