= Designing Gradle plugins

For beginners to Gradle implementing plugins can look like a daunting task that includes many considerations and deep knowledge:
organizing and structuring plugin logic, testing and debugging plugin code as well as publishing the plugin artifact to a repository for consumption.

In this section, you will learn how to properly design Gradle plugins based on established practices and apply them to your own projects.
This section assumes you have:

- Basic understanding of software engineering practices
- Knowledge of Gradle fundamentals like project organization, task creation and configuration as well as the Gradle build lifecycle

== Architecture

=== Reusable logic should be written as binary plugin

The Gradle User Manual differentiates two types of plugins: <<plugins.adoc#sec:types_of_plugins,script plugins and binary plugins>>.
Script plugins are basically just plain old Gradle build scripts with a different name.
While script plugins have their place for organizing build logic in a Gradle project, it’s hard to keep them well-maintained, they are hard to test and you can’t define new reusable types in them.

<<plugins.adoc#sec:binary_plugins,Binary plugins>> should be used whenever logic needs to be reused or shared across independent projects.
They allow for properly structuring code into classes and packages, are cachable, can follow a versioning scheme to enable smooth upgrade procedures and are easily testable.

=== Consider the impact on performance

As a developer of Gradle plugins you have full freedom in defining and organizing code.
Any logic imaginable can be implemented.
When designing Gradle plugins always be aware of the impact on the end user.
Seemingly simple logic can have a considerable impact on the execution performance of a build.
That’s especially the case when code of a plugin is executed during the <<build_lifecycle.adoc#sec:build_phases,configuration phase of the build lifecycle>> e.g.
resolving dependencies by iterating over them, making HTTP calls or writing to files.
The section on <<performance.adoc#performance_gradle,optimizing Gradle build performance>> will give you additional code examples, pitfalls and recommendations.

As you write plugin code ask yourself whether the code shouldn’t rather be run during the execution phase.
If you suspect issues with your plugin code, try creating a link:https://scans.gradle.com/[build scan] to identify bottlenecks.
The link:https://github.com/gradle/gradle-profiler[Gradle profiler] can help with automating build scan generation and gathering more low-level information.

=== Convention over configuration

link:https://en.wikipedia.org/wiki/Convention_over_configuration[Convention over configuration] is a software engineering paradigm that allows a tool or framework to make an attempt at decreasing the number of decisions the user has to make without losing its flexibility.
What does that mean for Gradle plugins? Gradle plugins can provide users with sensible defaults and standards (_conventions_) in a certain context.
Let’s take the <<java_plugin.adoc#java_plugin,Java plugin>> as an example.

- It defines the directory _src/main/java_ as the default source directory for compilation.
- The output directory for compiled source code and other artifacts (like the JAR file) is _build_.

As long as the user of the plugin does not prefer to use other conventions, no additional configuration is needed in the consuming build script.
It simply works out-of-the-box.
However, if the user prefers other standards, then the default conventions can be reconfigured.
You get the best of both worlds.

In practice you will find that most users are comfortable with the default conventions until there’s a good reason to change them e.g.
if you have to work with a legacy project.
When writing your own plugins, make sure that you pick sensible defaults.
You can find out if you did pick sensible conventions for your plugin if you see that the majority of plugin consumers don’t have to reconfigure them.

Let’s have a look at an example for conventions introduced by a plugin.
The plugin retrieves information from a server by making HTTP calls.
The default URL used by the plugin is configured to point to a server within an organization developing the plugin: +++https://www.myorg.com/server+++.
A good way to make the default URL configurable is to introduce an <<custom_plugins.adoc#sec:getting_input_from_the_build,extension>>.
An extension exposes a custom DSL for capturing user input that influences the runtime behavior.
The following example shows such a custom DSL for the discussed example:

.build.gradle
====
include::sample[dir="snippets/developingPlugins/conventionOverConfiguration/groovy",files="build.gradle[]"]
include::sample[dir="snippets/developingPlugins/conventionOverConfiguration/kotlin",files="build.gradle.kts[]"]
====

As you can see, the user only declares the "what" - the server the plugin should reach out to.
The actual inner workings - the "how" - is completely hidden from the end user.

[[capabilities-vs-conventions]]
=== Capabilities vs. conventions

The functionality brought in by a plugin can be extremely powerful but also very opinionated.
That’s especially the case if a plugin predefines tasks and conventions that a project inherits automatically when applying it.
Sometimes the reality that you - as plugin developer - choose for your users might simply look different than expected.
For that very reason you need to make a plugin as flexible and configurable as possible.

One way to provide these quality criteria is to separate capabilities from conventions.
In practice that means separating general-purpose functionality from pre-configured, opinionated functionality.
Let’s have a look at an example to explain this seemingly abstract concept.
There are two Gradle core plugins that demonstrate the concept perfectly:
the link:{javadocPath}/org/gradle/api/plugins/JavaBasePlugin.html[Java Base plugin] and the <<java_plugin.adoc#java_plugin,Java plugin>>.

- The Java Base plugin just provided un-opinionated functionality and general purpose concepts.
  For example it formalized the concept of a SourceSet and introduces dependency management configurations.
  However, it doesn’t actually create tasks you’d use as a Java developer on a regular basis nor does it create instances of source set.
- The Java plugin applies the Java Base plugin internally and inherits all its functionality.
  On top, it creates source set instances like `main` and `test`, creates tasks well-known to Java developers like `classes`, `jar` or `javadoc`.
  It also establishes a lifecycle between those tasks that make sense for the domain.

The bottom line is that we _separated capabilities from conventions_.
If a user decides that he doesn’t like the tasks created or doesn’t want to reconfigure a lot of the conventions because that’s not how the project structure looks like, then he can just fall back to applying the Java Base plugin and take matters into his own hands.

You should consider using the same technique when designing your own plugins.
You can develop both plugins within the same project and ship their compiled classes and identifiers with the same binary artifact.
The following code example shows how to apply a plugin from another one, so-called plugin composition:

.MyBasePlugin.java
[source,java]
----
include::{snippetsPath}/developingPlugins/capabilitiesVsConventions/groovy/buildSrc/src/main/java/MyBasePlugin.java[]
----

.MyPlugin.java
[source,java]
----
include::{snippetsPath}/developingPlugins/capabilitiesVsConventions/groovy/buildSrc/src/main/java/MyPlugin.java[]
----

For inspiration, here are two open-source plugins that apply the concept:

- link:https://bmuschko.github.io/gradle-docker-plugin/#provided_plugins[Docker plugin]
- link:https://github.com/bmuschko/gradle-cargo-plugin#provided-plugins[Cargo plugin]

== Technologies

=== Prefer using a statically-typed language to implement a plugin

Gradle doesn’t take a stance on the programming language you should choose for implementing a plugin.
It’s a developer’s choice as long as the plugin binary can be executed on the JVM.

It is recommended to use a statically-typed language like Java or Kotlin for implementing plugins to decrease the likelihood of binary incompatibilities.
Should you decide on using Groovy for your plugin implementation then it is a good choice to use the annotation link:https://docs.groovy-lang.org/latest/html/gapi/groovy/transform/CompileStatic.html[@groovy.transform.CompileStatic].

The recommendation to use a statically-typed language is independent from the language choice for writing tests for your plugin code.
The use of dynamic Groovy and (its very capable testing and mocking framework) link:http://spockframework.org[Spock] is a very viable and common option.

[[restricting_the_plugin_implementation_to_gradle_s_public_api]]
=== Restricting the plugin implementation to Gradle’s public API

To be able to build a Gradle plugin you’ll need to tell your project to use a compile-time dependency on the Gradle API.
Your build script would usually contain the following declaration:

====
include::sample[dir="snippets/base/customExternalTask/groovy/task",files="build.gradle[tags=gradle-api-dependencies]"]
include::sample[dir="snippets/base/customExternalTask/kotlin/task",files="build.gradle.kts[tags=gradle-api-dependencies]"]
====

It’s important to understand that this dependency includes the full Gradle runtime.
For historical reasons, public and internal Gradle API have not been separated yet.

To ensure the best backward and forward compatibility with other Gradle versions you should only use the public API.
In most cases it will support the use case you are trying to support with your plugin.
Keep in mind that internal APIs are subject to change and can easily break your plugin from one Gradle version to another.
Please link:https://github.com/gradle/gradle/issues[open an issue on GitHub] if you are looking for a public API that is currently internal-only.

How do you know if a class is part of the public API?
If you can find the class referenced in the link:{groovyDslPath}[DSL guide] or the link:{javadocPath}[Javadocs] then you can safely assume that it is public.
In the future, we are planning to clearly separate public from internal API which will allow end users to declare the relevant dependency in the build script.

=== Minimizing the use of external libraries

As application developers we have become quite accustomed to the use of external libraries to avoid having to write fundamental functionality.
You likely do not want to go without your beloved Guava or HttpClient library anymore.
Keep in mind that some of the libraries might pull in a huge graph of transitive dependencies when declared through Gradle’s dependency management system.
The dependency report does not render dependencies declared for the `classpath` configuration of the build script, effectively the classpath of the declared plugins and their transitive dependencies.
However, you can call the help task `buildEnvironment` to render the full dependency graph.
To demonstrate the functionality let’s assume the following build script:

====
include::sample[dir="snippets/developingPlugins/externalLibraries/groovy",files="build.gradle[]"]
include::sample[dir="snippets/developingPlugins/externalLibraries/kotlin",files="build.gradle.kts[]"]
====

The output of the task clearly indicates the classpath of the `classpath` configuration:

----
$ gradle buildEnvironment
include::{snippetsPath}/developingPlugins/externalLibraries/tests/buildEnvironment.out[]
----

It’s important to understand that a Gradle plugin does not run in its own, isolated classloader.
In turn those dependencies might conflict with other versions of the same library being resolved from other plugins and might lead to unexpected runtime behavior.
When writing Gradle plugins consider if you really need a specific library or if you could just implement a simple method yourself.
A future version of Gradle will introduce proper classpath isolation for plugins.

