Maven build not failing on failed scenarios

[future2r]

After days of trying I did not find a way to let the Maven build fail if a Cucumber scenario fails. What am I missing?

Here a minimal example of that build setup. It uses Maven Wrapper to simplify things. Just have a Java 21 in your JAVA_HOME and it shall run.

cucumber-problem.zip

[luke-hill]

@future2r As an FYI, we're unlikely to download a random zip from the internet. If you can make a github repo that we can see the problem then we might be inclined to take a look

[future2r]

Sure, here it is: Minimal Example

[mpkorstanje]

At a glance there are quite a few remarkable items:

1. You're using Maven Surefire and Failsafe 3.5.3 which is quite broken for any project using JUnit 5, including Cucumber (Surefire 3.5.3 does not include Cucumber scenarios in test summary count cucumber-jvm#2984).
2. You're importing both junit-jupiter and -api. This is unnesseary the -api is a dependency of junit-jupiter. Same for junit-platform-suite and -api.
3. You don't need any of the junit-jupiter dependencies, the junit-platform-suite alone should be sufficient. Especially if you use AssertJ for your assertions.
4. Both Surefire and Failsafe are configured to only run CucumberTest.java. Your test however is named CalculatorCucumberTest. That said, if you follow the naming conventions from Maven, you don't have to explicitly specify any tests at all.
5. The key configured in @ConfigurationParameter(key = "cucumber.execution.failure-strategy", value = "fail") doesn't exist. Did you use a large language model to create this project?

I'd recommend that you follow the 10-Minute tutorial first to get a working project first and only then shape that further.

[future2r]

Thank you very much! The latest versions of Surefire and Failsafe were causing the problem.
Also, thank you for your other hints. It makes the setup clearer.

I created the project manually, as a minimal example from a much larger project. And yes, you caught me. In my despair I consulted an LLM. The property was an oddment of that attempt. :-)