In our build process we're currently using MBUnit 2.x tests, called from an NAnt task, called from CruiseControl.NET. I've uprgaded to Gallio and MBUnit 3.x locally and am able to run tests from VS2008. I'm having trouble getting our build process upgraded. It looks like we have two options, either run the tests from CruiseControl.net or from NAnt. Based on this, I have two questions:
With all other things being equal, where should these tests be run, NAnt or CruiseControl.net, or does it really matter at all?
If you like doing this sort of thing in NAnt, do you have any documentation or examples of how to implement it? I've found documentation for the CC.NET soution in my Gallio\extra\CCNet directory in the Gallio installation.
Thanks
Your options for running tests as part of your build with Gallio are similar to what they were with MbUnit v2.
I recommend running the tests from your NAnt or MSBuild scripts using the provided tasks in Gallio.NAntTasks.dll and Gallio.MSBuildTasks.dll.
However, if you want to run the tests directly from the CCNet configuration, then you can add a CCNet task to execute the Gallio.Echo.exe program.
Here's a bit more info on the NAnt task that someone else blogged about. Some of the details have changed in recent releases but it should get you on the right track.
http://testdrivendevelopment.wordpress.com/2008/12/01/use-nant-to-run-mbunit-tests-using-gallio/
Related
I'm evaluating https://wiki.jenkins-ci.org/display/JENKINS/Workflow+Plugin and very like its concept of Groovy DSL in Jenkinsfile under version control. I tried to create different build steps, nodes and stages.
I have a multi-module project and want to have a kind of separate "job" for each module. Each module should have it's own Junit, Findbugs, Checkstyle reports.
However when I tried to collect Junit report it was attached to Workflow job, not it's node or stage.
Question:
Is it possible to create (and update dynamically) a job from Jenkins Workflow plugin DSL? If not, is there any analogue of job that can handle several reports within single workflow?
Since Workflow flow scripts can access the Jenkins model I suspect they can update a job configuration (is that what you mean by the first question?), but don't know if that's its strong suit. That would be a task for Job DSL plugin.
Build steps can invoke other jobs--search for build job in that page--and each of those can have its own publish steps. That might get what you need.
JENKINS-27395 (and analogues for other publishers) would be needed to fully support this use case in one Workflow job. Currently reports from different parts of the build are simply aggregated.
I have created a few coded ui tests and linked them to the test case, and they now appear as automated and you can see the dll they link to in the test case details.
Now that I want to run the tests, MTM refuses to even start the test unless a build is defined.
However: I want to run the tests against a statically installed application in the lab environment. This is an application that I manually install, and I get this application already compiled, so no need to play around building it.
So how can I take the build server out of the loop? I don't need the application built or deployed, I'm already doing that.
All I want is the tests to run on the lab environment specified against an application that is already preinstalled.
It's asking you to define the build of the test solution, assuming that it's different from your application under test. The test assembly will be deployed to the test environment after you specify it in MTM. This article may help you with the specifics.
It is asking you to create a build for your Coded UI test solution. It requires that the tests be built so that it has something to execute when you run the tests. Assuming that your tests were recorded using your statically deployed application then they will test that same application.
i'm new to gradle. If i'm not using the either doFirst() or doLast(). In which order the lines in a plugin(say) are executed. i can observe that they are not executed sequentially?
Can somebody explain the execution flow of a gradle file?
Thanks
The Gradle build lifecycle is documented here.
It can be summarized by "ICE": Initialization, Configuration, Execution.
Your question is focused on Execution. For a single-project build, it is described in section "48.5. Configuration and execution of a single project build" at the above link.
For plugins, the task dependency graph will depend on the plugin specifics. For example, see the Java plugin for a list of its tasks and dependencies.
Is it possible to automatically run a jasmine test suite as part of a cruise control.net build?
And If so how?
My server code is C# and I already had my CI server running lots of unit tests. So I added a unit test that uses Watin to launch a browser to run the Jasmine tests and check the results. It took a morning to get all the pieces playing happily together.
An alternative might be to investigate NJasmine -- I saw this was available on NuGet but didn't pursue this myself partly due to lack of documentation.
Also, if you're using ReSharper, you might like to look at their integration with QUnit: http://blogs.jetbrains.com/dotnet/2011/03/resharper-6-introduces-support-for-javascript-unit-testing/ (there's every chance they'll integrate it with Jasmine too). Although this is aimed at running JS UTs within Visual Studio, you might find it offers you a "hook" to run them from your CI server too.
How can I create build files using ANT Script in iPhone SDK? If it is possible, please tell me how.
You can use the exec task to call out to xcodebuild. This will work, but doesn't give you that much control over the build. You still have to have an Xcode project for it to work. Unless you have a lot of non-Xcode build steps to perform it doesn't buy you much over just invoking xcodebuild from a shell script.